00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2028 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3288 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.103 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.104 The recommended git tool is: git 00:00:00.104 using credential 00000000-0000-0000-0000-000000000002 00:00:00.105 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.163 Fetching changes from the remote Git repository 00:00:00.165 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.214 Using shallow fetch with depth 1 00:00:00.214 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.215 > git --version # timeout=10 00:00:00.259 > git --version # 'git version 2.39.2' 00:00:00.259 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.297 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.297 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.754 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.765 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.776 Checking out Revision 6b67f5fa1cb27c9c410cb5dac6df31d28ba79422 (FETCH_HEAD) 00:00:06.776 > git config core.sparsecheckout # timeout=10 00:00:06.785 > git read-tree -mu HEAD # timeout=10 00:00:06.801 > git checkout -f 6b67f5fa1cb27c9c410cb5dac6df31d28ba79422 # timeout=5 00:00:06.818 Commit message: "doc: add chapter about running CI Vagrant images on dev-systems" 00:00:06.818 > git rev-list --no-walk 6b67f5fa1cb27c9c410cb5dac6df31d28ba79422 # timeout=10 00:00:06.955 [Pipeline] Start of Pipeline 00:00:06.967 [Pipeline] library 00:00:06.968 Loading library shm_lib@master 00:00:06.968 Library shm_lib@master is cached. Copying from home. 00:00:06.982 [Pipeline] node 00:00:07.001 Running on WFP8 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:07.002 [Pipeline] { 00:00:07.010 [Pipeline] catchError 00:00:07.011 [Pipeline] { 00:00:07.020 [Pipeline] wrap 00:00:07.027 [Pipeline] { 00:00:07.032 [Pipeline] stage 00:00:07.033 [Pipeline] { (Prologue) 00:00:07.268 [Pipeline] sh 00:00:07.552 + logger -p user.info -t JENKINS-CI 00:00:07.570 [Pipeline] echo 00:00:07.572 Node: WFP8 00:00:07.579 [Pipeline] sh 00:00:07.876 [Pipeline] setCustomBuildProperty 00:00:07.887 [Pipeline] echo 00:00:07.889 Cleanup processes 00:00:07.894 [Pipeline] sh 00:00:08.176 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.176 3134459 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.188 [Pipeline] sh 00:00:08.470 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.470 ++ grep -v 'sudo pgrep' 00:00:08.470 ++ awk '{print $1}' 00:00:08.470 + sudo kill -9 00:00:08.470 + true 00:00:08.487 [Pipeline] cleanWs 00:00:08.497 [WS-CLEANUP] Deleting project workspace... 00:00:08.497 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.502 [WS-CLEANUP] done 00:00:08.506 [Pipeline] setCustomBuildProperty 00:00:08.518 [Pipeline] sh 00:00:08.796 + sudo git config --global --replace-all safe.directory '*' 00:00:08.886 [Pipeline] httpRequest 00:00:08.924 [Pipeline] echo 00:00:08.925 Sorcerer 10.211.164.101 is alive 00:00:08.930 [Pipeline] httpRequest 00:00:08.934 HttpMethod: GET 00:00:08.934 URL: http://10.211.164.101/packages/jbp_6b67f5fa1cb27c9c410cb5dac6df31d28ba79422.tar.gz 00:00:08.935 Sending request to url: http://10.211.164.101/packages/jbp_6b67f5fa1cb27c9c410cb5dac6df31d28ba79422.tar.gz 00:00:08.953 Response Code: HTTP/1.1 200 OK 00:00:08.954 Success: Status code 200 is in the accepted range: 200,404 00:00:08.954 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_6b67f5fa1cb27c9c410cb5dac6df31d28ba79422.tar.gz 00:00:17.356 [Pipeline] sh 00:00:17.636 + tar --no-same-owner -xf jbp_6b67f5fa1cb27c9c410cb5dac6df31d28ba79422.tar.gz 00:00:17.651 [Pipeline] httpRequest 00:00:17.678 [Pipeline] echo 00:00:17.680 Sorcerer 10.211.164.101 is alive 00:00:17.690 [Pipeline] httpRequest 00:00:17.694 HttpMethod: GET 00:00:17.695 URL: http://10.211.164.101/packages/spdk_dbef7efacb6f3438cd0fe1344a67946669fb1419.tar.gz 00:00:17.695 Sending request to url: http://10.211.164.101/packages/spdk_dbef7efacb6f3438cd0fe1344a67946669fb1419.tar.gz 00:00:17.708 Response Code: HTTP/1.1 200 OK 00:00:17.709 Success: Status code 200 is in the accepted range: 200,404 00:00:17.710 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_dbef7efacb6f3438cd0fe1344a67946669fb1419.tar.gz 00:00:47.027 [Pipeline] sh 00:00:47.309 + tar --no-same-owner -xf spdk_dbef7efacb6f3438cd0fe1344a67946669fb1419.tar.gz 00:00:49.855 [Pipeline] sh 00:00:50.137 + git -C spdk log --oneline -n5 00:00:50.137 dbef7efac test: fix dpdk builds on ubuntu24 00:00:50.137 4b94202c6 lib/event: Bug fix for framework_set_scheduler 00:00:50.137 507e9ba07 nvme: add lock_depth for ctrlr_lock 00:00:50.137 62fda7b5f nvme: check pthread_mutex_destroy() return value 00:00:50.137 e03c164a1 nvme: add nvme_ctrlr_lock 00:00:50.148 [Pipeline] } 00:00:50.164 [Pipeline] // stage 00:00:50.172 [Pipeline] stage 00:00:50.174 [Pipeline] { (Prepare) 00:00:50.191 [Pipeline] writeFile 00:00:50.208 [Pipeline] sh 00:00:50.492 + logger -p user.info -t JENKINS-CI 00:00:50.504 [Pipeline] sh 00:00:50.820 + logger -p user.info -t JENKINS-CI 00:00:50.833 [Pipeline] sh 00:00:51.115 + cat autorun-spdk.conf 00:00:51.115 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:51.115 SPDK_TEST_NVMF=1 00:00:51.115 SPDK_TEST_NVME_CLI=1 00:00:51.115 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:51.115 SPDK_TEST_NVMF_NICS=e810 00:00:51.115 SPDK_RUN_UBSAN=1 00:00:51.115 NET_TYPE=phy 00:00:51.122 RUN_NIGHTLY=1 00:00:51.127 [Pipeline] readFile 00:00:51.151 [Pipeline] withEnv 00:00:51.154 [Pipeline] { 00:00:51.167 [Pipeline] sh 00:00:51.450 + set -ex 00:00:51.450 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:51.450 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:51.450 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:51.450 ++ SPDK_TEST_NVMF=1 00:00:51.450 ++ SPDK_TEST_NVME_CLI=1 00:00:51.450 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:51.450 ++ SPDK_TEST_NVMF_NICS=e810 00:00:51.450 ++ SPDK_RUN_UBSAN=1 00:00:51.450 ++ NET_TYPE=phy 00:00:51.450 ++ RUN_NIGHTLY=1 00:00:51.450 + case $SPDK_TEST_NVMF_NICS in 00:00:51.450 + DRIVERS=ice 00:00:51.450 + [[ tcp == \r\d\m\a ]] 00:00:51.450 + [[ -n ice ]] 00:00:51.450 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:51.450 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:51.450 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:51.450 rmmod: ERROR: Module irdma is not currently loaded 00:00:51.450 rmmod: ERROR: Module i40iw is not currently loaded 00:00:51.450 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:51.450 + true 00:00:51.450 + for D in $DRIVERS 00:00:51.450 + sudo modprobe ice 00:00:51.450 + exit 0 00:00:51.459 [Pipeline] } 00:00:51.474 [Pipeline] // withEnv 00:00:51.478 [Pipeline] } 00:00:51.531 [Pipeline] // stage 00:00:51.541 [Pipeline] catchError 00:00:51.542 [Pipeline] { 00:00:51.551 [Pipeline] timeout 00:00:51.551 Timeout set to expire in 50 min 00:00:51.552 [Pipeline] { 00:00:51.561 [Pipeline] stage 00:00:51.562 [Pipeline] { (Tests) 00:00:51.572 [Pipeline] sh 00:00:51.853 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:51.853 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:51.853 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:51.853 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:51.853 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:51.853 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:51.853 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:51.853 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:51.853 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:51.853 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:51.853 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:00:51.853 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:51.853 + source /etc/os-release 00:00:51.853 ++ NAME='Fedora Linux' 00:00:51.853 ++ VERSION='38 (Cloud Edition)' 00:00:51.853 ++ ID=fedora 00:00:51.853 ++ VERSION_ID=38 00:00:51.853 ++ VERSION_CODENAME= 00:00:51.853 ++ PLATFORM_ID=platform:f38 00:00:51.853 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:00:51.853 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:51.853 ++ LOGO=fedora-logo-icon 00:00:51.853 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:00:51.853 ++ HOME_URL=https://fedoraproject.org/ 00:00:51.853 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:00:51.853 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:51.853 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:51.853 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:51.853 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:00:51.853 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:51.853 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:00:51.853 ++ SUPPORT_END=2024-05-14 00:00:51.853 ++ VARIANT='Cloud Edition' 00:00:51.853 ++ VARIANT_ID=cloud 00:00:51.853 + uname -a 00:00:51.853 Linux spdk-wfp-08 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:00:51.853 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:00:54.388 Hugepages 00:00:54.388 node hugesize free / total 00:00:54.388 node0 1048576kB 0 / 0 00:00:54.388 node0 2048kB 0 / 0 00:00:54.388 node1 1048576kB 0 / 0 00:00:54.388 node1 2048kB 0 / 0 00:00:54.388 00:00:54.388 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:54.388 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:00:54.388 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:00:54.388 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:00:54.388 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:00:54.388 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:00:54.388 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:00:54.388 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:00:54.388 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:00:54.388 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:00:54.389 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:00:54.389 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:00:54.389 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:00:54.389 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:00:54.389 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:00:54.389 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:00:54.389 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:00:54.389 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:00:54.389 + rm -f /tmp/spdk-ld-path 00:00:54.389 + source autorun-spdk.conf 00:00:54.389 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:54.389 ++ SPDK_TEST_NVMF=1 00:00:54.389 ++ SPDK_TEST_NVME_CLI=1 00:00:54.389 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:54.389 ++ SPDK_TEST_NVMF_NICS=e810 00:00:54.389 ++ SPDK_RUN_UBSAN=1 00:00:54.389 ++ NET_TYPE=phy 00:00:54.389 ++ RUN_NIGHTLY=1 00:00:54.389 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:54.389 + [[ -n '' ]] 00:00:54.389 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:54.389 + for M in /var/spdk/build-*-manifest.txt 00:00:54.389 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:54.389 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:54.389 + for M in /var/spdk/build-*-manifest.txt 00:00:54.389 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:54.389 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:54.389 ++ uname 00:00:54.389 + [[ Linux == \L\i\n\u\x ]] 00:00:54.389 + sudo dmesg -T 00:00:54.389 + sudo dmesg --clear 00:00:54.389 + dmesg_pid=3135898 00:00:54.389 + [[ Fedora Linux == FreeBSD ]] 00:00:54.389 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:54.389 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:54.389 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:54.389 + export VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:54.389 + VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:54.389 + [[ -x /usr/src/fio-static/fio ]] 00:00:54.389 + export FIO_BIN=/usr/src/fio-static/fio 00:00:54.389 + FIO_BIN=/usr/src/fio-static/fio 00:00:54.389 + sudo dmesg -Tw 00:00:54.389 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:54.389 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:54.389 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:54.389 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:54.389 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:54.389 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:54.389 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:54.389 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:54.389 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:54.389 Test configuration: 00:00:54.389 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:54.389 SPDK_TEST_NVMF=1 00:00:54.389 SPDK_TEST_NVME_CLI=1 00:00:54.389 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:54.389 SPDK_TEST_NVMF_NICS=e810 00:00:54.389 SPDK_RUN_UBSAN=1 00:00:54.389 NET_TYPE=phy 00:00:54.389 RUN_NIGHTLY=1 20:06:26 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:00:54.389 20:06:26 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:54.389 20:06:26 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:54.389 20:06:26 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:54.389 20:06:26 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:54.389 20:06:26 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:54.389 20:06:26 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:54.389 20:06:26 -- paths/export.sh@5 -- $ export PATH 00:00:54.389 20:06:26 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:54.389 20:06:26 -- common/autobuild_common.sh@437 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:00:54.389 20:06:26 -- common/autobuild_common.sh@438 -- $ date +%s 00:00:54.389 20:06:26 -- common/autobuild_common.sh@438 -- $ mktemp -dt spdk_1721671586.XXXXXX 00:00:54.389 20:06:26 -- common/autobuild_common.sh@438 -- $ SPDK_WORKSPACE=/tmp/spdk_1721671586.wQw0E3 00:00:54.389 20:06:26 -- common/autobuild_common.sh@440 -- $ [[ -n '' ]] 00:00:54.389 20:06:26 -- common/autobuild_common.sh@444 -- $ '[' -n '' ']' 00:00:54.389 20:06:26 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:00:54.389 20:06:26 -- common/autobuild_common.sh@451 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:54.389 20:06:26 -- common/autobuild_common.sh@453 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:54.389 20:06:26 -- common/autobuild_common.sh@454 -- $ get_config_params 00:00:54.389 20:06:26 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:00:54.389 20:06:26 -- common/autotest_common.sh@10 -- $ set +x 00:00:54.389 20:06:26 -- common/autobuild_common.sh@454 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:54.389 20:06:26 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:54.389 20:06:26 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:54.389 20:06:26 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:54.389 20:06:26 -- spdk/autobuild.sh@16 -- $ date -u 00:00:54.389 Mon Jul 22 06:06:26 PM UTC 2024 00:00:54.389 20:06:26 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:54.389 LTS-60-gdbef7efac 00:00:54.389 20:06:26 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:54.389 20:06:26 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:54.389 20:06:26 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:54.389 20:06:26 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:00:54.389 20:06:26 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:00:54.389 20:06:26 -- common/autotest_common.sh@10 -- $ set +x 00:00:54.389 ************************************ 00:00:54.389 START TEST ubsan 00:00:54.389 ************************************ 00:00:54.389 20:06:26 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:00:54.389 using ubsan 00:00:54.389 00:00:54.389 real 0m0.000s 00:00:54.389 user 0m0.000s 00:00:54.389 sys 0m0.000s 00:00:54.389 20:06:26 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:00:54.389 20:06:26 -- common/autotest_common.sh@10 -- $ set +x 00:00:54.389 ************************************ 00:00:54.389 END TEST ubsan 00:00:54.389 ************************************ 00:00:54.648 20:06:26 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:54.648 20:06:26 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:54.648 20:06:26 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:54.648 20:06:26 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:54.648 20:06:26 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:54.648 20:06:26 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:54.648 20:06:26 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:54.648 20:06:26 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:54.648 20:06:26 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:54.648 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:00:54.648 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:00:54.907 Using 'verbs' RDMA provider 00:01:07.684 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:17.663 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:17.663 Creating mk/config.mk...done. 00:01:17.663 Creating mk/cc.flags.mk...done. 00:01:17.663 Type 'make' to build. 00:01:17.663 20:06:49 -- spdk/autobuild.sh@69 -- $ run_test make make -j96 00:01:17.663 20:06:49 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:17.663 20:06:49 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:17.663 20:06:49 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.664 ************************************ 00:01:17.664 START TEST make 00:01:17.664 ************************************ 00:01:17.664 20:06:49 -- common/autotest_common.sh@1104 -- $ make -j96 00:01:17.922 make[1]: Nothing to be done for 'all'. 00:01:26.056 The Meson build system 00:01:26.056 Version: 1.3.1 00:01:26.056 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:26.056 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:26.056 Build type: native build 00:01:26.056 Program cat found: YES (/usr/bin/cat) 00:01:26.056 Project name: DPDK 00:01:26.056 Project version: 23.11.0 00:01:26.056 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:26.056 C linker for the host machine: cc ld.bfd 2.39-16 00:01:26.056 Host machine cpu family: x86_64 00:01:26.056 Host machine cpu: x86_64 00:01:26.056 Message: ## Building in Developer Mode ## 00:01:26.056 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:26.056 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:26.057 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:26.057 Program python3 found: YES (/usr/bin/python3) 00:01:26.057 Program cat found: YES (/usr/bin/cat) 00:01:26.057 Compiler for C supports arguments -march=native: YES 00:01:26.057 Checking for size of "void *" : 8 00:01:26.057 Checking for size of "void *" : 8 (cached) 00:01:26.057 Library m found: YES 00:01:26.057 Library numa found: YES 00:01:26.057 Has header "numaif.h" : YES 00:01:26.057 Library fdt found: NO 00:01:26.057 Library execinfo found: NO 00:01:26.057 Has header "execinfo.h" : YES 00:01:26.057 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:26.057 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:26.057 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:26.057 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:26.057 Run-time dependency openssl found: YES 3.0.9 00:01:26.057 Run-time dependency libpcap found: YES 1.10.4 00:01:26.057 Has header "pcap.h" with dependency libpcap: YES 00:01:26.057 Compiler for C supports arguments -Wcast-qual: YES 00:01:26.057 Compiler for C supports arguments -Wdeprecated: YES 00:01:26.057 Compiler for C supports arguments -Wformat: YES 00:01:26.057 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:26.057 Compiler for C supports arguments -Wformat-security: NO 00:01:26.057 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:26.057 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:26.057 Compiler for C supports arguments -Wnested-externs: YES 00:01:26.057 Compiler for C supports arguments -Wold-style-definition: YES 00:01:26.057 Compiler for C supports arguments -Wpointer-arith: YES 00:01:26.057 Compiler for C supports arguments -Wsign-compare: YES 00:01:26.057 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:26.057 Compiler for C supports arguments -Wundef: YES 00:01:26.057 Compiler for C supports arguments -Wwrite-strings: YES 00:01:26.057 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:26.057 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:26.057 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:26.057 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:26.057 Program objdump found: YES (/usr/bin/objdump) 00:01:26.057 Compiler for C supports arguments -mavx512f: YES 00:01:26.057 Checking if "AVX512 checking" compiles: YES 00:01:26.057 Fetching value of define "__SSE4_2__" : 1 00:01:26.057 Fetching value of define "__AES__" : 1 00:01:26.057 Fetching value of define "__AVX__" : 1 00:01:26.057 Fetching value of define "__AVX2__" : 1 00:01:26.057 Fetching value of define "__AVX512BW__" : 1 00:01:26.057 Fetching value of define "__AVX512CD__" : 1 00:01:26.057 Fetching value of define "__AVX512DQ__" : 1 00:01:26.057 Fetching value of define "__AVX512F__" : 1 00:01:26.057 Fetching value of define "__AVX512VL__" : 1 00:01:26.057 Fetching value of define "__PCLMUL__" : 1 00:01:26.057 Fetching value of define "__RDRND__" : 1 00:01:26.057 Fetching value of define "__RDSEED__" : 1 00:01:26.057 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:26.057 Fetching value of define "__znver1__" : (undefined) 00:01:26.057 Fetching value of define "__znver2__" : (undefined) 00:01:26.057 Fetching value of define "__znver3__" : (undefined) 00:01:26.057 Fetching value of define "__znver4__" : (undefined) 00:01:26.057 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:26.057 Message: lib/log: Defining dependency "log" 00:01:26.057 Message: lib/kvargs: Defining dependency "kvargs" 00:01:26.057 Message: lib/telemetry: Defining dependency "telemetry" 00:01:26.057 Checking for function "getentropy" : NO 00:01:26.057 Message: lib/eal: Defining dependency "eal" 00:01:26.057 Message: lib/ring: Defining dependency "ring" 00:01:26.057 Message: lib/rcu: Defining dependency "rcu" 00:01:26.057 Message: lib/mempool: Defining dependency "mempool" 00:01:26.057 Message: lib/mbuf: Defining dependency "mbuf" 00:01:26.057 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:26.057 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:26.057 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:26.057 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:26.057 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:26.057 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:01:26.057 Compiler for C supports arguments -mpclmul: YES 00:01:26.057 Compiler for C supports arguments -maes: YES 00:01:26.057 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:26.057 Compiler for C supports arguments -mavx512bw: YES 00:01:26.057 Compiler for C supports arguments -mavx512dq: YES 00:01:26.057 Compiler for C supports arguments -mavx512vl: YES 00:01:26.057 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:26.057 Compiler for C supports arguments -mavx2: YES 00:01:26.057 Compiler for C supports arguments -mavx: YES 00:01:26.057 Message: lib/net: Defining dependency "net" 00:01:26.057 Message: lib/meter: Defining dependency "meter" 00:01:26.057 Message: lib/ethdev: Defining dependency "ethdev" 00:01:26.057 Message: lib/pci: Defining dependency "pci" 00:01:26.057 Message: lib/cmdline: Defining dependency "cmdline" 00:01:26.057 Message: lib/hash: Defining dependency "hash" 00:01:26.057 Message: lib/timer: Defining dependency "timer" 00:01:26.057 Message: lib/compressdev: Defining dependency "compressdev" 00:01:26.057 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:26.057 Message: lib/dmadev: Defining dependency "dmadev" 00:01:26.057 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:26.057 Message: lib/power: Defining dependency "power" 00:01:26.058 Message: lib/reorder: Defining dependency "reorder" 00:01:26.058 Message: lib/security: Defining dependency "security" 00:01:26.058 Has header "linux/userfaultfd.h" : YES 00:01:26.058 Has header "linux/vduse.h" : YES 00:01:26.058 Message: lib/vhost: Defining dependency "vhost" 00:01:26.058 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:26.058 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:26.058 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:26.058 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:26.058 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:26.058 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:26.058 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:26.058 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:26.058 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:26.058 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:26.058 Program doxygen found: YES (/usr/bin/doxygen) 00:01:26.058 Configuring doxy-api-html.conf using configuration 00:01:26.058 Configuring doxy-api-man.conf using configuration 00:01:26.058 Program mandb found: YES (/usr/bin/mandb) 00:01:26.058 Program sphinx-build found: NO 00:01:26.058 Configuring rte_build_config.h using configuration 00:01:26.058 Message: 00:01:26.058 ================= 00:01:26.058 Applications Enabled 00:01:26.058 ================= 00:01:26.058 00:01:26.058 apps: 00:01:26.058 00:01:26.058 00:01:26.058 Message: 00:01:26.058 ================= 00:01:26.058 Libraries Enabled 00:01:26.058 ================= 00:01:26.058 00:01:26.058 libs: 00:01:26.058 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:26.058 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:26.058 cryptodev, dmadev, power, reorder, security, vhost, 00:01:26.058 00:01:26.058 Message: 00:01:26.058 =============== 00:01:26.058 Drivers Enabled 00:01:26.058 =============== 00:01:26.058 00:01:26.058 common: 00:01:26.058 00:01:26.058 bus: 00:01:26.058 pci, vdev, 00:01:26.058 mempool: 00:01:26.058 ring, 00:01:26.058 dma: 00:01:26.058 00:01:26.058 net: 00:01:26.058 00:01:26.058 crypto: 00:01:26.058 00:01:26.058 compress: 00:01:26.058 00:01:26.058 vdpa: 00:01:26.058 00:01:26.058 00:01:26.058 Message: 00:01:26.058 ================= 00:01:26.058 Content Skipped 00:01:26.058 ================= 00:01:26.058 00:01:26.058 apps: 00:01:26.058 dumpcap: explicitly disabled via build config 00:01:26.058 graph: explicitly disabled via build config 00:01:26.058 pdump: explicitly disabled via build config 00:01:26.058 proc-info: explicitly disabled via build config 00:01:26.058 test-acl: explicitly disabled via build config 00:01:26.058 test-bbdev: explicitly disabled via build config 00:01:26.058 test-cmdline: explicitly disabled via build config 00:01:26.058 test-compress-perf: explicitly disabled via build config 00:01:26.058 test-crypto-perf: explicitly disabled via build config 00:01:26.058 test-dma-perf: explicitly disabled via build config 00:01:26.058 test-eventdev: explicitly disabled via build config 00:01:26.058 test-fib: explicitly disabled via build config 00:01:26.058 test-flow-perf: explicitly disabled via build config 00:01:26.058 test-gpudev: explicitly disabled via build config 00:01:26.058 test-mldev: explicitly disabled via build config 00:01:26.058 test-pipeline: explicitly disabled via build config 00:01:26.058 test-pmd: explicitly disabled via build config 00:01:26.058 test-regex: explicitly disabled via build config 00:01:26.058 test-sad: explicitly disabled via build config 00:01:26.058 test-security-perf: explicitly disabled via build config 00:01:26.058 00:01:26.058 libs: 00:01:26.058 metrics: explicitly disabled via build config 00:01:26.058 acl: explicitly disabled via build config 00:01:26.058 bbdev: explicitly disabled via build config 00:01:26.058 bitratestats: explicitly disabled via build config 00:01:26.058 bpf: explicitly disabled via build config 00:01:26.058 cfgfile: explicitly disabled via build config 00:01:26.058 distributor: explicitly disabled via build config 00:01:26.058 efd: explicitly disabled via build config 00:01:26.058 eventdev: explicitly disabled via build config 00:01:26.058 dispatcher: explicitly disabled via build config 00:01:26.058 gpudev: explicitly disabled via build config 00:01:26.058 gro: explicitly disabled via build config 00:01:26.058 gso: explicitly disabled via build config 00:01:26.058 ip_frag: explicitly disabled via build config 00:01:26.058 jobstats: explicitly disabled via build config 00:01:26.058 latencystats: explicitly disabled via build config 00:01:26.058 lpm: explicitly disabled via build config 00:01:26.058 member: explicitly disabled via build config 00:01:26.058 pcapng: explicitly disabled via build config 00:01:26.058 rawdev: explicitly disabled via build config 00:01:26.058 regexdev: explicitly disabled via build config 00:01:26.058 mldev: explicitly disabled via build config 00:01:26.058 rib: explicitly disabled via build config 00:01:26.058 sched: explicitly disabled via build config 00:01:26.058 stack: explicitly disabled via build config 00:01:26.058 ipsec: explicitly disabled via build config 00:01:26.058 pdcp: explicitly disabled via build config 00:01:26.058 fib: explicitly disabled via build config 00:01:26.058 port: explicitly disabled via build config 00:01:26.058 pdump: explicitly disabled via build config 00:01:26.058 table: explicitly disabled via build config 00:01:26.058 pipeline: explicitly disabled via build config 00:01:26.058 graph: explicitly disabled via build config 00:01:26.058 node: explicitly disabled via build config 00:01:26.058 00:01:26.058 drivers: 00:01:26.058 common/cpt: not in enabled drivers build config 00:01:26.058 common/dpaax: not in enabled drivers build config 00:01:26.058 common/iavf: not in enabled drivers build config 00:01:26.058 common/idpf: not in enabled drivers build config 00:01:26.058 common/mvep: not in enabled drivers build config 00:01:26.058 common/octeontx: not in enabled drivers build config 00:01:26.058 bus/auxiliary: not in enabled drivers build config 00:01:26.058 bus/cdx: not in enabled drivers build config 00:01:26.058 bus/dpaa: not in enabled drivers build config 00:01:26.058 bus/fslmc: not in enabled drivers build config 00:01:26.058 bus/ifpga: not in enabled drivers build config 00:01:26.058 bus/platform: not in enabled drivers build config 00:01:26.058 bus/vmbus: not in enabled drivers build config 00:01:26.058 common/cnxk: not in enabled drivers build config 00:01:26.058 common/mlx5: not in enabled drivers build config 00:01:26.058 common/nfp: not in enabled drivers build config 00:01:26.058 common/qat: not in enabled drivers build config 00:01:26.058 common/sfc_efx: not in enabled drivers build config 00:01:26.058 mempool/bucket: not in enabled drivers build config 00:01:26.058 mempool/cnxk: not in enabled drivers build config 00:01:26.058 mempool/dpaa: not in enabled drivers build config 00:01:26.058 mempool/dpaa2: not in enabled drivers build config 00:01:26.058 mempool/octeontx: not in enabled drivers build config 00:01:26.058 mempool/stack: not in enabled drivers build config 00:01:26.058 dma/cnxk: not in enabled drivers build config 00:01:26.058 dma/dpaa: not in enabled drivers build config 00:01:26.058 dma/dpaa2: not in enabled drivers build config 00:01:26.058 dma/hisilicon: not in enabled drivers build config 00:01:26.058 dma/idxd: not in enabled drivers build config 00:01:26.058 dma/ioat: not in enabled drivers build config 00:01:26.059 dma/skeleton: not in enabled drivers build config 00:01:26.059 net/af_packet: not in enabled drivers build config 00:01:26.059 net/af_xdp: not in enabled drivers build config 00:01:26.059 net/ark: not in enabled drivers build config 00:01:26.059 net/atlantic: not in enabled drivers build config 00:01:26.059 net/avp: not in enabled drivers build config 00:01:26.059 net/axgbe: not in enabled drivers build config 00:01:26.059 net/bnx2x: not in enabled drivers build config 00:01:26.059 net/bnxt: not in enabled drivers build config 00:01:26.059 net/bonding: not in enabled drivers build config 00:01:26.059 net/cnxk: not in enabled drivers build config 00:01:26.059 net/cpfl: not in enabled drivers build config 00:01:26.059 net/cxgbe: not in enabled drivers build config 00:01:26.059 net/dpaa: not in enabled drivers build config 00:01:26.059 net/dpaa2: not in enabled drivers build config 00:01:26.059 net/e1000: not in enabled drivers build config 00:01:26.059 net/ena: not in enabled drivers build config 00:01:26.059 net/enetc: not in enabled drivers build config 00:01:26.059 net/enetfec: not in enabled drivers build config 00:01:26.059 net/enic: not in enabled drivers build config 00:01:26.059 net/failsafe: not in enabled drivers build config 00:01:26.059 net/fm10k: not in enabled drivers build config 00:01:26.059 net/gve: not in enabled drivers build config 00:01:26.059 net/hinic: not in enabled drivers build config 00:01:26.059 net/hns3: not in enabled drivers build config 00:01:26.059 net/i40e: not in enabled drivers build config 00:01:26.059 net/iavf: not in enabled drivers build config 00:01:26.059 net/ice: not in enabled drivers build config 00:01:26.059 net/idpf: not in enabled drivers build config 00:01:26.059 net/igc: not in enabled drivers build config 00:01:26.059 net/ionic: not in enabled drivers build config 00:01:26.059 net/ipn3ke: not in enabled drivers build config 00:01:26.059 net/ixgbe: not in enabled drivers build config 00:01:26.059 net/mana: not in enabled drivers build config 00:01:26.059 net/memif: not in enabled drivers build config 00:01:26.059 net/mlx4: not in enabled drivers build config 00:01:26.059 net/mlx5: not in enabled drivers build config 00:01:26.059 net/mvneta: not in enabled drivers build config 00:01:26.059 net/mvpp2: not in enabled drivers build config 00:01:26.059 net/netvsc: not in enabled drivers build config 00:01:26.059 net/nfb: not in enabled drivers build config 00:01:26.059 net/nfp: not in enabled drivers build config 00:01:26.059 net/ngbe: not in enabled drivers build config 00:01:26.059 net/null: not in enabled drivers build config 00:01:26.059 net/octeontx: not in enabled drivers build config 00:01:26.059 net/octeon_ep: not in enabled drivers build config 00:01:26.059 net/pcap: not in enabled drivers build config 00:01:26.059 net/pfe: not in enabled drivers build config 00:01:26.059 net/qede: not in enabled drivers build config 00:01:26.059 net/ring: not in enabled drivers build config 00:01:26.059 net/sfc: not in enabled drivers build config 00:01:26.059 net/softnic: not in enabled drivers build config 00:01:26.059 net/tap: not in enabled drivers build config 00:01:26.059 net/thunderx: not in enabled drivers build config 00:01:26.059 net/txgbe: not in enabled drivers build config 00:01:26.059 net/vdev_netvsc: not in enabled drivers build config 00:01:26.059 net/vhost: not in enabled drivers build config 00:01:26.059 net/virtio: not in enabled drivers build config 00:01:26.059 net/vmxnet3: not in enabled drivers build config 00:01:26.059 raw/*: missing internal dependency, "rawdev" 00:01:26.059 crypto/armv8: not in enabled drivers build config 00:01:26.059 crypto/bcmfs: not in enabled drivers build config 00:01:26.059 crypto/caam_jr: not in enabled drivers build config 00:01:26.059 crypto/ccp: not in enabled drivers build config 00:01:26.059 crypto/cnxk: not in enabled drivers build config 00:01:26.059 crypto/dpaa_sec: not in enabled drivers build config 00:01:26.059 crypto/dpaa2_sec: not in enabled drivers build config 00:01:26.059 crypto/ipsec_mb: not in enabled drivers build config 00:01:26.059 crypto/mlx5: not in enabled drivers build config 00:01:26.059 crypto/mvsam: not in enabled drivers build config 00:01:26.059 crypto/nitrox: not in enabled drivers build config 00:01:26.059 crypto/null: not in enabled drivers build config 00:01:26.059 crypto/octeontx: not in enabled drivers build config 00:01:26.059 crypto/openssl: not in enabled drivers build config 00:01:26.059 crypto/scheduler: not in enabled drivers build config 00:01:26.059 crypto/uadk: not in enabled drivers build config 00:01:26.059 crypto/virtio: not in enabled drivers build config 00:01:26.059 compress/isal: not in enabled drivers build config 00:01:26.059 compress/mlx5: not in enabled drivers build config 00:01:26.059 compress/octeontx: not in enabled drivers build config 00:01:26.059 compress/zlib: not in enabled drivers build config 00:01:26.059 regex/*: missing internal dependency, "regexdev" 00:01:26.059 ml/*: missing internal dependency, "mldev" 00:01:26.059 vdpa/ifc: not in enabled drivers build config 00:01:26.059 vdpa/mlx5: not in enabled drivers build config 00:01:26.059 vdpa/nfp: not in enabled drivers build config 00:01:26.059 vdpa/sfc: not in enabled drivers build config 00:01:26.059 event/*: missing internal dependency, "eventdev" 00:01:26.059 baseband/*: missing internal dependency, "bbdev" 00:01:26.059 gpu/*: missing internal dependency, "gpudev" 00:01:26.059 00:01:26.059 00:01:26.059 Build targets in project: 85 00:01:26.059 00:01:26.059 DPDK 23.11.0 00:01:26.059 00:01:26.059 User defined options 00:01:26.059 buildtype : debug 00:01:26.059 default_library : shared 00:01:26.059 libdir : lib 00:01:26.059 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:26.059 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:26.059 c_link_args : 00:01:26.059 cpu_instruction_set: native 00:01:26.060 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:26.060 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:26.060 enable_docs : false 00:01:26.060 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:26.060 enable_kmods : false 00:01:26.060 tests : false 00:01:26.060 00:01:26.060 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:26.060 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:26.060 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:26.060 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:26.060 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:26.060 [4/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:26.060 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:26.060 [6/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:26.060 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:26.060 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:26.060 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:26.060 [10/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:26.060 [11/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:26.060 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:26.060 [13/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:26.060 [14/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:26.060 [15/265] Linking static target lib/librte_log.a 00:01:26.060 [16/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:26.060 [17/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:26.060 [18/265] Linking static target lib/librte_kvargs.a 00:01:26.060 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:26.060 [20/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:26.060 [21/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:26.060 [22/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:26.060 [23/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:26.322 [24/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:26.322 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:26.322 [26/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:26.322 [27/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:26.322 [28/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:26.322 [29/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:26.322 [30/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:26.322 [31/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:26.322 [32/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:26.322 [33/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:26.322 [34/265] Linking static target lib/librte_pci.a 00:01:26.322 [35/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:26.322 [36/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:26.322 [37/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:26.601 [38/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:26.602 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:26.602 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:26.602 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:26.602 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:26.602 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:26.602 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:26.602 [45/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:26.602 [46/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:26.602 [47/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:26.602 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:26.602 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:26.602 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:26.602 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:26.602 [52/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:26.602 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:26.602 [54/265] Linking static target lib/librte_meter.a 00:01:26.602 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:26.602 [56/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:26.602 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:26.602 [58/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:26.602 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:26.602 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:26.602 [61/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:26.602 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:26.602 [63/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:26.602 [64/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.602 [65/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:26.602 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:26.602 [67/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:26.602 [68/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:26.602 [69/265] Linking static target lib/librte_ring.a 00:01:26.602 [70/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:26.602 [71/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:26.602 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:26.602 [73/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:26.602 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:26.602 [75/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:26.602 [76/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.602 [77/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:26.602 [78/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:26.602 [79/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:26.602 [80/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:26.602 [81/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:26.602 [82/265] Linking static target lib/librte_telemetry.a 00:01:26.602 [83/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:26.602 [84/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:26.602 [85/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:26.602 [86/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:26.602 [87/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:26.602 [88/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:26.602 [89/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:26.602 [90/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:26.602 [91/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:26.602 [92/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:26.602 [93/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:26.602 [94/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:26.602 [95/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:26.602 [96/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:26.602 [97/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:26.602 [98/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:26.602 [99/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:26.602 [100/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:26.602 [101/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:26.602 [102/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:26.602 [103/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:26.602 [104/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:26.602 [105/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:26.602 [106/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:26.602 [107/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:26.602 [108/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:26.602 [109/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:26.602 [110/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:26.602 [111/265] Linking static target lib/librte_mempool.a 00:01:26.602 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:26.602 [113/265] Linking static target lib/librte_net.a 00:01:26.602 [114/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:26.602 [115/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:26.602 [116/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:26.602 [117/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:26.602 [118/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:26.890 [119/265] Linking static target lib/librte_cmdline.a 00:01:26.890 [120/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:26.890 [121/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:26.890 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:26.890 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:26.890 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:26.890 [125/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:26.890 [126/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:26.890 [127/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:26.890 [128/265] Linking static target lib/librte_rcu.a 00:01:26.890 [129/265] Linking static target lib/librte_eal.a 00:01:26.890 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:26.890 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:26.890 [132/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:26.890 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:26.890 [134/265] Linking static target lib/librte_timer.a 00:01:26.890 [135/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:26.890 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:26.890 [137/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.890 [138/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:26.890 [139/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.890 [140/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:26.890 [141/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:26.890 [142/265] Linking target lib/librte_log.so.24.0 00:01:26.890 [143/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.890 [144/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:26.890 [145/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:26.890 [146/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:26.890 [147/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:26.890 [148/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:26.890 [149/265] Linking static target lib/librte_compressdev.a 00:01:26.890 [150/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:26.890 [151/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.890 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:26.890 [153/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:26.890 [154/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:26.890 [155/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:26.890 [156/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:26.890 [157/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:26.890 [158/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:26.890 [159/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:26.890 [160/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:26.890 [161/265] Linking static target lib/librte_mbuf.a 00:01:26.890 [162/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:26.890 [163/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.890 [164/265] Linking target lib/librte_kvargs.so.24.0 00:01:27.149 [165/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:27.149 [166/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:27.149 [167/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:27.149 [168/265] Linking static target lib/librte_power.a 00:01:27.149 [169/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:27.149 [170/265] Linking static target lib/librte_dmadev.a 00:01:27.149 [171/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:27.149 [172/265] Linking target lib/librte_telemetry.so.24.0 00:01:27.149 [173/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.149 [174/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:27.149 [175/265] Linking static target lib/librte_security.a 00:01:27.149 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:27.149 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:27.149 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:27.149 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:27.149 [180/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:27.149 [181/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:27.149 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:27.149 [183/265] Linking static target lib/librte_reorder.a 00:01:27.149 [184/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:27.149 [185/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:27.149 [186/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:27.149 [187/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.149 [188/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:27.149 [189/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:27.149 [190/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:27.149 [191/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:27.150 [192/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:27.150 [193/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:27.150 [194/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:27.150 [195/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:27.150 [196/265] Linking static target lib/librte_hash.a 00:01:27.150 [197/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:27.150 [198/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:27.150 [199/265] Linking static target drivers/librte_bus_vdev.a 00:01:27.150 [200/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:27.409 [201/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:27.409 [202/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:27.409 [203/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:27.409 [204/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:27.409 [205/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:27.409 [206/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.409 [207/265] Linking static target drivers/librte_bus_pci.a 00:01:27.409 [208/265] Linking static target lib/librte_cryptodev.a 00:01:27.409 [209/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:27.409 [210/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:27.409 [211/265] Linking static target drivers/librte_mempool_ring.a 00:01:27.409 [212/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.409 [213/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.409 [214/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.668 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.668 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:27.668 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.668 [218/265] Linking static target lib/librte_ethdev.a 00:01:27.668 [219/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.668 [220/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.925 [221/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.925 [222/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:27.925 [223/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.184 [224/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.751 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:28.751 [226/265] Linking static target lib/librte_vhost.a 00:01:29.319 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.727 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.912 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.289 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.289 [231/265] Linking target lib/librte_eal.so.24.0 00:01:36.548 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:36.548 [233/265] Linking target lib/librte_ring.so.24.0 00:01:36.548 [234/265] Linking target lib/librte_meter.so.24.0 00:01:36.548 [235/265] Linking target lib/librte_pci.so.24.0 00:01:36.548 [236/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:36.548 [237/265] Linking target lib/librte_dmadev.so.24.0 00:01:36.548 [238/265] Linking target lib/librte_timer.so.24.0 00:01:36.548 [239/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:36.548 [240/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:36.548 [241/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:36.548 [242/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:36.548 [243/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:36.806 [244/265] Linking target lib/librte_rcu.so.24.0 00:01:36.806 [245/265] Linking target lib/librte_mempool.so.24.0 00:01:36.806 [246/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:36.806 [247/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:36.806 [248/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:36.806 [249/265] Linking target lib/librte_mbuf.so.24.0 00:01:36.806 [250/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:37.065 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:37.065 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:37.065 [253/265] Linking target lib/librte_reorder.so.24.0 00:01:37.065 [254/265] Linking target lib/librte_compressdev.so.24.0 00:01:37.065 [255/265] Linking target lib/librte_net.so.24.0 00:01:37.065 [256/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:37.065 [257/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:37.065 [258/265] Linking target lib/librte_hash.so.24.0 00:01:37.065 [259/265] Linking target lib/librte_security.so.24.0 00:01:37.065 [260/265] Linking target lib/librte_cmdline.so.24.0 00:01:37.065 [261/265] Linking target lib/librte_ethdev.so.24.0 00:01:37.323 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:37.323 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:37.323 [264/265] Linking target lib/librte_power.so.24.0 00:01:37.323 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:37.323 INFO: autodetecting backend as ninja 00:01:37.323 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 96 00:01:38.259 CC lib/ut_mock/mock.o 00:01:38.259 CC lib/log/log.o 00:01:38.259 CC lib/log/log_flags.o 00:01:38.259 CC lib/log/log_deprecated.o 00:01:38.259 CC lib/ut/ut.o 00:01:38.259 LIB libspdk_ut_mock.a 00:01:38.259 SO libspdk_ut_mock.so.5.0 00:01:38.259 LIB libspdk_log.a 00:01:38.259 LIB libspdk_ut.a 00:01:38.519 SYMLINK libspdk_ut_mock.so 00:01:38.519 SO libspdk_log.so.6.1 00:01:38.519 SO libspdk_ut.so.1.0 00:01:38.519 SYMLINK libspdk_log.so 00:01:38.519 SYMLINK libspdk_ut.so 00:01:38.778 CC lib/util/base64.o 00:01:38.778 CC lib/util/bit_array.o 00:01:38.778 CC lib/util/cpuset.o 00:01:38.778 CC lib/util/crc16.o 00:01:38.778 CC lib/util/crc32c.o 00:01:38.778 CC lib/util/crc32.o 00:01:38.778 CXX lib/trace_parser/trace.o 00:01:38.778 CC lib/util/crc32_ieee.o 00:01:38.778 CC lib/util/crc64.o 00:01:38.778 CC lib/util/dif.o 00:01:38.778 CC lib/util/hexlify.o 00:01:38.778 CC lib/util/fd.o 00:01:38.778 CC lib/util/file.o 00:01:38.778 CC lib/util/iov.o 00:01:38.778 CC lib/util/math.o 00:01:38.778 CC lib/util/pipe.o 00:01:38.778 CC lib/util/strerror_tls.o 00:01:38.778 CC lib/util/string.o 00:01:38.778 CC lib/util/fd_group.o 00:01:38.778 CC lib/util/uuid.o 00:01:38.778 CC lib/util/xor.o 00:01:38.778 CC lib/dma/dma.o 00:01:38.778 CC lib/util/zipf.o 00:01:38.778 CC lib/ioat/ioat.o 00:01:38.778 CC lib/vfio_user/host/vfio_user.o 00:01:38.778 CC lib/vfio_user/host/vfio_user_pci.o 00:01:38.778 LIB libspdk_dma.a 00:01:38.778 SO libspdk_dma.so.3.0 00:01:39.037 LIB libspdk_ioat.a 00:01:39.037 SYMLINK libspdk_dma.so 00:01:39.037 SO libspdk_ioat.so.6.0 00:01:39.037 LIB libspdk_vfio_user.a 00:01:39.037 SYMLINK libspdk_ioat.so 00:01:39.037 SO libspdk_vfio_user.so.4.0 00:01:39.037 LIB libspdk_util.a 00:01:39.037 SYMLINK libspdk_vfio_user.so 00:01:39.037 SO libspdk_util.so.8.0 00:01:39.296 SYMLINK libspdk_util.so 00:01:39.296 LIB libspdk_trace_parser.a 00:01:39.296 SO libspdk_trace_parser.so.4.0 00:01:39.296 CC lib/rdma/common.o 00:01:39.296 CC lib/rdma/rdma_verbs.o 00:01:39.296 CC lib/json/json_parse.o 00:01:39.296 CC lib/json/json_util.o 00:01:39.296 CC lib/json/json_write.o 00:01:39.296 CC lib/idxd/idxd.o 00:01:39.296 CC lib/conf/conf.o 00:01:39.296 CC lib/idxd/idxd_user.o 00:01:39.296 CC lib/idxd/idxd_kernel.o 00:01:39.554 CC lib/env_dpdk/memory.o 00:01:39.554 CC lib/env_dpdk/env.o 00:01:39.554 CC lib/env_dpdk/init.o 00:01:39.554 CC lib/env_dpdk/pci.o 00:01:39.554 CC lib/vmd/led.o 00:01:39.554 CC lib/vmd/vmd.o 00:01:39.554 CC lib/env_dpdk/threads.o 00:01:39.554 CC lib/env_dpdk/pci_ioat.o 00:01:39.554 CC lib/env_dpdk/pci_virtio.o 00:01:39.554 CC lib/env_dpdk/pci_vmd.o 00:01:39.554 CC lib/env_dpdk/pci_idxd.o 00:01:39.554 CC lib/env_dpdk/pci_event.o 00:01:39.554 CC lib/env_dpdk/sigbus_handler.o 00:01:39.554 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:39.554 SYMLINK libspdk_trace_parser.so 00:01:39.554 CC lib/env_dpdk/pci_dpdk.o 00:01:39.554 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:39.554 LIB libspdk_conf.a 00:01:39.554 LIB libspdk_json.a 00:01:39.554 LIB libspdk_rdma.a 00:01:39.554 SO libspdk_conf.so.5.0 00:01:39.812 SO libspdk_json.so.5.1 00:01:39.812 SO libspdk_rdma.so.5.0 00:01:39.812 SYMLINK libspdk_conf.so 00:01:39.812 SYMLINK libspdk_json.so 00:01:39.812 SYMLINK libspdk_rdma.so 00:01:39.812 LIB libspdk_idxd.a 00:01:39.812 SO libspdk_idxd.so.11.0 00:01:39.812 LIB libspdk_vmd.a 00:01:39.812 CC lib/jsonrpc/jsonrpc_server.o 00:01:39.812 CC lib/jsonrpc/jsonrpc_client.o 00:01:39.812 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:39.812 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:40.070 SYMLINK libspdk_idxd.so 00:01:40.070 SO libspdk_vmd.so.5.0 00:01:40.070 SYMLINK libspdk_vmd.so 00:01:40.070 LIB libspdk_jsonrpc.a 00:01:40.070 SO libspdk_jsonrpc.so.5.1 00:01:40.327 SYMLINK libspdk_jsonrpc.so 00:01:40.327 LIB libspdk_env_dpdk.a 00:01:40.327 CC lib/rpc/rpc.o 00:01:40.584 SO libspdk_env_dpdk.so.13.0 00:01:40.584 LIB libspdk_rpc.a 00:01:40.584 SYMLINK libspdk_env_dpdk.so 00:01:40.584 SO libspdk_rpc.so.5.0 00:01:40.584 SYMLINK libspdk_rpc.so 00:01:40.841 CC lib/trace/trace.o 00:01:40.841 CC lib/trace/trace_flags.o 00:01:40.841 CC lib/notify/notify.o 00:01:40.841 CC lib/trace/trace_rpc.o 00:01:40.841 CC lib/notify/notify_rpc.o 00:01:40.841 CC lib/sock/sock.o 00:01:40.841 CC lib/sock/sock_rpc.o 00:01:41.099 LIB libspdk_notify.a 00:01:41.100 LIB libspdk_trace.a 00:01:41.100 SO libspdk_notify.so.5.0 00:01:41.100 SO libspdk_trace.so.9.0 00:01:41.100 SYMLINK libspdk_notify.so 00:01:41.100 SYMLINK libspdk_trace.so 00:01:41.100 LIB libspdk_sock.a 00:01:41.100 SO libspdk_sock.so.8.0 00:01:41.358 SYMLINK libspdk_sock.so 00:01:41.358 CC lib/thread/thread.o 00:01:41.358 CC lib/thread/iobuf.o 00:01:41.358 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:41.358 CC lib/nvme/nvme_ctrlr.o 00:01:41.358 CC lib/nvme/nvme_fabric.o 00:01:41.358 CC lib/nvme/nvme_ns_cmd.o 00:01:41.358 CC lib/nvme/nvme_ns.o 00:01:41.358 CC lib/nvme/nvme_pcie_common.o 00:01:41.358 CC lib/nvme/nvme_pcie.o 00:01:41.358 CC lib/nvme/nvme_qpair.o 00:01:41.358 CC lib/nvme/nvme.o 00:01:41.358 CC lib/nvme/nvme_discovery.o 00:01:41.358 CC lib/nvme/nvme_quirks.o 00:01:41.358 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:41.358 CC lib/nvme/nvme_transport.o 00:01:41.358 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:41.358 CC lib/nvme/nvme_tcp.o 00:01:41.358 CC lib/nvme/nvme_opal.o 00:01:41.358 CC lib/nvme/nvme_io_msg.o 00:01:41.358 CC lib/nvme/nvme_poll_group.o 00:01:41.358 CC lib/nvme/nvme_zns.o 00:01:41.358 CC lib/nvme/nvme_cuse.o 00:01:41.358 CC lib/nvme/nvme_vfio_user.o 00:01:41.358 CC lib/nvme/nvme_rdma.o 00:01:42.291 LIB libspdk_thread.a 00:01:42.549 SO libspdk_thread.so.9.0 00:01:42.549 SYMLINK libspdk_thread.so 00:01:42.549 CC lib/init/json_config.o 00:01:42.549 CC lib/init/subsystem.o 00:01:42.549 CC lib/init/subsystem_rpc.o 00:01:42.549 CC lib/init/rpc.o 00:01:42.549 CC lib/accel/accel.o 00:01:42.808 CC lib/blob/blobstore.o 00:01:42.808 CC lib/accel/accel_rpc.o 00:01:42.808 CC lib/accel/accel_sw.o 00:01:42.808 CC lib/blob/request.o 00:01:42.808 CC lib/blob/zeroes.o 00:01:42.808 CC lib/blob/blob_bs_dev.o 00:01:42.808 CC lib/virtio/virtio.o 00:01:42.808 CC lib/virtio/virtio_vhost_user.o 00:01:42.808 CC lib/virtio/virtio_vfio_user.o 00:01:42.808 CC lib/virtio/virtio_pci.o 00:01:42.808 LIB libspdk_init.a 00:01:42.808 SO libspdk_init.so.4.0 00:01:42.808 LIB libspdk_nvme.a 00:01:43.067 SYMLINK libspdk_init.so 00:01:43.067 LIB libspdk_virtio.a 00:01:43.067 SO libspdk_virtio.so.6.0 00:01:43.067 SO libspdk_nvme.so.12.0 00:01:43.067 SYMLINK libspdk_virtio.so 00:01:43.067 CC lib/event/app.o 00:01:43.067 CC lib/event/reactor.o 00:01:43.067 CC lib/event/log_rpc.o 00:01:43.067 CC lib/event/app_rpc.o 00:01:43.067 CC lib/event/scheduler_static.o 00:01:43.324 SYMLINK libspdk_nvme.so 00:01:43.324 LIB libspdk_accel.a 00:01:43.324 SO libspdk_accel.so.14.0 00:01:43.325 LIB libspdk_event.a 00:01:43.325 SYMLINK libspdk_accel.so 00:01:43.582 SO libspdk_event.so.12.0 00:01:43.582 SYMLINK libspdk_event.so 00:01:43.582 CC lib/bdev/bdev.o 00:01:43.582 CC lib/bdev/bdev_rpc.o 00:01:43.582 CC lib/bdev/bdev_zone.o 00:01:43.582 CC lib/bdev/part.o 00:01:43.582 CC lib/bdev/scsi_nvme.o 00:01:44.512 LIB libspdk_blob.a 00:01:44.512 SO libspdk_blob.so.10.1 00:01:44.770 SYMLINK libspdk_blob.so 00:01:44.770 CC lib/blobfs/blobfs.o 00:01:44.770 CC lib/blobfs/tree.o 00:01:44.770 CC lib/lvol/lvol.o 00:01:45.336 LIB libspdk_bdev.a 00:01:45.336 SO libspdk_bdev.so.14.0 00:01:45.336 LIB libspdk_blobfs.a 00:01:45.336 LIB libspdk_lvol.a 00:01:45.336 SO libspdk_blobfs.so.9.0 00:01:45.594 SO libspdk_lvol.so.9.1 00:01:45.594 SYMLINK libspdk_bdev.so 00:01:45.594 SYMLINK libspdk_blobfs.so 00:01:45.594 SYMLINK libspdk_lvol.so 00:01:45.594 CC lib/scsi/dev.o 00:01:45.594 CC lib/scsi/scsi.o 00:01:45.594 CC lib/scsi/lun.o 00:01:45.594 CC lib/scsi/port.o 00:01:45.594 CC lib/scsi/scsi_bdev.o 00:01:45.594 CC lib/scsi/scsi_pr.o 00:01:45.594 CC lib/scsi/scsi_rpc.o 00:01:45.594 CC lib/scsi/task.o 00:01:45.594 CC lib/ftl/ftl_core.o 00:01:45.594 CC lib/ftl/ftl_layout.o 00:01:45.594 CC lib/ftl/ftl_init.o 00:01:45.594 CC lib/ublk/ublk.o 00:01:45.594 CC lib/ftl/ftl_debug.o 00:01:45.594 CC lib/ublk/ublk_rpc.o 00:01:45.594 CC lib/ftl/ftl_io.o 00:01:45.594 CC lib/ftl/ftl_sb.o 00:01:45.594 CC lib/ftl/ftl_l2p.o 00:01:45.594 CC lib/ftl/ftl_l2p_flat.o 00:01:45.594 CC lib/ftl/ftl_nv_cache.o 00:01:45.594 CC lib/ftl/ftl_band_ops.o 00:01:45.594 CC lib/ftl/ftl_band.o 00:01:45.594 CC lib/ftl/ftl_writer.o 00:01:45.594 CC lib/ftl/ftl_rq.o 00:01:45.594 CC lib/ftl/ftl_l2p_cache.o 00:01:45.594 CC lib/ftl/ftl_reloc.o 00:01:45.594 CC lib/ftl/ftl_p2l.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:45.594 CC lib/nbd/nbd.o 00:01:45.594 CC lib/nvmf/ctrlr.o 00:01:45.594 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:45.594 CC lib/ftl/utils/ftl_conf.o 00:01:45.594 CC lib/nvmf/ctrlr_discovery.o 00:01:45.594 CC lib/nvmf/ctrlr_bdev.o 00:01:45.594 CC lib/nvmf/subsystem.o 00:01:45.594 CC lib/ftl/utils/ftl_md.o 00:01:45.594 CC lib/nbd/nbd_rpc.o 00:01:45.594 CC lib/ftl/utils/ftl_bitmap.o 00:01:45.594 CC lib/ftl/utils/ftl_mempool.o 00:01:45.594 CC lib/ftl/utils/ftl_property.o 00:01:45.594 CC lib/nvmf/nvmf.o 00:01:45.594 CC lib/nvmf/nvmf_rpc.o 00:01:45.594 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:45.594 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:45.594 CC lib/nvmf/transport.o 00:01:45.594 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:45.594 CC lib/nvmf/tcp.o 00:01:45.594 CC lib/nvmf/rdma.o 00:01:45.594 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:45.594 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:45.594 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:45.594 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:45.594 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:45.594 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:45.594 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:45.594 CC lib/ftl/base/ftl_base_dev.o 00:01:45.851 CC lib/ftl/ftl_trace.o 00:01:45.851 CC lib/ftl/base/ftl_base_bdev.o 00:01:46.128 LIB libspdk_nbd.a 00:01:46.128 SO libspdk_nbd.so.6.0 00:01:46.396 SYMLINK libspdk_nbd.so 00:01:46.396 LIB libspdk_scsi.a 00:01:46.396 LIB libspdk_ublk.a 00:01:46.396 SO libspdk_scsi.so.8.0 00:01:46.396 SO libspdk_ublk.so.2.0 00:01:46.396 SYMLINK libspdk_scsi.so 00:01:46.396 SYMLINK libspdk_ublk.so 00:01:46.396 LIB libspdk_ftl.a 00:01:46.654 CC lib/vhost/vhost_rpc.o 00:01:46.654 CC lib/vhost/vhost.o 00:01:46.654 CC lib/vhost/vhost_scsi.o 00:01:46.654 CC lib/vhost/vhost_blk.o 00:01:46.654 CC lib/vhost/rte_vhost_user.o 00:01:46.654 CC lib/iscsi/conn.o 00:01:46.654 CC lib/iscsi/init_grp.o 00:01:46.654 CC lib/iscsi/iscsi.o 00:01:46.654 CC lib/iscsi/md5.o 00:01:46.654 CC lib/iscsi/param.o 00:01:46.654 CC lib/iscsi/portal_grp.o 00:01:46.654 CC lib/iscsi/tgt_node.o 00:01:46.654 CC lib/iscsi/iscsi_subsystem.o 00:01:46.654 CC lib/iscsi/iscsi_rpc.o 00:01:46.654 CC lib/iscsi/task.o 00:01:46.654 SO libspdk_ftl.so.8.0 00:01:46.912 SYMLINK libspdk_ftl.so 00:01:47.171 LIB libspdk_nvmf.a 00:01:47.428 SO libspdk_nvmf.so.17.0 00:01:47.428 LIB libspdk_vhost.a 00:01:47.428 SO libspdk_vhost.so.7.1 00:01:47.428 SYMLINK libspdk_nvmf.so 00:01:47.428 SYMLINK libspdk_vhost.so 00:01:47.685 LIB libspdk_iscsi.a 00:01:47.685 SO libspdk_iscsi.so.7.0 00:01:47.685 SYMLINK libspdk_iscsi.so 00:01:47.942 CC module/env_dpdk/env_dpdk_rpc.o 00:01:48.199 CC module/accel/iaa/accel_iaa.o 00:01:48.199 CC module/accel/iaa/accel_iaa_rpc.o 00:01:48.199 CC module/accel/dsa/accel_dsa.o 00:01:48.199 CC module/accel/dsa/accel_dsa_rpc.o 00:01:48.199 CC module/accel/error/accel_error.o 00:01:48.199 CC module/accel/error/accel_error_rpc.o 00:01:48.199 CC module/accel/ioat/accel_ioat.o 00:01:48.199 CC module/accel/ioat/accel_ioat_rpc.o 00:01:48.199 CC module/blob/bdev/blob_bdev.o 00:01:48.199 CC module/sock/posix/posix.o 00:01:48.199 CC module/scheduler/gscheduler/gscheduler.o 00:01:48.199 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:48.199 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:48.199 LIB libspdk_env_dpdk_rpc.a 00:01:48.199 SO libspdk_env_dpdk_rpc.so.5.0 00:01:48.199 SYMLINK libspdk_env_dpdk_rpc.so 00:01:48.199 LIB libspdk_scheduler_gscheduler.a 00:01:48.199 LIB libspdk_accel_iaa.a 00:01:48.199 LIB libspdk_accel_error.a 00:01:48.199 SO libspdk_scheduler_gscheduler.so.3.0 00:01:48.199 LIB libspdk_scheduler_dpdk_governor.a 00:01:48.199 LIB libspdk_accel_ioat.a 00:01:48.458 LIB libspdk_accel_dsa.a 00:01:48.458 SO libspdk_accel_error.so.1.0 00:01:48.458 SO libspdk_accel_iaa.so.2.0 00:01:48.458 LIB libspdk_scheduler_dynamic.a 00:01:48.458 SO libspdk_scheduler_dpdk_governor.so.3.0 00:01:48.458 SYMLINK libspdk_scheduler_gscheduler.so 00:01:48.458 SO libspdk_accel_dsa.so.4.0 00:01:48.458 SO libspdk_accel_ioat.so.5.0 00:01:48.458 LIB libspdk_blob_bdev.a 00:01:48.458 SO libspdk_scheduler_dynamic.so.3.0 00:01:48.458 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:48.458 SYMLINK libspdk_accel_error.so 00:01:48.458 SO libspdk_blob_bdev.so.10.1 00:01:48.458 SYMLINK libspdk_accel_iaa.so 00:01:48.458 SYMLINK libspdk_accel_dsa.so 00:01:48.458 SYMLINK libspdk_accel_ioat.so 00:01:48.458 SYMLINK libspdk_scheduler_dynamic.so 00:01:48.458 SYMLINK libspdk_blob_bdev.so 00:01:48.716 LIB libspdk_sock_posix.a 00:01:48.716 CC module/bdev/lvol/vbdev_lvol.o 00:01:48.716 CC module/bdev/malloc/bdev_malloc.o 00:01:48.716 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:48.716 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:48.716 CC module/bdev/split/vbdev_split.o 00:01:48.716 CC module/bdev/split/vbdev_split_rpc.o 00:01:48.716 CC module/bdev/nvme/bdev_nvme.o 00:01:48.716 CC module/bdev/nvme/nvme_rpc.o 00:01:48.716 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:48.716 CC module/bdev/nvme/bdev_mdns_client.o 00:01:48.716 CC module/bdev/gpt/vbdev_gpt.o 00:01:48.716 CC module/bdev/gpt/gpt.o 00:01:48.716 CC module/bdev/nvme/vbdev_opal.o 00:01:48.716 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:48.716 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:48.716 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:48.716 CC module/bdev/null/bdev_null_rpc.o 00:01:48.716 CC module/bdev/null/bdev_null.o 00:01:48.716 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:48.716 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:48.716 CC module/bdev/ftl/bdev_ftl.o 00:01:48.716 CC module/bdev/delay/vbdev_delay.o 00:01:48.716 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:48.716 CC module/bdev/aio/bdev_aio.o 00:01:48.716 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:48.716 CC module/bdev/passthru/vbdev_passthru.o 00:01:48.716 CC module/bdev/aio/bdev_aio_rpc.o 00:01:48.716 CC module/bdev/raid/bdev_raid_rpc.o 00:01:48.716 CC module/bdev/raid/bdev_raid.o 00:01:48.716 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:48.716 CC module/bdev/raid/bdev_raid_sb.o 00:01:48.716 CC module/bdev/raid/raid0.o 00:01:48.716 CC module/bdev/raid/raid1.o 00:01:48.716 CC module/bdev/raid/concat.o 00:01:48.716 CC module/blobfs/bdev/blobfs_bdev.o 00:01:48.716 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:48.716 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:48.716 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:48.716 CC module/bdev/error/vbdev_error.o 00:01:48.716 CC module/bdev/error/vbdev_error_rpc.o 00:01:48.716 CC module/bdev/iscsi/bdev_iscsi.o 00:01:48.716 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:48.716 SO libspdk_sock_posix.so.5.0 00:01:48.716 SYMLINK libspdk_sock_posix.so 00:01:48.973 LIB libspdk_blobfs_bdev.a 00:01:48.973 LIB libspdk_bdev_split.a 00:01:48.973 SO libspdk_blobfs_bdev.so.5.0 00:01:48.973 SO libspdk_bdev_split.so.5.0 00:01:48.973 LIB libspdk_bdev_null.a 00:01:48.973 LIB libspdk_bdev_gpt.a 00:01:48.973 SO libspdk_bdev_null.so.5.0 00:01:48.973 LIB libspdk_bdev_error.a 00:01:48.973 SYMLINK libspdk_blobfs_bdev.so 00:01:48.973 LIB libspdk_bdev_ftl.a 00:01:48.973 SYMLINK libspdk_bdev_split.so 00:01:48.973 LIB libspdk_bdev_passthru.a 00:01:48.973 SO libspdk_bdev_gpt.so.5.0 00:01:48.973 LIB libspdk_bdev_zone_block.a 00:01:48.973 SO libspdk_bdev_error.so.5.0 00:01:48.973 SYMLINK libspdk_bdev_null.so 00:01:48.973 SO libspdk_bdev_ftl.so.5.0 00:01:48.973 LIB libspdk_bdev_aio.a 00:01:48.973 SO libspdk_bdev_passthru.so.5.0 00:01:48.973 LIB libspdk_bdev_malloc.a 00:01:48.973 LIB libspdk_bdev_delay.a 00:01:48.973 SO libspdk_bdev_zone_block.so.5.0 00:01:48.973 LIB libspdk_bdev_iscsi.a 00:01:49.231 SYMLINK libspdk_bdev_gpt.so 00:01:49.231 SO libspdk_bdev_delay.so.5.0 00:01:49.231 SO libspdk_bdev_aio.so.5.0 00:01:49.231 SYMLINK libspdk_bdev_error.so 00:01:49.231 SO libspdk_bdev_malloc.so.5.0 00:01:49.231 SYMLINK libspdk_bdev_ftl.so 00:01:49.231 SO libspdk_bdev_iscsi.so.5.0 00:01:49.231 SYMLINK libspdk_bdev_passthru.so 00:01:49.231 SYMLINK libspdk_bdev_zone_block.so 00:01:49.231 SYMLINK libspdk_bdev_aio.so 00:01:49.231 SYMLINK libspdk_bdev_delay.so 00:01:49.231 LIB libspdk_bdev_lvol.a 00:01:49.231 LIB libspdk_bdev_virtio.a 00:01:49.231 SYMLINK libspdk_bdev_iscsi.so 00:01:49.231 SYMLINK libspdk_bdev_malloc.so 00:01:49.231 SO libspdk_bdev_lvol.so.5.0 00:01:49.231 SO libspdk_bdev_virtio.so.5.0 00:01:49.231 SYMLINK libspdk_bdev_lvol.so 00:01:49.231 SYMLINK libspdk_bdev_virtio.so 00:01:49.489 LIB libspdk_bdev_raid.a 00:01:49.489 SO libspdk_bdev_raid.so.5.0 00:01:49.489 SYMLINK libspdk_bdev_raid.so 00:01:50.422 LIB libspdk_bdev_nvme.a 00:01:50.422 SO libspdk_bdev_nvme.so.6.0 00:01:50.422 SYMLINK libspdk_bdev_nvme.so 00:01:50.680 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:50.680 CC module/event/subsystems/iobuf/iobuf.o 00:01:50.680 CC module/event/subsystems/sock/sock.o 00:01:50.680 CC module/event/subsystems/scheduler/scheduler.o 00:01:50.680 CC module/event/subsystems/vmd/vmd.o 00:01:50.680 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:50.680 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:50.937 LIB libspdk_event_sock.a 00:01:50.937 SO libspdk_event_sock.so.4.0 00:01:50.937 LIB libspdk_event_iobuf.a 00:01:50.937 LIB libspdk_event_scheduler.a 00:01:50.937 LIB libspdk_event_vhost_blk.a 00:01:50.937 LIB libspdk_event_vmd.a 00:01:50.937 SO libspdk_event_scheduler.so.3.0 00:01:50.937 SO libspdk_event_iobuf.so.2.0 00:01:50.937 SO libspdk_event_vhost_blk.so.2.0 00:01:50.937 SO libspdk_event_vmd.so.5.0 00:01:50.937 SYMLINK libspdk_event_sock.so 00:01:50.937 SYMLINK libspdk_event_scheduler.so 00:01:50.937 SYMLINK libspdk_event_iobuf.so 00:01:50.937 SYMLINK libspdk_event_vhost_blk.so 00:01:50.937 SYMLINK libspdk_event_vmd.so 00:01:51.195 CC module/event/subsystems/accel/accel.o 00:01:51.195 LIB libspdk_event_accel.a 00:01:51.195 SO libspdk_event_accel.so.5.0 00:01:51.461 SYMLINK libspdk_event_accel.so 00:01:51.461 CC module/event/subsystems/bdev/bdev.o 00:01:51.720 LIB libspdk_event_bdev.a 00:01:51.720 SO libspdk_event_bdev.so.5.0 00:01:51.720 SYMLINK libspdk_event_bdev.so 00:01:51.979 CC module/event/subsystems/scsi/scsi.o 00:01:51.979 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:51.979 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:51.979 CC module/event/subsystems/ublk/ublk.o 00:01:51.979 CC module/event/subsystems/nbd/nbd.o 00:01:51.979 LIB libspdk_event_ublk.a 00:01:51.979 LIB libspdk_event_scsi.a 00:01:51.979 LIB libspdk_event_nbd.a 00:01:52.237 SO libspdk_event_ublk.so.2.0 00:01:52.237 SO libspdk_event_scsi.so.5.0 00:01:52.237 LIB libspdk_event_nvmf.a 00:01:52.237 SO libspdk_event_nbd.so.5.0 00:01:52.237 SO libspdk_event_nvmf.so.5.0 00:01:52.237 SYMLINK libspdk_event_ublk.so 00:01:52.237 SYMLINK libspdk_event_scsi.so 00:01:52.237 SYMLINK libspdk_event_nbd.so 00:01:52.237 SYMLINK libspdk_event_nvmf.so 00:01:52.237 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:52.496 CC module/event/subsystems/iscsi/iscsi.o 00:01:52.496 LIB libspdk_event_vhost_scsi.a 00:01:52.496 SO libspdk_event_vhost_scsi.so.2.0 00:01:52.496 LIB libspdk_event_iscsi.a 00:01:52.496 SO libspdk_event_iscsi.so.5.0 00:01:52.496 SYMLINK libspdk_event_vhost_scsi.so 00:01:52.496 SYMLINK libspdk_event_iscsi.so 00:01:52.758 SO libspdk.so.5.0 00:01:52.758 SYMLINK libspdk.so 00:01:53.022 CC app/trace_record/trace_record.o 00:01:53.022 CXX app/trace/trace.o 00:01:53.022 CC app/spdk_nvme_discover/discovery_aer.o 00:01:53.022 CC app/spdk_nvme_perf/perf.o 00:01:53.022 CC app/spdk_lspci/spdk_lspci.o 00:01:53.022 CC app/spdk_nvme_identify/identify.o 00:01:53.022 CC app/spdk_top/spdk_top.o 00:01:53.022 TEST_HEADER include/spdk/assert.h 00:01:53.022 TEST_HEADER include/spdk/accel.h 00:01:53.022 TEST_HEADER include/spdk/base64.h 00:01:53.022 TEST_HEADER include/spdk/accel_module.h 00:01:53.022 TEST_HEADER include/spdk/barrier.h 00:01:53.022 TEST_HEADER include/spdk/bdev.h 00:01:53.022 CC app/iscsi_tgt/iscsi_tgt.o 00:01:53.022 TEST_HEADER include/spdk/bdev_module.h 00:01:53.022 TEST_HEADER include/spdk/bdev_zone.h 00:01:53.022 TEST_HEADER include/spdk/bit_array.h 00:01:53.022 TEST_HEADER include/spdk/bit_pool.h 00:01:53.022 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:53.022 TEST_HEADER include/spdk/blob_bdev.h 00:01:53.022 TEST_HEADER include/spdk/blobfs.h 00:01:53.022 TEST_HEADER include/spdk/blob.h 00:01:53.022 CC test/rpc_client/rpc_client_test.o 00:01:53.022 TEST_HEADER include/spdk/config.h 00:01:53.022 TEST_HEADER include/spdk/conf.h 00:01:53.022 TEST_HEADER include/spdk/cpuset.h 00:01:53.022 TEST_HEADER include/spdk/crc16.h 00:01:53.022 TEST_HEADER include/spdk/dif.h 00:01:53.022 TEST_HEADER include/spdk/crc32.h 00:01:53.022 TEST_HEADER include/spdk/dma.h 00:01:53.022 TEST_HEADER include/spdk/crc64.h 00:01:53.022 TEST_HEADER include/spdk/endian.h 00:01:53.022 TEST_HEADER include/spdk/env_dpdk.h 00:01:53.022 CC app/vhost/vhost.o 00:01:53.022 TEST_HEADER include/spdk/fd_group.h 00:01:53.022 TEST_HEADER include/spdk/env.h 00:01:53.022 TEST_HEADER include/spdk/event.h 00:01:53.022 TEST_HEADER include/spdk/fd.h 00:01:53.022 TEST_HEADER include/spdk/ftl.h 00:01:53.022 TEST_HEADER include/spdk/file.h 00:01:53.022 TEST_HEADER include/spdk/gpt_spec.h 00:01:53.022 TEST_HEADER include/spdk/hexlify.h 00:01:53.022 TEST_HEADER include/spdk/idxd.h 00:01:53.022 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:53.022 TEST_HEADER include/spdk/init.h 00:01:53.022 TEST_HEADER include/spdk/histogram_data.h 00:01:53.022 TEST_HEADER include/spdk/idxd_spec.h 00:01:53.022 TEST_HEADER include/spdk/ioat_spec.h 00:01:53.022 TEST_HEADER include/spdk/ioat.h 00:01:53.022 CC app/nvmf_tgt/nvmf_main.o 00:01:53.022 TEST_HEADER include/spdk/jsonrpc.h 00:01:53.022 TEST_HEADER include/spdk/iscsi_spec.h 00:01:53.022 TEST_HEADER include/spdk/json.h 00:01:53.022 TEST_HEADER include/spdk/likely.h 00:01:53.022 TEST_HEADER include/spdk/log.h 00:01:53.022 TEST_HEADER include/spdk/lvol.h 00:01:53.022 TEST_HEADER include/spdk/memory.h 00:01:53.022 TEST_HEADER include/spdk/mmio.h 00:01:53.022 TEST_HEADER include/spdk/notify.h 00:01:53.022 CC app/spdk_dd/spdk_dd.o 00:01:53.022 TEST_HEADER include/spdk/nbd.h 00:01:53.022 TEST_HEADER include/spdk/nvme.h 00:01:53.022 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:53.022 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:53.022 TEST_HEADER include/spdk/nvme_intel.h 00:01:53.022 TEST_HEADER include/spdk/nvme_spec.h 00:01:53.022 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:53.022 TEST_HEADER include/spdk/nvme_zns.h 00:01:53.022 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:53.022 TEST_HEADER include/spdk/nvmf.h 00:01:53.022 TEST_HEADER include/spdk/nvmf_spec.h 00:01:53.022 CC app/spdk_tgt/spdk_tgt.o 00:01:53.022 TEST_HEADER include/spdk/opal.h 00:01:53.022 TEST_HEADER include/spdk/opal_spec.h 00:01:53.022 TEST_HEADER include/spdk/nvmf_transport.h 00:01:53.022 TEST_HEADER include/spdk/pci_ids.h 00:01:53.022 TEST_HEADER include/spdk/reduce.h 00:01:53.022 TEST_HEADER include/spdk/pipe.h 00:01:53.022 TEST_HEADER include/spdk/queue.h 00:01:53.022 TEST_HEADER include/spdk/rpc.h 00:01:53.022 TEST_HEADER include/spdk/scsi.h 00:01:53.022 TEST_HEADER include/spdk/scheduler.h 00:01:53.022 TEST_HEADER include/spdk/sock.h 00:01:53.022 TEST_HEADER include/spdk/scsi_spec.h 00:01:53.022 TEST_HEADER include/spdk/stdinc.h 00:01:53.022 TEST_HEADER include/spdk/string.h 00:01:53.022 TEST_HEADER include/spdk/trace.h 00:01:53.022 TEST_HEADER include/spdk/thread.h 00:01:53.022 TEST_HEADER include/spdk/trace_parser.h 00:01:53.022 TEST_HEADER include/spdk/tree.h 00:01:53.022 TEST_HEADER include/spdk/ublk.h 00:01:53.022 TEST_HEADER include/spdk/uuid.h 00:01:53.022 TEST_HEADER include/spdk/version.h 00:01:53.022 TEST_HEADER include/spdk/util.h 00:01:53.022 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:53.022 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:53.022 TEST_HEADER include/spdk/vmd.h 00:01:53.022 TEST_HEADER include/spdk/xor.h 00:01:53.022 TEST_HEADER include/spdk/vhost.h 00:01:53.022 CC examples/accel/perf/accel_perf.o 00:01:53.022 TEST_HEADER include/spdk/zipf.h 00:01:53.022 CXX test/cpp_headers/accel_module.o 00:01:53.022 CXX test/cpp_headers/barrier.o 00:01:53.022 CXX test/cpp_headers/accel.o 00:01:53.022 CXX test/cpp_headers/assert.o 00:01:53.022 CXX test/cpp_headers/base64.o 00:01:53.022 CXX test/cpp_headers/bdev.o 00:01:53.022 CXX test/cpp_headers/bit_array.o 00:01:53.022 CXX test/cpp_headers/bdev_module.o 00:01:53.022 CXX test/cpp_headers/bdev_zone.o 00:01:53.022 CXX test/cpp_headers/bit_pool.o 00:01:53.022 CXX test/cpp_headers/blob_bdev.o 00:01:53.022 CXX test/cpp_headers/blobfs_bdev.o 00:01:53.022 CXX test/cpp_headers/conf.o 00:01:53.022 CXX test/cpp_headers/blobfs.o 00:01:53.022 CXX test/cpp_headers/config.o 00:01:53.022 CXX test/cpp_headers/blob.o 00:01:53.022 CC examples/ioat/verify/verify.o 00:01:53.022 CXX test/cpp_headers/crc16.o 00:01:53.022 CC examples/vmd/led/led.o 00:01:53.022 CXX test/cpp_headers/cpuset.o 00:01:53.022 CXX test/cpp_headers/crc32.o 00:01:53.022 CXX test/cpp_headers/crc64.o 00:01:53.022 CC examples/sock/hello_world/hello_sock.o 00:01:53.022 CC examples/idxd/perf/perf.o 00:01:53.022 CC examples/nvme/abort/abort.o 00:01:53.022 CC test/app/jsoncat/jsoncat.o 00:01:53.022 CC examples/nvme/reconnect/reconnect.o 00:01:53.022 CC test/app/histogram_perf/histogram_perf.o 00:01:53.022 CC examples/ioat/perf/perf.o 00:01:53.022 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:53.022 CC test/thread/poller_perf/poller_perf.o 00:01:53.022 CC test/nvme/sgl/sgl.o 00:01:53.022 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:53.022 CC examples/util/zipf/zipf.o 00:01:53.022 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:53.022 CC test/nvme/reset/reset.o 00:01:53.022 CC test/env/vtophys/vtophys.o 00:01:53.022 CC examples/vmd/lsvmd/lsvmd.o 00:01:53.022 CC test/nvme/e2edp/nvme_dp.o 00:01:53.022 CC examples/nvme/arbitration/arbitration.o 00:01:53.022 CC examples/nvme/hello_world/hello_world.o 00:01:53.022 CC test/nvme/fdp/fdp.o 00:01:53.022 CC test/nvme/cuse/cuse.o 00:01:53.022 CC test/nvme/startup/startup.o 00:01:53.022 CC test/env/memory/memory_ut.o 00:01:53.022 CC app/fio/nvme/fio_plugin.o 00:01:53.022 CC examples/nvme/hotplug/hotplug.o 00:01:53.022 CC test/app/stub/stub.o 00:01:53.022 CC examples/blob/cli/blobcli.o 00:01:53.022 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:53.022 CC test/nvme/reserve/reserve.o 00:01:53.022 CC app/fio/bdev/fio_plugin.o 00:01:53.022 CC test/nvme/aer/aer.o 00:01:53.022 CC examples/bdev/bdevperf/bdevperf.o 00:01:53.022 CC test/env/pci/pci_ut.o 00:01:53.022 CC test/nvme/boot_partition/boot_partition.o 00:01:53.022 CC test/nvme/connect_stress/connect_stress.o 00:01:53.022 CC test/nvme/err_injection/err_injection.o 00:01:53.022 CC test/nvme/compliance/nvme_compliance.o 00:01:53.022 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:53.022 CC test/nvme/simple_copy/simple_copy.o 00:01:53.022 CC test/bdev/bdevio/bdevio.o 00:01:53.283 CC examples/blob/hello_world/hello_blob.o 00:01:53.283 CXX test/cpp_headers/dif.o 00:01:53.283 CC test/nvme/overhead/overhead.o 00:01:53.283 CC test/event/reactor/reactor.o 00:01:53.283 CC test/accel/dif/dif.o 00:01:53.283 CC test/nvme/fused_ordering/fused_ordering.o 00:01:53.283 CC examples/thread/thread/thread_ex.o 00:01:53.283 CC test/event/reactor_perf/reactor_perf.o 00:01:53.283 CC test/event/event_perf/event_perf.o 00:01:53.283 CC test/blobfs/mkfs/mkfs.o 00:01:53.283 CC examples/bdev/hello_world/hello_bdev.o 00:01:53.283 CC test/event/app_repeat/app_repeat.o 00:01:53.283 CC test/app/bdev_svc/bdev_svc.o 00:01:53.283 CC examples/nvmf/nvmf/nvmf.o 00:01:53.283 CC test/dma/test_dma/test_dma.o 00:01:53.283 LINK spdk_lspci 00:01:53.283 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:53.283 CC test/event/scheduler/scheduler.o 00:01:53.283 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:53.283 CC test/lvol/esnap/esnap.o 00:01:53.283 LINK spdk_nvme_discover 00:01:53.283 CC test/env/mem_callbacks/mem_callbacks.o 00:01:53.283 LINK iscsi_tgt 00:01:53.283 LINK interrupt_tgt 00:01:53.548 LINK vtophys 00:01:53.548 LINK jsoncat 00:01:53.548 LINK histogram_perf 00:01:53.548 LINK vhost 00:01:53.548 LINK lsvmd 00:01:53.548 LINK zipf 00:01:53.548 LINK rpc_client_test 00:01:53.548 LINK nvmf_tgt 00:01:53.548 LINK reactor 00:01:53.548 LINK spdk_tgt 00:01:53.548 LINK event_perf 00:01:53.548 LINK led 00:01:53.548 LINK spdk_trace_record 00:01:53.548 LINK reactor_perf 00:01:53.548 LINK poller_perf 00:01:53.548 LINK doorbell_aers 00:01:53.548 LINK app_repeat 00:01:53.548 CXX test/cpp_headers/dma.o 00:01:53.548 LINK reserve 00:01:53.548 CXX test/cpp_headers/endian.o 00:01:53.548 LINK env_dpdk_post_init 00:01:53.548 LINK hello_world 00:01:53.548 LINK boot_partition 00:01:53.548 CXX test/cpp_headers/env_dpdk.o 00:01:53.548 CXX test/cpp_headers/env.o 00:01:53.548 CXX test/cpp_headers/event.o 00:01:53.548 CXX test/cpp_headers/fd_group.o 00:01:53.548 LINK cmb_copy 00:01:53.548 LINK hotplug 00:01:53.548 LINK startup 00:01:53.548 LINK ioat_perf 00:01:53.548 LINK connect_stress 00:01:53.548 LINK pmr_persistence 00:01:53.548 LINK err_injection 00:01:53.548 LINK hello_blob 00:01:53.548 CXX test/cpp_headers/file.o 00:01:53.548 CXX test/cpp_headers/ftl.o 00:01:53.548 CXX test/cpp_headers/fd.o 00:01:53.548 CXX test/cpp_headers/gpt_spec.o 00:01:53.548 LINK stub 00:01:53.548 CXX test/cpp_headers/hexlify.o 00:01:53.548 LINK verify 00:01:53.548 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:53.548 LINK nvme_dp 00:01:53.548 CXX test/cpp_headers/histogram_data.o 00:01:53.548 LINK bdev_svc 00:01:53.548 LINK mkfs 00:01:53.548 LINK hello_bdev 00:01:53.548 LINK fused_ordering 00:01:53.809 LINK spdk_dd 00:01:53.809 CXX test/cpp_headers/idxd.o 00:01:53.809 CXX test/cpp_headers/idxd_spec.o 00:01:53.809 LINK hello_sock 00:01:53.809 CXX test/cpp_headers/init.o 00:01:53.809 LINK reset 00:01:53.809 LINK simple_copy 00:01:53.809 LINK fdp 00:01:53.809 LINK sgl 00:01:53.809 LINK thread 00:01:53.809 CXX test/cpp_headers/ioat.o 00:01:53.809 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:53.809 LINK reconnect 00:01:53.809 CXX test/cpp_headers/ioat_spec.o 00:01:53.809 CXX test/cpp_headers/iscsi_spec.o 00:01:53.809 CXX test/cpp_headers/json.o 00:01:53.809 CXX test/cpp_headers/jsonrpc.o 00:01:53.809 LINK nvme_compliance 00:01:53.809 CXX test/cpp_headers/likely.o 00:01:53.809 LINK idxd_perf 00:01:53.809 CXX test/cpp_headers/log.o 00:01:53.809 CXX test/cpp_headers/lvol.o 00:01:53.809 LINK scheduler 00:01:53.809 CXX test/cpp_headers/memory.o 00:01:53.809 CXX test/cpp_headers/mmio.o 00:01:53.809 LINK overhead 00:01:53.809 CXX test/cpp_headers/nbd.o 00:01:53.809 CXX test/cpp_headers/notify.o 00:01:53.809 CXX test/cpp_headers/nvme.o 00:01:53.809 CXX test/cpp_headers/nvme_intel.o 00:01:53.809 LINK aer 00:01:53.809 LINK arbitration 00:01:53.809 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:53.809 CXX test/cpp_headers/nvme_ocssd.o 00:01:53.809 LINK nvmf 00:01:53.809 CXX test/cpp_headers/nvme_spec.o 00:01:53.809 CXX test/cpp_headers/nvme_zns.o 00:01:53.809 CXX test/cpp_headers/nvmf_cmd.o 00:01:53.809 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:53.809 CXX test/cpp_headers/nvmf.o 00:01:53.809 LINK accel_perf 00:01:53.809 LINK abort 00:01:53.809 CXX test/cpp_headers/nvmf_spec.o 00:01:53.809 CXX test/cpp_headers/nvmf_transport.o 00:01:53.809 CXX test/cpp_headers/opal.o 00:01:53.809 CXX test/cpp_headers/opal_spec.o 00:01:53.809 CXX test/cpp_headers/pipe.o 00:01:53.809 CXX test/cpp_headers/pci_ids.o 00:01:53.809 CXX test/cpp_headers/queue.o 00:01:53.809 CXX test/cpp_headers/reduce.o 00:01:53.809 CXX test/cpp_headers/rpc.o 00:01:53.809 CXX test/cpp_headers/scheduler.o 00:01:53.809 CXX test/cpp_headers/scsi.o 00:01:53.809 CXX test/cpp_headers/scsi_spec.o 00:01:53.809 CXX test/cpp_headers/sock.o 00:01:53.809 CXX test/cpp_headers/stdinc.o 00:01:53.809 LINK test_dma 00:01:53.809 CXX test/cpp_headers/string.o 00:01:53.809 CXX test/cpp_headers/trace.o 00:01:53.809 CXX test/cpp_headers/thread.o 00:01:53.809 CXX test/cpp_headers/trace_parser.o 00:01:54.070 CXX test/cpp_headers/tree.o 00:01:54.070 CXX test/cpp_headers/ublk.o 00:01:54.070 CXX test/cpp_headers/util.o 00:01:54.070 CXX test/cpp_headers/uuid.o 00:01:54.070 LINK pci_ut 00:01:54.070 LINK bdevio 00:01:54.070 CXX test/cpp_headers/version.o 00:01:54.070 LINK spdk_bdev 00:01:54.070 LINK dif 00:01:54.070 CXX test/cpp_headers/vfio_user_pci.o 00:01:54.070 CXX test/cpp_headers/vfio_user_spec.o 00:01:54.070 CXX test/cpp_headers/vhost.o 00:01:54.070 LINK blobcli 00:01:54.070 LINK spdk_trace 00:01:54.070 CXX test/cpp_headers/vmd.o 00:01:54.070 CXX test/cpp_headers/xor.o 00:01:54.070 CXX test/cpp_headers/zipf.o 00:01:54.070 LINK spdk_nvme 00:01:54.070 LINK nvme_fuzz 00:01:54.070 LINK nvme_manage 00:01:54.345 LINK bdevperf 00:01:54.345 LINK spdk_nvme_perf 00:01:54.345 LINK spdk_nvme_identify 00:01:54.345 LINK mem_callbacks 00:01:54.345 LINK spdk_top 00:01:54.345 LINK vhost_fuzz 00:01:54.603 LINK cuse 00:01:54.603 LINK memory_ut 00:01:55.170 LINK iscsi_fuzz 00:01:57.070 LINK esnap 00:01:57.070 00:01:57.070 real 0m39.587s 00:01:57.070 user 6m10.255s 00:01:57.070 sys 3m6.079s 00:01:57.070 20:07:28 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:01:57.070 20:07:28 -- common/autotest_common.sh@10 -- $ set +x 00:01:57.070 ************************************ 00:01:57.070 END TEST make 00:01:57.070 ************************************ 00:01:57.329 20:07:29 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:01:57.330 20:07:29 -- nvmf/common.sh@7 -- # uname -s 00:01:57.330 20:07:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:57.330 20:07:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:57.330 20:07:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:57.330 20:07:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:57.330 20:07:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:57.330 20:07:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:57.330 20:07:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:57.330 20:07:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:57.330 20:07:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:57.330 20:07:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:57.330 20:07:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:01:57.330 20:07:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:01:57.330 20:07:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:57.330 20:07:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:57.330 20:07:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:57.330 20:07:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:57.330 20:07:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:57.330 20:07:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:57.330 20:07:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:57.330 20:07:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:57.330 20:07:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:57.330 20:07:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:57.330 20:07:29 -- paths/export.sh@5 -- # export PATH 00:01:57.330 20:07:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:57.330 20:07:29 -- nvmf/common.sh@46 -- # : 0 00:01:57.330 20:07:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:01:57.330 20:07:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:01:57.330 20:07:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:01:57.330 20:07:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:57.330 20:07:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:57.330 20:07:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:01:57.330 20:07:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:01:57.330 20:07:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:01:57.330 20:07:29 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:57.330 20:07:29 -- spdk/autotest.sh@32 -- # uname -s 00:01:57.330 20:07:29 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:57.330 20:07:29 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:57.330 20:07:29 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:57.330 20:07:29 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:57.330 20:07:29 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:57.330 20:07:29 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:57.330 20:07:29 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:57.330 20:07:29 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:57.330 20:07:29 -- spdk/autotest.sh@48 -- # udevadm_pid=3178195 00:01:57.330 20:07:29 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:57.330 20:07:29 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:57.330 20:07:29 -- spdk/autotest.sh@54 -- # echo 3178197 00:01:57.330 20:07:29 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:57.330 20:07:29 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:57.330 20:07:29 -- spdk/autotest.sh@56 -- # echo 3178198 00:01:57.330 20:07:29 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:01:57.330 20:07:29 -- spdk/autotest.sh@60 -- # echo 3178199 00:01:57.330 20:07:29 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:57.330 20:07:29 -- spdk/autotest.sh@62 -- # echo 3178200 00:01:57.330 20:07:29 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:57.330 20:07:29 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:57.330 20:07:29 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:01:57.330 20:07:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:01:57.330 20:07:29 -- common/autotest_common.sh@10 -- # set +x 00:01:57.330 20:07:29 -- spdk/autotest.sh@70 -- # create_test_list 00:01:57.330 20:07:29 -- common/autotest_common.sh@736 -- # xtrace_disable 00:01:57.330 20:07:29 -- common/autotest_common.sh@10 -- # set +x 00:01:57.330 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:01:57.330 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:01:57.330 20:07:29 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:01:57.330 20:07:29 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:57.330 20:07:29 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:57.330 20:07:29 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:57.330 20:07:29 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:57.330 20:07:29 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:01:57.330 20:07:29 -- common/autotest_common.sh@1440 -- # uname 00:01:57.330 20:07:29 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:01:57.330 20:07:29 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:01:57.330 20:07:29 -- common/autotest_common.sh@1460 -- # uname 00:01:57.330 20:07:29 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:01:57.330 20:07:29 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:01:57.330 20:07:29 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:01:57.330 20:07:29 -- spdk/autotest.sh@83 -- # hash lcov 00:01:57.330 20:07:29 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:01:57.330 20:07:29 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:01:57.330 --rc lcov_branch_coverage=1 00:01:57.330 --rc lcov_function_coverage=1 00:01:57.330 --rc genhtml_branch_coverage=1 00:01:57.330 --rc genhtml_function_coverage=1 00:01:57.330 --rc genhtml_legend=1 00:01:57.330 --rc geninfo_all_blocks=1 00:01:57.330 ' 00:01:57.330 20:07:29 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:01:57.330 --rc lcov_branch_coverage=1 00:01:57.330 --rc lcov_function_coverage=1 00:01:57.330 --rc genhtml_branch_coverage=1 00:01:57.330 --rc genhtml_function_coverage=1 00:01:57.330 --rc genhtml_legend=1 00:01:57.330 --rc geninfo_all_blocks=1 00:01:57.330 ' 00:01:57.330 20:07:29 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:01:57.330 --rc lcov_branch_coverage=1 00:01:57.330 --rc lcov_function_coverage=1 00:01:57.330 --rc genhtml_branch_coverage=1 00:01:57.330 --rc genhtml_function_coverage=1 00:01:57.330 --rc genhtml_legend=1 00:01:57.330 --rc geninfo_all_blocks=1 00:01:57.330 --no-external' 00:01:57.330 20:07:29 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:01:57.330 --rc lcov_branch_coverage=1 00:01:57.330 --rc lcov_function_coverage=1 00:01:57.330 --rc genhtml_branch_coverage=1 00:01:57.330 --rc genhtml_function_coverage=1 00:01:57.330 --rc genhtml_legend=1 00:01:57.330 --rc geninfo_all_blocks=1 00:01:57.330 --no-external' 00:01:57.330 20:07:29 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:01:57.590 lcov: LCOV version 1.14 00:01:57.590 20:07:29 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:00.262 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:00.262 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:00.262 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:00.262 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:00.262 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:00.262 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:15.191 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:15.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:15.192 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:15.192 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:15.193 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:15.193 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:15.193 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:17.730 20:07:49 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:02:17.730 20:07:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:17.730 20:07:49 -- common/autotest_common.sh@10 -- # set +x 00:02:17.730 20:07:49 -- spdk/autotest.sh@102 -- # rm -f 00:02:17.730 20:07:49 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:21.021 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:02:21.021 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:02:21.021 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:02:21.021 20:07:52 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:02:21.021 20:07:52 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:21.021 20:07:52 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:21.021 20:07:52 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:21.021 20:07:52 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:21.021 20:07:52 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:21.021 20:07:52 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:21.021 20:07:52 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:21.021 20:07:52 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:21.021 20:07:52 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:02:21.021 20:07:52 -- spdk/autotest.sh@121 -- # grep -v p 00:02:21.021 20:07:52 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:02:21.021 20:07:52 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:21.021 20:07:52 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:02:21.021 20:07:52 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:02:21.021 20:07:52 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:21.021 20:07:52 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:21.021 No valid GPT data, bailing 00:02:21.021 20:07:52 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:21.021 20:07:52 -- scripts/common.sh@393 -- # pt= 00:02:21.021 20:07:52 -- scripts/common.sh@394 -- # return 1 00:02:21.021 20:07:52 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:21.021 1+0 records in 00:02:21.021 1+0 records out 00:02:21.021 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601651 s, 174 MB/s 00:02:21.021 20:07:52 -- spdk/autotest.sh@129 -- # sync 00:02:21.021 20:07:52 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:21.021 20:07:52 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:21.021 20:07:52 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:25.213 20:07:57 -- spdk/autotest.sh@135 -- # uname -s 00:02:25.213 20:07:57 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:02:25.213 20:07:57 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:25.213 20:07:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:25.213 20:07:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:25.213 20:07:57 -- common/autotest_common.sh@10 -- # set +x 00:02:25.213 ************************************ 00:02:25.213 START TEST setup.sh 00:02:25.213 ************************************ 00:02:25.213 20:07:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:25.473 * Looking for test storage... 00:02:25.473 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:25.473 20:07:57 -- setup/test-setup.sh@10 -- # uname -s 00:02:25.473 20:07:57 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:25.473 20:07:57 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:25.473 20:07:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:25.473 20:07:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:25.473 20:07:57 -- common/autotest_common.sh@10 -- # set +x 00:02:25.473 ************************************ 00:02:25.473 START TEST acl 00:02:25.473 ************************************ 00:02:25.473 20:07:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:25.473 * Looking for test storage... 00:02:25.473 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:25.473 20:07:57 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:25.473 20:07:57 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:25.473 20:07:57 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:25.473 20:07:57 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:25.473 20:07:57 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:25.473 20:07:57 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:25.473 20:07:57 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:25.473 20:07:57 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:25.473 20:07:57 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:25.473 20:07:57 -- setup/acl.sh@12 -- # devs=() 00:02:25.473 20:07:57 -- setup/acl.sh@12 -- # declare -a devs 00:02:25.473 20:07:57 -- setup/acl.sh@13 -- # drivers=() 00:02:25.473 20:07:57 -- setup/acl.sh@13 -- # declare -A drivers 00:02:25.473 20:07:57 -- setup/acl.sh@51 -- # setup reset 00:02:25.473 20:07:57 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:25.473 20:07:57 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:28.763 20:08:00 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:28.763 20:08:00 -- setup/acl.sh@16 -- # local dev driver 00:02:28.763 20:08:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:28.763 20:08:00 -- setup/acl.sh@15 -- # setup output status 00:02:28.763 20:08:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:28.763 20:08:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:31.299 Hugepages 00:02:31.299 node hugesize free / total 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 00:02:31.299 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:5e:00.0 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:31.299 20:08:02 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.299 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.299 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.299 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.300 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.300 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.300 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.300 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.300 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.300 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.300 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.300 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.300 20:08:02 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:31.300 20:08:02 -- setup/acl.sh@20 -- # continue 00:02:31.300 20:08:02 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:31.300 20:08:02 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:31.300 20:08:02 -- setup/acl.sh@54 -- # run_test denied denied 00:02:31.300 20:08:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:31.300 20:08:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:31.300 20:08:02 -- common/autotest_common.sh@10 -- # set +x 00:02:31.300 ************************************ 00:02:31.300 START TEST denied 00:02:31.300 ************************************ 00:02:31.300 20:08:02 -- common/autotest_common.sh@1104 -- # denied 00:02:31.300 20:08:02 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:5e:00.0' 00:02:31.300 20:08:02 -- setup/acl.sh@38 -- # setup output config 00:02:31.300 20:08:02 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5e:00.0' 00:02:31.300 20:08:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:31.300 20:08:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:34.608 0000:5e:00.0 (8086 0a54): Skipping denied controller at 0000:5e:00.0 00:02:34.608 20:08:05 -- setup/acl.sh@40 -- # verify 0000:5e:00.0 00:02:34.608 20:08:05 -- setup/acl.sh@28 -- # local dev driver 00:02:34.608 20:08:05 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:34.608 20:08:05 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5e:00.0 ]] 00:02:34.608 20:08:05 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5e:00.0/driver 00:02:34.608 20:08:05 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:34.608 20:08:05 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:34.608 20:08:05 -- setup/acl.sh@41 -- # setup reset 00:02:34.608 20:08:05 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:34.608 20:08:05 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:38.802 00:02:38.802 real 0m6.960s 00:02:38.802 user 0m2.310s 00:02:38.802 sys 0m4.016s 00:02:38.802 20:08:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:38.802 20:08:09 -- common/autotest_common.sh@10 -- # set +x 00:02:38.802 ************************************ 00:02:38.802 END TEST denied 00:02:38.802 ************************************ 00:02:38.802 20:08:09 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:38.802 20:08:09 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:38.802 20:08:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:38.802 20:08:09 -- common/autotest_common.sh@10 -- # set +x 00:02:38.802 ************************************ 00:02:38.802 START TEST allowed 00:02:38.802 ************************************ 00:02:38.802 20:08:09 -- common/autotest_common.sh@1104 -- # allowed 00:02:38.802 20:08:09 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5e:00.0 00:02:38.802 20:08:09 -- setup/acl.sh@45 -- # setup output config 00:02:38.802 20:08:09 -- setup/acl.sh@46 -- # grep -E '0000:5e:00.0 .*: nvme -> .*' 00:02:38.802 20:08:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:38.802 20:08:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:42.090 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:02:42.090 20:08:13 -- setup/acl.sh@47 -- # verify 00:02:42.090 20:08:13 -- setup/acl.sh@28 -- # local dev driver 00:02:42.090 20:08:13 -- setup/acl.sh@48 -- # setup reset 00:02:42.090 20:08:13 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:42.090 20:08:13 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:44.634 00:02:44.634 real 0m6.411s 00:02:44.634 user 0m1.923s 00:02:44.634 sys 0m3.602s 00:02:44.634 20:08:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:44.634 20:08:16 -- common/autotest_common.sh@10 -- # set +x 00:02:44.634 ************************************ 00:02:44.635 END TEST allowed 00:02:44.635 ************************************ 00:02:44.635 00:02:44.635 real 0m19.179s 00:02:44.635 user 0m6.455s 00:02:44.635 sys 0m11.425s 00:02:44.635 20:08:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:44.635 20:08:16 -- common/autotest_common.sh@10 -- # set +x 00:02:44.635 ************************************ 00:02:44.635 END TEST acl 00:02:44.635 ************************************ 00:02:44.635 20:08:16 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:44.635 20:08:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:44.635 20:08:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:44.635 20:08:16 -- common/autotest_common.sh@10 -- # set +x 00:02:44.635 ************************************ 00:02:44.635 START TEST hugepages 00:02:44.635 ************************************ 00:02:44.635 20:08:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:44.635 * Looking for test storage... 00:02:44.635 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:44.635 20:08:16 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:44.635 20:08:16 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:44.635 20:08:16 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:44.635 20:08:16 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:44.635 20:08:16 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:44.635 20:08:16 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:44.635 20:08:16 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:44.635 20:08:16 -- setup/common.sh@18 -- # local node= 00:02:44.635 20:08:16 -- setup/common.sh@19 -- # local var val 00:02:44.635 20:08:16 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.635 20:08:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.635 20:08:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.635 20:08:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.635 20:08:16 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.635 20:08:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 169172472 kB' 'MemAvailable: 172092044 kB' 'Buffers: 3896 kB' 'Cached: 14365412 kB' 'SwapCached: 0 kB' 'Active: 11306396 kB' 'Inactive: 3519248 kB' 'Active(anon): 10889016 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459636 kB' 'Mapped: 164048 kB' 'Shmem: 10432680 kB' 'KReclaimable: 254320 kB' 'Slab: 873640 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 619320 kB' 'KernelStack: 20768 kB' 'PageTables: 9364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 101982020 kB' 'Committed_AS: 12440860 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 315936 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.635 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.635 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.636 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.636 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # continue 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.637 20:08:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.637 20:08:16 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:44.637 20:08:16 -- setup/common.sh@33 -- # echo 2048 00:02:44.637 20:08:16 -- setup/common.sh@33 -- # return 0 00:02:44.637 20:08:16 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:44.637 20:08:16 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:44.637 20:08:16 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:44.637 20:08:16 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:44.637 20:08:16 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:44.637 20:08:16 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:44.637 20:08:16 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:44.637 20:08:16 -- setup/hugepages.sh@207 -- # get_nodes 00:02:44.637 20:08:16 -- setup/hugepages.sh@27 -- # local node 00:02:44.637 20:08:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:44.637 20:08:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:44.637 20:08:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:44.637 20:08:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:44.637 20:08:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:44.637 20:08:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:44.637 20:08:16 -- setup/hugepages.sh@208 -- # clear_hp 00:02:44.637 20:08:16 -- setup/hugepages.sh@37 -- # local node hp 00:02:44.637 20:08:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:44.637 20:08:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:44.637 20:08:16 -- setup/hugepages.sh@41 -- # echo 0 00:02:44.637 20:08:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:44.637 20:08:16 -- setup/hugepages.sh@41 -- # echo 0 00:02:44.637 20:08:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:44.637 20:08:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:44.637 20:08:16 -- setup/hugepages.sh@41 -- # echo 0 00:02:44.637 20:08:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:44.637 20:08:16 -- setup/hugepages.sh@41 -- # echo 0 00:02:44.637 20:08:16 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:44.637 20:08:16 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:44.637 20:08:16 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:44.637 20:08:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:44.637 20:08:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:44.637 20:08:16 -- common/autotest_common.sh@10 -- # set +x 00:02:44.637 ************************************ 00:02:44.637 START TEST default_setup 00:02:44.637 ************************************ 00:02:44.637 20:08:16 -- common/autotest_common.sh@1104 -- # default_setup 00:02:44.637 20:08:16 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:44.637 20:08:16 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:44.637 20:08:16 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:44.637 20:08:16 -- setup/hugepages.sh@51 -- # shift 00:02:44.637 20:08:16 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:44.637 20:08:16 -- setup/hugepages.sh@52 -- # local node_ids 00:02:44.637 20:08:16 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:44.637 20:08:16 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:44.637 20:08:16 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:44.637 20:08:16 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:44.637 20:08:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:44.637 20:08:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:44.637 20:08:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:44.637 20:08:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:44.637 20:08:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:44.637 20:08:16 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:44.637 20:08:16 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:44.637 20:08:16 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:44.638 20:08:16 -- setup/hugepages.sh@73 -- # return 0 00:02:44.638 20:08:16 -- setup/hugepages.sh@137 -- # setup output 00:02:44.638 20:08:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:44.638 20:08:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:47.949 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:02:47.949 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:02:48.520 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:02:48.520 20:08:20 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:48.520 20:08:20 -- setup/hugepages.sh@89 -- # local node 00:02:48.520 20:08:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:48.520 20:08:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:48.521 20:08:20 -- setup/hugepages.sh@92 -- # local surp 00:02:48.521 20:08:20 -- setup/hugepages.sh@93 -- # local resv 00:02:48.521 20:08:20 -- setup/hugepages.sh@94 -- # local anon 00:02:48.521 20:08:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:48.521 20:08:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:48.521 20:08:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:48.521 20:08:20 -- setup/common.sh@18 -- # local node= 00:02:48.521 20:08:20 -- setup/common.sh@19 -- # local var val 00:02:48.521 20:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.521 20:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.521 20:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.521 20:08:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.521 20:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.521 20:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171320416 kB' 'MemAvailable: 174239988 kB' 'Buffers: 3896 kB' 'Cached: 14365532 kB' 'SwapCached: 0 kB' 'Active: 11325192 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907812 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478516 kB' 'Mapped: 164028 kB' 'Shmem: 10432800 kB' 'KReclaimable: 254320 kB' 'Slab: 872052 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617732 kB' 'KernelStack: 20688 kB' 'PageTables: 8952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12461416 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316128 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.521 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.521 20:08:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.522 20:08:20 -- setup/common.sh@33 -- # echo 0 00:02:48.522 20:08:20 -- setup/common.sh@33 -- # return 0 00:02:48.522 20:08:20 -- setup/hugepages.sh@97 -- # anon=0 00:02:48.522 20:08:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:48.522 20:08:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.522 20:08:20 -- setup/common.sh@18 -- # local node= 00:02:48.522 20:08:20 -- setup/common.sh@19 -- # local var val 00:02:48.522 20:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.522 20:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.522 20:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.522 20:08:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.522 20:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.522 20:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.522 20:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171320428 kB' 'MemAvailable: 174240000 kB' 'Buffers: 3896 kB' 'Cached: 14365536 kB' 'SwapCached: 0 kB' 'Active: 11325752 kB' 'Inactive: 3519248 kB' 'Active(anon): 10908372 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479012 kB' 'Mapped: 163952 kB' 'Shmem: 10432804 kB' 'KReclaimable: 254320 kB' 'Slab: 872040 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617720 kB' 'KernelStack: 20704 kB' 'PageTables: 8984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12461428 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316128 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.522 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.522 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.523 20:08:20 -- setup/common.sh@33 -- # echo 0 00:02:48.523 20:08:20 -- setup/common.sh@33 -- # return 0 00:02:48.523 20:08:20 -- setup/hugepages.sh@99 -- # surp=0 00:02:48.523 20:08:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:48.523 20:08:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:48.523 20:08:20 -- setup/common.sh@18 -- # local node= 00:02:48.523 20:08:20 -- setup/common.sh@19 -- # local var val 00:02:48.523 20:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.523 20:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.523 20:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.523 20:08:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.523 20:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.523 20:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.523 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.523 20:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171321708 kB' 'MemAvailable: 174241280 kB' 'Buffers: 3896 kB' 'Cached: 14365548 kB' 'SwapCached: 0 kB' 'Active: 11325236 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907856 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478416 kB' 'Mapped: 163924 kB' 'Shmem: 10432816 kB' 'KReclaimable: 254320 kB' 'Slab: 872076 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617756 kB' 'KernelStack: 20816 kB' 'PageTables: 9016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12461444 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316144 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.524 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.524 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.525 20:08:20 -- setup/common.sh@33 -- # echo 0 00:02:48.525 20:08:20 -- setup/common.sh@33 -- # return 0 00:02:48.525 20:08:20 -- setup/hugepages.sh@100 -- # resv=0 00:02:48.525 20:08:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:48.525 nr_hugepages=1024 00:02:48.525 20:08:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:48.525 resv_hugepages=0 00:02:48.525 20:08:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:48.525 surplus_hugepages=0 00:02:48.525 20:08:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:48.525 anon_hugepages=0 00:02:48.525 20:08:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:48.525 20:08:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:48.525 20:08:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:48.525 20:08:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:48.525 20:08:20 -- setup/common.sh@18 -- # local node= 00:02:48.525 20:08:20 -- setup/common.sh@19 -- # local var val 00:02:48.525 20:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.525 20:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.525 20:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.525 20:08:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.525 20:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.525 20:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171322764 kB' 'MemAvailable: 174242336 kB' 'Buffers: 3896 kB' 'Cached: 14365560 kB' 'SwapCached: 0 kB' 'Active: 11325152 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907772 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478360 kB' 'Mapped: 163924 kB' 'Shmem: 10432828 kB' 'KReclaimable: 254320 kB' 'Slab: 872076 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617756 kB' 'KernelStack: 20752 kB' 'PageTables: 8792 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12461460 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316208 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.525 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.525 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.526 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.526 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.527 20:08:20 -- setup/common.sh@33 -- # echo 1024 00:02:48.527 20:08:20 -- setup/common.sh@33 -- # return 0 00:02:48.527 20:08:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:48.527 20:08:20 -- setup/hugepages.sh@112 -- # get_nodes 00:02:48.527 20:08:20 -- setup/hugepages.sh@27 -- # local node 00:02:48.527 20:08:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:48.527 20:08:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:48.527 20:08:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:48.527 20:08:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:48.527 20:08:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:48.527 20:08:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:48.527 20:08:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:48.527 20:08:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:48.527 20:08:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:48.527 20:08:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.527 20:08:20 -- setup/common.sh@18 -- # local node=0 00:02:48.527 20:08:20 -- setup/common.sh@19 -- # local var val 00:02:48.527 20:08:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.527 20:08:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.527 20:08:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:48.527 20:08:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:48.527 20:08:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.527 20:08:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 91749248 kB' 'MemUsed: 5866380 kB' 'SwapCached: 0 kB' 'Active: 2047160 kB' 'Inactive: 202016 kB' 'Active(anon): 1885400 kB' 'Inactive(anon): 0 kB' 'Active(file): 161760 kB' 'Inactive(file): 202016 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2062152 kB' 'Mapped: 62768 kB' 'AnonPages: 190188 kB' 'Shmem: 1698376 kB' 'KernelStack: 11528 kB' 'PageTables: 3948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132620 kB' 'Slab: 413296 kB' 'SReclaimable: 132620 kB' 'SUnreclaim: 280676 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.527 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.527 20:08:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # continue 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.528 20:08:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.528 20:08:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.528 20:08:20 -- setup/common.sh@33 -- # echo 0 00:02:48.528 20:08:20 -- setup/common.sh@33 -- # return 0 00:02:48.528 20:08:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:48.528 20:08:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:48.528 20:08:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:48.528 20:08:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:48.528 20:08:20 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:48.528 node0=1024 expecting 1024 00:02:48.528 20:08:20 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:48.528 00:02:48.528 real 0m3.912s 00:02:48.528 user 0m1.202s 00:02:48.528 sys 0m1.917s 00:02:48.528 20:08:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:48.528 20:08:20 -- common/autotest_common.sh@10 -- # set +x 00:02:48.528 ************************************ 00:02:48.528 END TEST default_setup 00:02:48.528 ************************************ 00:02:48.787 20:08:20 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:48.787 20:08:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:48.787 20:08:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:48.787 20:08:20 -- common/autotest_common.sh@10 -- # set +x 00:02:48.787 ************************************ 00:02:48.787 START TEST per_node_1G_alloc 00:02:48.787 ************************************ 00:02:48.787 20:08:20 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:02:48.787 20:08:20 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:48.787 20:08:20 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:48.787 20:08:20 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:48.787 20:08:20 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:48.787 20:08:20 -- setup/hugepages.sh@51 -- # shift 00:02:48.788 20:08:20 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:48.788 20:08:20 -- setup/hugepages.sh@52 -- # local node_ids 00:02:48.788 20:08:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:48.788 20:08:20 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:48.788 20:08:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:48.788 20:08:20 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:48.788 20:08:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:48.788 20:08:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:48.788 20:08:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:48.788 20:08:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:48.788 20:08:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:48.788 20:08:20 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:48.788 20:08:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:48.788 20:08:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:48.788 20:08:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:48.788 20:08:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:48.788 20:08:20 -- setup/hugepages.sh@73 -- # return 0 00:02:48.788 20:08:20 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:48.788 20:08:20 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:48.788 20:08:20 -- setup/hugepages.sh@146 -- # setup output 00:02:48.788 20:08:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:48.788 20:08:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:51.323 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:51.323 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:51.323 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:51.323 20:08:23 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:51.323 20:08:23 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:51.323 20:08:23 -- setup/hugepages.sh@89 -- # local node 00:02:51.323 20:08:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:51.323 20:08:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:51.323 20:08:23 -- setup/hugepages.sh@92 -- # local surp 00:02:51.323 20:08:23 -- setup/hugepages.sh@93 -- # local resv 00:02:51.323 20:08:23 -- setup/hugepages.sh@94 -- # local anon 00:02:51.323 20:08:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:51.323 20:08:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:51.323 20:08:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:51.323 20:08:23 -- setup/common.sh@18 -- # local node= 00:02:51.323 20:08:23 -- setup/common.sh@19 -- # local var val 00:02:51.323 20:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.323 20:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.323 20:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.323 20:08:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.323 20:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.323 20:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.323 20:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171314212 kB' 'MemAvailable: 174233784 kB' 'Buffers: 3896 kB' 'Cached: 14365632 kB' 'SwapCached: 0 kB' 'Active: 11325888 kB' 'Inactive: 3519248 kB' 'Active(anon): 10908508 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478320 kB' 'Mapped: 163960 kB' 'Shmem: 10432900 kB' 'KReclaimable: 254320 kB' 'Slab: 872120 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617800 kB' 'KernelStack: 20704 kB' 'PageTables: 8944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12471240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316416 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.323 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.323 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.324 20:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.324 20:08:23 -- setup/common.sh@33 -- # echo 0 00:02:51.324 20:08:23 -- setup/common.sh@33 -- # return 0 00:02:51.324 20:08:23 -- setup/hugepages.sh@97 -- # anon=0 00:02:51.324 20:08:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:51.324 20:08:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.324 20:08:23 -- setup/common.sh@18 -- # local node= 00:02:51.324 20:08:23 -- setup/common.sh@19 -- # local var val 00:02:51.324 20:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.324 20:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.324 20:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.324 20:08:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.324 20:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.324 20:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.324 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171314004 kB' 'MemAvailable: 174233576 kB' 'Buffers: 3896 kB' 'Cached: 14365640 kB' 'SwapCached: 0 kB' 'Active: 11327008 kB' 'Inactive: 3519248 kB' 'Active(anon): 10909628 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480008 kB' 'Mapped: 164036 kB' 'Shmem: 10432908 kB' 'KReclaimable: 254320 kB' 'Slab: 871980 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617660 kB' 'KernelStack: 20752 kB' 'PageTables: 8940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12461560 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316240 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.325 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.325 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.326 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.326 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.588 20:08:23 -- setup/common.sh@33 -- # echo 0 00:02:51.588 20:08:23 -- setup/common.sh@33 -- # return 0 00:02:51.588 20:08:23 -- setup/hugepages.sh@99 -- # surp=0 00:02:51.588 20:08:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:51.588 20:08:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:51.588 20:08:23 -- setup/common.sh@18 -- # local node= 00:02:51.588 20:08:23 -- setup/common.sh@19 -- # local var val 00:02:51.588 20:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.588 20:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.588 20:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.588 20:08:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.588 20:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.588 20:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171313160 kB' 'MemAvailable: 174232732 kB' 'Buffers: 3896 kB' 'Cached: 14365656 kB' 'SwapCached: 0 kB' 'Active: 11325776 kB' 'Inactive: 3519248 kB' 'Active(anon): 10908396 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478772 kB' 'Mapped: 163932 kB' 'Shmem: 10432924 kB' 'KReclaimable: 254320 kB' 'Slab: 871936 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617616 kB' 'KernelStack: 20768 kB' 'PageTables: 9092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12460184 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316304 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.588 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.588 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.588 20:08:23 -- setup/common.sh@33 -- # echo 0 00:02:51.588 20:08:23 -- setup/common.sh@33 -- # return 0 00:02:51.588 20:08:23 -- setup/hugepages.sh@100 -- # resv=0 00:02:51.588 20:08:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:51.588 nr_hugepages=1024 00:02:51.588 20:08:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:51.588 resv_hugepages=0 00:02:51.588 20:08:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:51.588 surplus_hugepages=0 00:02:51.589 20:08:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:51.589 anon_hugepages=0 00:02:51.589 20:08:23 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:51.589 20:08:23 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:51.589 20:08:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:51.589 20:08:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:51.589 20:08:23 -- setup/common.sh@18 -- # local node= 00:02:51.589 20:08:23 -- setup/common.sh@19 -- # local var val 00:02:51.589 20:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.589 20:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.589 20:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.589 20:08:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.589 20:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.589 20:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171312344 kB' 'MemAvailable: 174231916 kB' 'Buffers: 3896 kB' 'Cached: 14365656 kB' 'SwapCached: 0 kB' 'Active: 11325692 kB' 'Inactive: 3519248 kB' 'Active(anon): 10908312 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478672 kB' 'Mapped: 163932 kB' 'Shmem: 10432924 kB' 'KReclaimable: 254320 kB' 'Slab: 871936 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617616 kB' 'KernelStack: 20768 kB' 'PageTables: 8956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12461592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316320 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.589 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.589 20:08:23 -- setup/common.sh@33 -- # echo 1024 00:02:51.589 20:08:23 -- setup/common.sh@33 -- # return 0 00:02:51.589 20:08:23 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:51.589 20:08:23 -- setup/hugepages.sh@112 -- # get_nodes 00:02:51.589 20:08:23 -- setup/hugepages.sh@27 -- # local node 00:02:51.589 20:08:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:51.589 20:08:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:51.589 20:08:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:51.589 20:08:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:51.589 20:08:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:51.589 20:08:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:51.589 20:08:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:51.589 20:08:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:51.589 20:08:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:51.589 20:08:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.589 20:08:23 -- setup/common.sh@18 -- # local node=0 00:02:51.589 20:08:23 -- setup/common.sh@19 -- # local var val 00:02:51.589 20:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.589 20:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.589 20:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:51.589 20:08:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:51.589 20:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.589 20:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.589 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 92792016 kB' 'MemUsed: 4823612 kB' 'SwapCached: 0 kB' 'Active: 2048820 kB' 'Inactive: 202016 kB' 'Active(anon): 1887060 kB' 'Inactive(anon): 0 kB' 'Active(file): 161760 kB' 'Inactive(file): 202016 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2062196 kB' 'Mapped: 62768 kB' 'AnonPages: 191864 kB' 'Shmem: 1698420 kB' 'KernelStack: 11752 kB' 'PageTables: 4376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132620 kB' 'Slab: 413368 kB' 'SReclaimable: 132620 kB' 'SUnreclaim: 280748 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@33 -- # echo 0 00:02:51.590 20:08:23 -- setup/common.sh@33 -- # return 0 00:02:51.590 20:08:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:51.590 20:08:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:51.590 20:08:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:51.590 20:08:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:51.590 20:08:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.590 20:08:23 -- setup/common.sh@18 -- # local node=1 00:02:51.590 20:08:23 -- setup/common.sh@19 -- # local var val 00:02:51.590 20:08:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.590 20:08:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.590 20:08:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:51.590 20:08:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:51.590 20:08:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.590 20:08:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93765508 kB' 'MemFree: 78521320 kB' 'MemUsed: 15244188 kB' 'SwapCached: 0 kB' 'Active: 9277416 kB' 'Inactive: 3317232 kB' 'Active(anon): 9021796 kB' 'Inactive(anon): 0 kB' 'Active(file): 255620 kB' 'Inactive(file): 3317232 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 12307404 kB' 'Mapped: 101164 kB' 'AnonPages: 287380 kB' 'Shmem: 8734552 kB' 'KernelStack: 9192 kB' 'PageTables: 4868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 121700 kB' 'Slab: 458568 kB' 'SReclaimable: 121700 kB' 'SUnreclaim: 336868 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.590 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.590 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # continue 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.591 20:08:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.591 20:08:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.591 20:08:23 -- setup/common.sh@33 -- # echo 0 00:02:51.591 20:08:23 -- setup/common.sh@33 -- # return 0 00:02:51.591 20:08:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:51.591 20:08:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:51.591 20:08:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:51.591 20:08:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:51.591 20:08:23 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:51.591 node0=512 expecting 512 00:02:51.591 20:08:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:51.591 20:08:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:51.591 20:08:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:51.591 20:08:23 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:51.591 node1=512 expecting 512 00:02:51.591 20:08:23 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:51.591 00:02:51.591 real 0m2.893s 00:02:51.591 user 0m1.198s 00:02:51.591 sys 0m1.752s 00:02:51.591 20:08:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:51.591 20:08:23 -- common/autotest_common.sh@10 -- # set +x 00:02:51.591 ************************************ 00:02:51.591 END TEST per_node_1G_alloc 00:02:51.591 ************************************ 00:02:51.591 20:08:23 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:51.591 20:08:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:51.591 20:08:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:51.591 20:08:23 -- common/autotest_common.sh@10 -- # set +x 00:02:51.591 ************************************ 00:02:51.591 START TEST even_2G_alloc 00:02:51.591 ************************************ 00:02:51.591 20:08:23 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:02:51.591 20:08:23 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:51.591 20:08:23 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:51.591 20:08:23 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:51.591 20:08:23 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:51.591 20:08:23 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:51.591 20:08:23 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:51.591 20:08:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:51.591 20:08:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:51.591 20:08:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:51.591 20:08:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:51.591 20:08:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:51.591 20:08:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:51.591 20:08:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:51.591 20:08:23 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:51.591 20:08:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:51.591 20:08:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:51.591 20:08:23 -- setup/hugepages.sh@83 -- # : 512 00:02:51.591 20:08:23 -- setup/hugepages.sh@84 -- # : 1 00:02:51.591 20:08:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:51.591 20:08:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:51.591 20:08:23 -- setup/hugepages.sh@83 -- # : 0 00:02:51.591 20:08:23 -- setup/hugepages.sh@84 -- # : 0 00:02:51.591 20:08:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:51.591 20:08:23 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:51.591 20:08:23 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:51.591 20:08:23 -- setup/hugepages.sh@153 -- # setup output 00:02:51.591 20:08:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:51.591 20:08:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:54.126 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:54.126 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:54.126 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:54.126 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:54.126 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:54.389 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:54.390 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:54.390 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:54.390 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:54.390 20:08:26 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:54.390 20:08:26 -- setup/hugepages.sh@89 -- # local node 00:02:54.390 20:08:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:54.390 20:08:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:54.390 20:08:26 -- setup/hugepages.sh@92 -- # local surp 00:02:54.390 20:08:26 -- setup/hugepages.sh@93 -- # local resv 00:02:54.390 20:08:26 -- setup/hugepages.sh@94 -- # local anon 00:02:54.390 20:08:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:54.390 20:08:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:54.390 20:08:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:54.390 20:08:26 -- setup/common.sh@18 -- # local node= 00:02:54.390 20:08:26 -- setup/common.sh@19 -- # local var val 00:02:54.390 20:08:26 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.390 20:08:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.390 20:08:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:54.390 20:08:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:54.390 20:08:26 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.390 20:08:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171342788 kB' 'MemAvailable: 174262360 kB' 'Buffers: 3896 kB' 'Cached: 14365756 kB' 'SwapCached: 0 kB' 'Active: 11321532 kB' 'Inactive: 3519248 kB' 'Active(anon): 10904152 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474368 kB' 'Mapped: 162912 kB' 'Shmem: 10433024 kB' 'KReclaimable: 254320 kB' 'Slab: 872024 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617704 kB' 'KernelStack: 20592 kB' 'PageTables: 8652 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12437568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316112 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.390 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.390 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.391 20:08:26 -- setup/common.sh@33 -- # echo 0 00:02:54.391 20:08:26 -- setup/common.sh@33 -- # return 0 00:02:54.391 20:08:26 -- setup/hugepages.sh@97 -- # anon=0 00:02:54.391 20:08:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:54.391 20:08:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:54.391 20:08:26 -- setup/common.sh@18 -- # local node= 00:02:54.391 20:08:26 -- setup/common.sh@19 -- # local var val 00:02:54.391 20:08:26 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.391 20:08:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.391 20:08:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:54.391 20:08:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:54.391 20:08:26 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.391 20:08:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171343844 kB' 'MemAvailable: 174263416 kB' 'Buffers: 3896 kB' 'Cached: 14365760 kB' 'SwapCached: 0 kB' 'Active: 11320900 kB' 'Inactive: 3519248 kB' 'Active(anon): 10903520 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 473876 kB' 'Mapped: 162912 kB' 'Shmem: 10433028 kB' 'KReclaimable: 254320 kB' 'Slab: 871964 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617644 kB' 'KernelStack: 20544 kB' 'PageTables: 8520 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12433628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316080 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.391 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.391 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.392 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.392 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.393 20:08:26 -- setup/common.sh@33 -- # echo 0 00:02:54.393 20:08:26 -- setup/common.sh@33 -- # return 0 00:02:54.393 20:08:26 -- setup/hugepages.sh@99 -- # surp=0 00:02:54.393 20:08:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:54.393 20:08:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:54.393 20:08:26 -- setup/common.sh@18 -- # local node= 00:02:54.393 20:08:26 -- setup/common.sh@19 -- # local var val 00:02:54.393 20:08:26 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.393 20:08:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.393 20:08:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:54.393 20:08:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:54.393 20:08:26 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.393 20:08:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171344100 kB' 'MemAvailable: 174263672 kB' 'Buffers: 3896 kB' 'Cached: 14365768 kB' 'SwapCached: 0 kB' 'Active: 11321184 kB' 'Inactive: 3519248 kB' 'Active(anon): 10903804 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474096 kB' 'Mapped: 162912 kB' 'Shmem: 10433036 kB' 'KReclaimable: 254320 kB' 'Slab: 872036 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617716 kB' 'KernelStack: 20560 kB' 'PageTables: 8572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12433644 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316080 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.393 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.393 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.394 20:08:26 -- setup/common.sh@33 -- # echo 0 00:02:54.394 20:08:26 -- setup/common.sh@33 -- # return 0 00:02:54.394 20:08:26 -- setup/hugepages.sh@100 -- # resv=0 00:02:54.394 20:08:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:54.394 nr_hugepages=1024 00:02:54.394 20:08:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:54.394 resv_hugepages=0 00:02:54.394 20:08:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:54.394 surplus_hugepages=0 00:02:54.394 20:08:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:54.394 anon_hugepages=0 00:02:54.394 20:08:26 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:54.394 20:08:26 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:54.394 20:08:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:54.394 20:08:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:54.394 20:08:26 -- setup/common.sh@18 -- # local node= 00:02:54.394 20:08:26 -- setup/common.sh@19 -- # local var val 00:02:54.394 20:08:26 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.394 20:08:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.394 20:08:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:54.394 20:08:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:54.394 20:08:26 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.394 20:08:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.394 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.394 20:08:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171344100 kB' 'MemAvailable: 174263672 kB' 'Buffers: 3896 kB' 'Cached: 14365768 kB' 'SwapCached: 0 kB' 'Active: 11321212 kB' 'Inactive: 3519248 kB' 'Active(anon): 10903832 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474132 kB' 'Mapped: 162912 kB' 'Shmem: 10433036 kB' 'KReclaimable: 254320 kB' 'Slab: 872036 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617716 kB' 'KernelStack: 20576 kB' 'PageTables: 8628 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12433656 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316080 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:54.394 20:08:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.395 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.395 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.396 20:08:26 -- setup/common.sh@33 -- # echo 1024 00:02:54.396 20:08:26 -- setup/common.sh@33 -- # return 0 00:02:54.396 20:08:26 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:54.396 20:08:26 -- setup/hugepages.sh@112 -- # get_nodes 00:02:54.396 20:08:26 -- setup/hugepages.sh@27 -- # local node 00:02:54.396 20:08:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:54.396 20:08:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:54.396 20:08:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:54.396 20:08:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:54.396 20:08:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:54.396 20:08:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:54.396 20:08:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:54.396 20:08:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:54.396 20:08:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:54.396 20:08:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:54.396 20:08:26 -- setup/common.sh@18 -- # local node=0 00:02:54.396 20:08:26 -- setup/common.sh@19 -- # local var val 00:02:54.396 20:08:26 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.396 20:08:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.396 20:08:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:54.396 20:08:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:54.396 20:08:26 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.396 20:08:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.396 20:08:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 92818912 kB' 'MemUsed: 4796716 kB' 'SwapCached: 0 kB' 'Active: 2044196 kB' 'Inactive: 202016 kB' 'Active(anon): 1882436 kB' 'Inactive(anon): 0 kB' 'Active(file): 161760 kB' 'Inactive(file): 202016 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2062224 kB' 'Mapped: 62408 kB' 'AnonPages: 187132 kB' 'Shmem: 1698448 kB' 'KernelStack: 11304 kB' 'PageTables: 3556 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132620 kB' 'Slab: 413416 kB' 'SReclaimable: 132620 kB' 'SUnreclaim: 280796 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.396 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.396 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.397 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.397 20:08:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@33 -- # echo 0 00:02:54.398 20:08:26 -- setup/common.sh@33 -- # return 0 00:02:54.398 20:08:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:54.398 20:08:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:54.398 20:08:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:54.398 20:08:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:54.398 20:08:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:54.398 20:08:26 -- setup/common.sh@18 -- # local node=1 00:02:54.398 20:08:26 -- setup/common.sh@19 -- # local var val 00:02:54.398 20:08:26 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.398 20:08:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.398 20:08:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:54.398 20:08:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:54.398 20:08:26 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.398 20:08:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93765508 kB' 'MemFree: 78525232 kB' 'MemUsed: 15240276 kB' 'SwapCached: 0 kB' 'Active: 9276944 kB' 'Inactive: 3317232 kB' 'Active(anon): 9021324 kB' 'Inactive(anon): 0 kB' 'Active(file): 255620 kB' 'Inactive(file): 3317232 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 12307480 kB' 'Mapped: 100504 kB' 'AnonPages: 286844 kB' 'Shmem: 8734628 kB' 'KernelStack: 9240 kB' 'PageTables: 4956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 121700 kB' 'Slab: 458620 kB' 'SReclaimable: 121700 kB' 'SUnreclaim: 336920 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.398 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.398 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.399 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.399 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # continue 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.658 20:08:26 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.658 20:08:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.658 20:08:26 -- setup/common.sh@33 -- # echo 0 00:02:54.658 20:08:26 -- setup/common.sh@33 -- # return 0 00:02:54.658 20:08:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:54.658 20:08:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:54.658 20:08:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:54.658 20:08:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:54.658 20:08:26 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:54.658 node0=512 expecting 512 00:02:54.658 20:08:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:54.658 20:08:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:54.658 20:08:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:54.658 20:08:26 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:54.658 node1=512 expecting 512 00:02:54.658 20:08:26 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:54.658 00:02:54.658 real 0m2.906s 00:02:54.658 user 0m1.158s 00:02:54.658 sys 0m1.807s 00:02:54.658 20:08:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:54.659 20:08:26 -- common/autotest_common.sh@10 -- # set +x 00:02:54.659 ************************************ 00:02:54.659 END TEST even_2G_alloc 00:02:54.659 ************************************ 00:02:54.659 20:08:26 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:54.659 20:08:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:54.659 20:08:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:54.659 20:08:26 -- common/autotest_common.sh@10 -- # set +x 00:02:54.659 ************************************ 00:02:54.659 START TEST odd_alloc 00:02:54.659 ************************************ 00:02:54.659 20:08:26 -- common/autotest_common.sh@1104 -- # odd_alloc 00:02:54.659 20:08:26 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:54.659 20:08:26 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:54.659 20:08:26 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:54.659 20:08:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:54.659 20:08:26 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:54.659 20:08:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:54.659 20:08:26 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:54.659 20:08:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:54.659 20:08:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:54.659 20:08:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:54.659 20:08:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:54.659 20:08:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:54.659 20:08:26 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:54.659 20:08:26 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:54.659 20:08:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:54.659 20:08:26 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:54.659 20:08:26 -- setup/hugepages.sh@83 -- # : 513 00:02:54.659 20:08:26 -- setup/hugepages.sh@84 -- # : 1 00:02:54.659 20:08:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:54.659 20:08:26 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:54.659 20:08:26 -- setup/hugepages.sh@83 -- # : 0 00:02:54.659 20:08:26 -- setup/hugepages.sh@84 -- # : 0 00:02:54.659 20:08:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:54.659 20:08:26 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:54.659 20:08:26 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:54.659 20:08:26 -- setup/hugepages.sh@160 -- # setup output 00:02:54.659 20:08:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:54.659 20:08:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:57.197 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:57.197 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:57.197 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:57.197 20:08:28 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:57.197 20:08:28 -- setup/hugepages.sh@89 -- # local node 00:02:57.197 20:08:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:57.197 20:08:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:57.197 20:08:28 -- setup/hugepages.sh@92 -- # local surp 00:02:57.197 20:08:28 -- setup/hugepages.sh@93 -- # local resv 00:02:57.197 20:08:28 -- setup/hugepages.sh@94 -- # local anon 00:02:57.197 20:08:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:57.197 20:08:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:57.197 20:08:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:57.197 20:08:28 -- setup/common.sh@18 -- # local node= 00:02:57.197 20:08:28 -- setup/common.sh@19 -- # local var val 00:02:57.197 20:08:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:57.197 20:08:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:57.197 20:08:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:57.197 20:08:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:57.197 20:08:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:57.197 20:08:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.197 20:08:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171325792 kB' 'MemAvailable: 174245364 kB' 'Buffers: 3896 kB' 'Cached: 14365864 kB' 'SwapCached: 0 kB' 'Active: 11321792 kB' 'Inactive: 3519248 kB' 'Active(anon): 10904412 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 473992 kB' 'Mapped: 162960 kB' 'Shmem: 10433132 kB' 'KReclaimable: 254320 kB' 'Slab: 872716 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 618396 kB' 'KernelStack: 20576 kB' 'PageTables: 8696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103029572 kB' 'Committed_AS: 12444628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316128 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.197 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.197 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.198 20:08:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:57.198 20:08:28 -- setup/common.sh@33 -- # echo 0 00:02:57.198 20:08:28 -- setup/common.sh@33 -- # return 0 00:02:57.198 20:08:28 -- setup/hugepages.sh@97 -- # anon=0 00:02:57.198 20:08:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:57.198 20:08:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:57.198 20:08:28 -- setup/common.sh@18 -- # local node= 00:02:57.198 20:08:28 -- setup/common.sh@19 -- # local var val 00:02:57.198 20:08:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:57.198 20:08:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:57.198 20:08:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:57.198 20:08:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:57.198 20:08:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:57.198 20:08:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.198 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171325220 kB' 'MemAvailable: 174244792 kB' 'Buffers: 3896 kB' 'Cached: 14365868 kB' 'SwapCached: 0 kB' 'Active: 11321824 kB' 'Inactive: 3519248 kB' 'Active(anon): 10904444 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474108 kB' 'Mapped: 162996 kB' 'Shmem: 10433136 kB' 'KReclaimable: 254320 kB' 'Slab: 872884 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 618564 kB' 'KernelStack: 20592 kB' 'PageTables: 8616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103029572 kB' 'Committed_AS: 12433756 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316064 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.199 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.199 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.200 20:08:28 -- setup/common.sh@33 -- # echo 0 00:02:57.200 20:08:28 -- setup/common.sh@33 -- # return 0 00:02:57.200 20:08:28 -- setup/hugepages.sh@99 -- # surp=0 00:02:57.200 20:08:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:57.200 20:08:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:57.200 20:08:28 -- setup/common.sh@18 -- # local node= 00:02:57.200 20:08:28 -- setup/common.sh@19 -- # local var val 00:02:57.200 20:08:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:57.200 20:08:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:57.200 20:08:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:57.200 20:08:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:57.200 20:08:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:57.200 20:08:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:57.200 20:08:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171324968 kB' 'MemAvailable: 174244540 kB' 'Buffers: 3896 kB' 'Cached: 14365884 kB' 'SwapCached: 0 kB' 'Active: 11321344 kB' 'Inactive: 3519248 kB' 'Active(anon): 10903964 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474088 kB' 'Mapped: 162920 kB' 'Shmem: 10433152 kB' 'KReclaimable: 254320 kB' 'Slab: 872884 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 618564 kB' 'KernelStack: 20592 kB' 'PageTables: 8612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103029572 kB' 'Committed_AS: 12433776 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316064 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.200 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.200 20:08:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:57.201 20:08:28 -- setup/common.sh@33 -- # echo 0 00:02:57.201 20:08:28 -- setup/common.sh@33 -- # return 0 00:02:57.201 20:08:28 -- setup/hugepages.sh@100 -- # resv=0 00:02:57.201 20:08:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:57.201 nr_hugepages=1025 00:02:57.201 20:08:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:57.201 resv_hugepages=0 00:02:57.201 20:08:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:57.201 surplus_hugepages=0 00:02:57.201 20:08:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:57.201 anon_hugepages=0 00:02:57.201 20:08:28 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:57.201 20:08:28 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:57.201 20:08:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:57.201 20:08:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:57.201 20:08:28 -- setup/common.sh@18 -- # local node= 00:02:57.201 20:08:28 -- setup/common.sh@19 -- # local var val 00:02:57.201 20:08:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:57.201 20:08:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:57.201 20:08:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:57.201 20:08:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:57.201 20:08:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:57.201 20:08:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.201 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.201 20:08:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171324968 kB' 'MemAvailable: 174244540 kB' 'Buffers: 3896 kB' 'Cached: 14365904 kB' 'SwapCached: 0 kB' 'Active: 11320924 kB' 'Inactive: 3519248 kB' 'Active(anon): 10903544 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 473640 kB' 'Mapped: 162920 kB' 'Shmem: 10433172 kB' 'KReclaimable: 254320 kB' 'Slab: 872884 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 618564 kB' 'KernelStack: 20576 kB' 'PageTables: 8552 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103029572 kB' 'Committed_AS: 12433928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316064 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.201 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.202 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.202 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.203 20:08:28 -- setup/common.sh@33 -- # echo 1025 00:02:57.203 20:08:28 -- setup/common.sh@33 -- # return 0 00:02:57.203 20:08:28 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:57.203 20:08:28 -- setup/hugepages.sh@112 -- # get_nodes 00:02:57.203 20:08:28 -- setup/hugepages.sh@27 -- # local node 00:02:57.203 20:08:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:57.203 20:08:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:57.203 20:08:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:57.203 20:08:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:57.203 20:08:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:57.203 20:08:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:57.203 20:08:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:57.203 20:08:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:57.203 20:08:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:57.203 20:08:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:57.203 20:08:28 -- setup/common.sh@18 -- # local node=0 00:02:57.203 20:08:28 -- setup/common.sh@19 -- # local var val 00:02:57.203 20:08:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:57.203 20:08:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:57.203 20:08:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:57.203 20:08:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:57.203 20:08:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:57.203 20:08:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:57.203 20:08:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 92811164 kB' 'MemUsed: 4804464 kB' 'SwapCached: 0 kB' 'Active: 2044144 kB' 'Inactive: 202016 kB' 'Active(anon): 1882384 kB' 'Inactive(anon): 0 kB' 'Active(file): 161760 kB' 'Inactive(file): 202016 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2062304 kB' 'Mapped: 62408 kB' 'AnonPages: 187064 kB' 'Shmem: 1698528 kB' 'KernelStack: 11272 kB' 'PageTables: 3464 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132620 kB' 'Slab: 413968 kB' 'SReclaimable: 132620 kB' 'SUnreclaim: 281348 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.203 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.203 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@33 -- # echo 0 00:02:57.204 20:08:28 -- setup/common.sh@33 -- # return 0 00:02:57.204 20:08:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:57.204 20:08:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:57.204 20:08:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:57.204 20:08:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:57.204 20:08:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:57.204 20:08:28 -- setup/common.sh@18 -- # local node=1 00:02:57.204 20:08:28 -- setup/common.sh@19 -- # local var val 00:02:57.204 20:08:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:57.204 20:08:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:57.204 20:08:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:57.204 20:08:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:57.204 20:08:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:57.204 20:08:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93765508 kB' 'MemFree: 78514464 kB' 'MemUsed: 15251044 kB' 'SwapCached: 0 kB' 'Active: 9277072 kB' 'Inactive: 3317232 kB' 'Active(anon): 9021452 kB' 'Inactive(anon): 0 kB' 'Active(file): 255620 kB' 'Inactive(file): 3317232 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 12307524 kB' 'Mapped: 100512 kB' 'AnonPages: 286904 kB' 'Shmem: 8734672 kB' 'KernelStack: 9320 kB' 'PageTables: 5132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 121700 kB' 'Slab: 458916 kB' 'SReclaimable: 121700 kB' 'SUnreclaim: 337216 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:28 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.204 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.204 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # continue 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.205 20:08:29 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.205 20:08:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.205 20:08:29 -- setup/common.sh@33 -- # echo 0 00:02:57.205 20:08:29 -- setup/common.sh@33 -- # return 0 00:02:57.205 20:08:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:57.205 20:08:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:57.205 20:08:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:57.205 20:08:29 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:57.205 node0=512 expecting 513 00:02:57.205 20:08:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:57.205 20:08:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:57.205 20:08:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:57.205 20:08:29 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:57.205 node1=513 expecting 512 00:02:57.205 20:08:29 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:57.205 00:02:57.205 real 0m2.655s 00:02:57.205 user 0m1.042s 00:02:57.205 sys 0m1.599s 00:02:57.205 20:08:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:57.205 20:08:29 -- common/autotest_common.sh@10 -- # set +x 00:02:57.205 ************************************ 00:02:57.205 END TEST odd_alloc 00:02:57.205 ************************************ 00:02:57.205 20:08:29 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:57.205 20:08:29 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:57.205 20:08:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:57.205 20:08:29 -- common/autotest_common.sh@10 -- # set +x 00:02:57.205 ************************************ 00:02:57.205 START TEST custom_alloc 00:02:57.205 ************************************ 00:02:57.205 20:08:29 -- common/autotest_common.sh@1104 -- # custom_alloc 00:02:57.205 20:08:29 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:57.205 20:08:29 -- setup/hugepages.sh@169 -- # local node 00:02:57.205 20:08:29 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:57.205 20:08:29 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:57.205 20:08:29 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:57.205 20:08:29 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:57.205 20:08:29 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:57.205 20:08:29 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:57.205 20:08:29 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:57.205 20:08:29 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:57.205 20:08:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:57.205 20:08:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:57.205 20:08:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:57.205 20:08:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:57.205 20:08:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:57.205 20:08:29 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:57.205 20:08:29 -- setup/hugepages.sh@83 -- # : 256 00:02:57.205 20:08:29 -- setup/hugepages.sh@84 -- # : 1 00:02:57.205 20:08:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:57.205 20:08:29 -- setup/hugepages.sh@83 -- # : 0 00:02:57.205 20:08:29 -- setup/hugepages.sh@84 -- # : 0 00:02:57.205 20:08:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:57.205 20:08:29 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:57.205 20:08:29 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:57.205 20:08:29 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:57.205 20:08:29 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:57.205 20:08:29 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:57.205 20:08:29 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:57.205 20:08:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:57.205 20:08:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:57.205 20:08:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:57.206 20:08:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:57.206 20:08:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:57.206 20:08:29 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:57.206 20:08:29 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:57.206 20:08:29 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:57.206 20:08:29 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:57.206 20:08:29 -- setup/hugepages.sh@78 -- # return 0 00:02:57.206 20:08:29 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:57.206 20:08:29 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:57.206 20:08:29 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:57.206 20:08:29 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:57.206 20:08:29 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:57.206 20:08:29 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:57.206 20:08:29 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:57.206 20:08:29 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:57.206 20:08:29 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:57.206 20:08:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:57.206 20:08:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:57.206 20:08:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:57.206 20:08:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:57.206 20:08:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:57.206 20:08:29 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:57.206 20:08:29 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:57.206 20:08:29 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:57.206 20:08:29 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:57.206 20:08:29 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:57.206 20:08:29 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:57.206 20:08:29 -- setup/hugepages.sh@78 -- # return 0 00:02:57.206 20:08:29 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:57.206 20:08:29 -- setup/hugepages.sh@187 -- # setup output 00:02:57.206 20:08:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:57.206 20:08:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:59.743 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:59.743 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:59.743 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:59.743 20:08:31 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:02:59.743 20:08:31 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:02:59.743 20:08:31 -- setup/hugepages.sh@89 -- # local node 00:02:59.743 20:08:31 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:59.743 20:08:31 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:59.743 20:08:31 -- setup/hugepages.sh@92 -- # local surp 00:02:59.743 20:08:31 -- setup/hugepages.sh@93 -- # local resv 00:02:59.743 20:08:31 -- setup/hugepages.sh@94 -- # local anon 00:02:59.743 20:08:31 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:59.743 20:08:31 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:59.743 20:08:31 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:59.743 20:08:31 -- setup/common.sh@18 -- # local node= 00:02:59.743 20:08:31 -- setup/common.sh@19 -- # local var val 00:02:59.743 20:08:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.743 20:08:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.743 20:08:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.743 20:08:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.743 20:08:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.743 20:08:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.743 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.743 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.743 20:08:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 170279140 kB' 'MemAvailable: 173198712 kB' 'Buffers: 3896 kB' 'Cached: 14365992 kB' 'SwapCached: 0 kB' 'Active: 11324808 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907428 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477024 kB' 'Mapped: 162952 kB' 'Shmem: 10433260 kB' 'KReclaimable: 254320 kB' 'Slab: 872236 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617916 kB' 'KernelStack: 20560 kB' 'PageTables: 8420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102506308 kB' 'Committed_AS: 12434788 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316112 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:59.743 20:08:31 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.743 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.743 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.743 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.744 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.744 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.745 20:08:31 -- setup/common.sh@33 -- # echo 0 00:02:59.745 20:08:31 -- setup/common.sh@33 -- # return 0 00:02:59.745 20:08:31 -- setup/hugepages.sh@97 -- # anon=0 00:02:59.745 20:08:31 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:59.745 20:08:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:59.745 20:08:31 -- setup/common.sh@18 -- # local node= 00:02:59.745 20:08:31 -- setup/common.sh@19 -- # local var val 00:02:59.745 20:08:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.745 20:08:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.745 20:08:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.745 20:08:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.745 20:08:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.745 20:08:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 170284828 kB' 'MemAvailable: 173204400 kB' 'Buffers: 3896 kB' 'Cached: 14365996 kB' 'SwapCached: 0 kB' 'Active: 11323876 kB' 'Inactive: 3519248 kB' 'Active(anon): 10906496 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476612 kB' 'Mapped: 162928 kB' 'Shmem: 10433264 kB' 'KReclaimable: 254320 kB' 'Slab: 872244 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617924 kB' 'KernelStack: 20512 kB' 'PageTables: 8396 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102506308 kB' 'Committed_AS: 12434800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316080 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # continue 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.745 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.745 20:08:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.007 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.007 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.008 20:08:31 -- setup/common.sh@33 -- # echo 0 00:03:00.008 20:08:31 -- setup/common.sh@33 -- # return 0 00:03:00.008 20:08:31 -- setup/hugepages.sh@99 -- # surp=0 00:03:00.008 20:08:31 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:00.008 20:08:31 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:00.008 20:08:31 -- setup/common.sh@18 -- # local node= 00:03:00.008 20:08:31 -- setup/common.sh@19 -- # local var val 00:03:00.008 20:08:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.008 20:08:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.008 20:08:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:00.008 20:08:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:00.008 20:08:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.008 20:08:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 170285336 kB' 'MemAvailable: 173204908 kB' 'Buffers: 3896 kB' 'Cached: 14366008 kB' 'SwapCached: 0 kB' 'Active: 11323868 kB' 'Inactive: 3519248 kB' 'Active(anon): 10906488 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476588 kB' 'Mapped: 162928 kB' 'Shmem: 10433276 kB' 'KReclaimable: 254320 kB' 'Slab: 872292 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617972 kB' 'KernelStack: 20512 kB' 'PageTables: 8412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102506308 kB' 'Committed_AS: 12434816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316080 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.008 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.008 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.009 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.009 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.009 20:08:31 -- setup/common.sh@33 -- # echo 0 00:03:00.009 20:08:31 -- setup/common.sh@33 -- # return 0 00:03:00.009 20:08:31 -- setup/hugepages.sh@100 -- # resv=0 00:03:00.009 20:08:31 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:00.009 nr_hugepages=1536 00:03:00.009 20:08:31 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:00.009 resv_hugepages=0 00:03:00.010 20:08:31 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:00.010 surplus_hugepages=0 00:03:00.010 20:08:31 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:00.010 anon_hugepages=0 00:03:00.010 20:08:31 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:00.010 20:08:31 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:00.010 20:08:31 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:00.010 20:08:31 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:00.010 20:08:31 -- setup/common.sh@18 -- # local node= 00:03:00.010 20:08:31 -- setup/common.sh@19 -- # local var val 00:03:00.010 20:08:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.010 20:08:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.010 20:08:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:00.010 20:08:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:00.010 20:08:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.010 20:08:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 170285736 kB' 'MemAvailable: 173205308 kB' 'Buffers: 3896 kB' 'Cached: 14366020 kB' 'SwapCached: 0 kB' 'Active: 11324876 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907496 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477592 kB' 'Mapped: 163432 kB' 'Shmem: 10433288 kB' 'KReclaimable: 254320 kB' 'Slab: 872292 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617972 kB' 'KernelStack: 20512 kB' 'PageTables: 8412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102506308 kB' 'Committed_AS: 12436448 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316064 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.010 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.010 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.011 20:08:31 -- setup/common.sh@33 -- # echo 1536 00:03:00.011 20:08:31 -- setup/common.sh@33 -- # return 0 00:03:00.011 20:08:31 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:00.011 20:08:31 -- setup/hugepages.sh@112 -- # get_nodes 00:03:00.011 20:08:31 -- setup/hugepages.sh@27 -- # local node 00:03:00.011 20:08:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:00.011 20:08:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:00.011 20:08:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:00.011 20:08:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:00.011 20:08:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:00.011 20:08:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:00.011 20:08:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:00.011 20:08:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:00.011 20:08:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:00.011 20:08:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:00.011 20:08:31 -- setup/common.sh@18 -- # local node=0 00:03:00.011 20:08:31 -- setup/common.sh@19 -- # local var val 00:03:00.011 20:08:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.011 20:08:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.011 20:08:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:00.011 20:08:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:00.011 20:08:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.011 20:08:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.011 20:08:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 92809824 kB' 'MemUsed: 4805804 kB' 'SwapCached: 0 kB' 'Active: 2051940 kB' 'Inactive: 202016 kB' 'Active(anon): 1890180 kB' 'Inactive(anon): 0 kB' 'Active(file): 161760 kB' 'Inactive(file): 202016 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2062404 kB' 'Mapped: 62560 kB' 'AnonPages: 194864 kB' 'Shmem: 1698628 kB' 'KernelStack: 11304 kB' 'PageTables: 3592 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132620 kB' 'Slab: 413260 kB' 'SReclaimable: 132620 kB' 'SUnreclaim: 280640 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.011 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.011 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@33 -- # echo 0 00:03:00.012 20:08:31 -- setup/common.sh@33 -- # return 0 00:03:00.012 20:08:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:00.012 20:08:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:00.012 20:08:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:00.012 20:08:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:00.012 20:08:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:00.012 20:08:31 -- setup/common.sh@18 -- # local node=1 00:03:00.012 20:08:31 -- setup/common.sh@19 -- # local var val 00:03:00.012 20:08:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.012 20:08:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.012 20:08:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:00.012 20:08:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:00.012 20:08:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.012 20:08:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.012 20:08:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93765508 kB' 'MemFree: 77473392 kB' 'MemUsed: 16292116 kB' 'SwapCached: 0 kB' 'Active: 9277548 kB' 'Inactive: 3317232 kB' 'Active(anon): 9021928 kB' 'Inactive(anon): 0 kB' 'Active(file): 255620 kB' 'Inactive(file): 3317232 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 12307528 kB' 'Mapped: 100648 kB' 'AnonPages: 287352 kB' 'Shmem: 8734676 kB' 'KernelStack: 9208 kB' 'PageTables: 4844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 121700 kB' 'Slab: 459032 kB' 'SReclaimable: 121700 kB' 'SUnreclaim: 337332 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.012 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.012 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # continue 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.013 20:08:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.013 20:08:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.013 20:08:31 -- setup/common.sh@33 -- # echo 0 00:03:00.013 20:08:31 -- setup/common.sh@33 -- # return 0 00:03:00.013 20:08:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:00.013 20:08:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:00.013 20:08:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:00.013 20:08:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:00.013 20:08:31 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:00.013 node0=512 expecting 512 00:03:00.013 20:08:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:00.013 20:08:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:00.013 20:08:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:00.013 20:08:31 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:00.013 node1=1024 expecting 1024 00:03:00.013 20:08:31 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:00.013 00:03:00.013 real 0m2.771s 00:03:00.013 user 0m1.120s 00:03:00.013 sys 0m1.705s 00:03:00.013 20:08:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:00.013 20:08:31 -- common/autotest_common.sh@10 -- # set +x 00:03:00.014 ************************************ 00:03:00.014 END TEST custom_alloc 00:03:00.014 ************************************ 00:03:00.014 20:08:31 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:00.014 20:08:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:00.014 20:08:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:00.014 20:08:31 -- common/autotest_common.sh@10 -- # set +x 00:03:00.014 ************************************ 00:03:00.014 START TEST no_shrink_alloc 00:03:00.014 ************************************ 00:03:00.014 20:08:31 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:03:00.014 20:08:31 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:00.014 20:08:31 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:00.014 20:08:31 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:00.014 20:08:31 -- setup/hugepages.sh@51 -- # shift 00:03:00.014 20:08:31 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:00.014 20:08:31 -- setup/hugepages.sh@52 -- # local node_ids 00:03:00.014 20:08:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:00.014 20:08:31 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:00.014 20:08:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:00.014 20:08:31 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:00.014 20:08:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:00.014 20:08:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:00.014 20:08:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:00.014 20:08:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:00.014 20:08:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:00.014 20:08:31 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:00.014 20:08:31 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:00.014 20:08:31 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:00.014 20:08:31 -- setup/hugepages.sh@73 -- # return 0 00:03:00.014 20:08:31 -- setup/hugepages.sh@198 -- # setup output 00:03:00.014 20:08:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:00.014 20:08:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:02.550 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:02.550 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:02.550 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:02.812 20:08:34 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:02.812 20:08:34 -- setup/hugepages.sh@89 -- # local node 00:03:02.812 20:08:34 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:02.812 20:08:34 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:02.812 20:08:34 -- setup/hugepages.sh@92 -- # local surp 00:03:02.812 20:08:34 -- setup/hugepages.sh@93 -- # local resv 00:03:02.812 20:08:34 -- setup/hugepages.sh@94 -- # local anon 00:03:02.812 20:08:34 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:02.812 20:08:34 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:02.812 20:08:34 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:02.812 20:08:34 -- setup/common.sh@18 -- # local node= 00:03:02.812 20:08:34 -- setup/common.sh@19 -- # local var val 00:03:02.812 20:08:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.812 20:08:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.812 20:08:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:02.812 20:08:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:02.812 20:08:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.812 20:08:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.812 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.812 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171321704 kB' 'MemAvailable: 174241276 kB' 'Buffers: 3896 kB' 'Cached: 14366108 kB' 'SwapCached: 0 kB' 'Active: 11323952 kB' 'Inactive: 3519248 kB' 'Active(anon): 10906572 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476456 kB' 'Mapped: 162964 kB' 'Shmem: 10433376 kB' 'KReclaimable: 254320 kB' 'Slab: 872144 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617824 kB' 'KernelStack: 20432 kB' 'PageTables: 8240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12435224 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316096 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.813 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.813 20:08:34 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.814 20:08:34 -- setup/common.sh@33 -- # echo 0 00:03:02.814 20:08:34 -- setup/common.sh@33 -- # return 0 00:03:02.814 20:08:34 -- setup/hugepages.sh@97 -- # anon=0 00:03:02.814 20:08:34 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:02.814 20:08:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:02.814 20:08:34 -- setup/common.sh@18 -- # local node= 00:03:02.814 20:08:34 -- setup/common.sh@19 -- # local var val 00:03:02.814 20:08:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.814 20:08:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.814 20:08:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:02.814 20:08:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:02.814 20:08:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.814 20:08:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171321956 kB' 'MemAvailable: 174241528 kB' 'Buffers: 3896 kB' 'Cached: 14366116 kB' 'SwapCached: 0 kB' 'Active: 11324308 kB' 'Inactive: 3519248 kB' 'Active(anon): 10906928 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476856 kB' 'Mapped: 162964 kB' 'Shmem: 10433384 kB' 'KReclaimable: 254320 kB' 'Slab: 872172 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617852 kB' 'KernelStack: 20464 kB' 'PageTables: 8236 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12435368 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316048 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.814 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.814 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.815 20:08:34 -- setup/common.sh@33 -- # echo 0 00:03:02.815 20:08:34 -- setup/common.sh@33 -- # return 0 00:03:02.815 20:08:34 -- setup/hugepages.sh@99 -- # surp=0 00:03:02.815 20:08:34 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:02.815 20:08:34 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:02.815 20:08:34 -- setup/common.sh@18 -- # local node= 00:03:02.815 20:08:34 -- setup/common.sh@19 -- # local var val 00:03:02.815 20:08:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.815 20:08:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.815 20:08:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:02.815 20:08:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:02.815 20:08:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.815 20:08:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171322308 kB' 'MemAvailable: 174241880 kB' 'Buffers: 3896 kB' 'Cached: 14366132 kB' 'SwapCached: 0 kB' 'Active: 11324868 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907488 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477416 kB' 'Mapped: 162964 kB' 'Shmem: 10433400 kB' 'KReclaimable: 254320 kB' 'Slab: 872172 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617852 kB' 'KernelStack: 20512 kB' 'PageTables: 8448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12435756 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316064 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.815 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.815 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.816 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.816 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.816 20:08:34 -- setup/common.sh@33 -- # echo 0 00:03:02.816 20:08:34 -- setup/common.sh@33 -- # return 0 00:03:02.817 20:08:34 -- setup/hugepages.sh@100 -- # resv=0 00:03:02.817 20:08:34 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:02.817 nr_hugepages=1024 00:03:02.817 20:08:34 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:02.817 resv_hugepages=0 00:03:02.817 20:08:34 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:02.817 surplus_hugepages=0 00:03:02.817 20:08:34 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:02.817 anon_hugepages=0 00:03:02.817 20:08:34 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:02.817 20:08:34 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:02.817 20:08:34 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:02.817 20:08:34 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:02.817 20:08:34 -- setup/common.sh@18 -- # local node= 00:03:02.817 20:08:34 -- setup/common.sh@19 -- # local var val 00:03:02.817 20:08:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.817 20:08:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.817 20:08:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:02.817 20:08:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:02.817 20:08:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.817 20:08:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171326696 kB' 'MemAvailable: 174246268 kB' 'Buffers: 3896 kB' 'Cached: 14366144 kB' 'SwapCached: 0 kB' 'Active: 11324568 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907188 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477108 kB' 'Mapped: 162964 kB' 'Shmem: 10433412 kB' 'KReclaimable: 254320 kB' 'Slab: 872172 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 617852 kB' 'KernelStack: 20512 kB' 'PageTables: 8416 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12435772 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316064 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.817 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.817 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.818 20:08:34 -- setup/common.sh@33 -- # echo 1024 00:03:02.818 20:08:34 -- setup/common.sh@33 -- # return 0 00:03:02.818 20:08:34 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:02.818 20:08:34 -- setup/hugepages.sh@112 -- # get_nodes 00:03:02.818 20:08:34 -- setup/hugepages.sh@27 -- # local node 00:03:02.818 20:08:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:02.818 20:08:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:02.818 20:08:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:02.818 20:08:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:02.818 20:08:34 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:02.818 20:08:34 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:02.818 20:08:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:02.818 20:08:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:02.818 20:08:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:02.818 20:08:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:02.818 20:08:34 -- setup/common.sh@18 -- # local node=0 00:03:02.818 20:08:34 -- setup/common.sh@19 -- # local var val 00:03:02.818 20:08:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.818 20:08:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.818 20:08:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:02.818 20:08:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:02.818 20:08:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.818 20:08:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 91760152 kB' 'MemUsed: 5855476 kB' 'SwapCached: 0 kB' 'Active: 2045884 kB' 'Inactive: 202016 kB' 'Active(anon): 1884124 kB' 'Inactive(anon): 0 kB' 'Active(file): 161760 kB' 'Inactive(file): 202016 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2062512 kB' 'Mapped: 62408 kB' 'AnonPages: 188544 kB' 'Shmem: 1698736 kB' 'KernelStack: 11272 kB' 'PageTables: 3412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132620 kB' 'Slab: 413336 kB' 'SReclaimable: 132620 kB' 'SUnreclaim: 280716 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.818 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.818 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # continue 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.819 20:08:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.819 20:08:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.819 20:08:34 -- setup/common.sh@33 -- # echo 0 00:03:02.819 20:08:34 -- setup/common.sh@33 -- # return 0 00:03:02.819 20:08:34 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:02.819 20:08:34 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:02.819 20:08:34 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:02.819 20:08:34 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:02.819 20:08:34 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:02.819 node0=1024 expecting 1024 00:03:02.819 20:08:34 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:02.819 20:08:34 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:02.819 20:08:34 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:02.819 20:08:34 -- setup/hugepages.sh@202 -- # setup output 00:03:02.819 20:08:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:02.819 20:08:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:05.354 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:05.354 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:05.354 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:05.354 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:05.354 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:05.354 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:05.354 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:05.354 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:05.354 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:05.354 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:05.616 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:05.616 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:05.616 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:05.616 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:05.616 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:05.616 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:05.616 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:05.616 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:05.616 20:08:37 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:05.616 20:08:37 -- setup/hugepages.sh@89 -- # local node 00:03:05.616 20:08:37 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:05.616 20:08:37 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:05.616 20:08:37 -- setup/hugepages.sh@92 -- # local surp 00:03:05.616 20:08:37 -- setup/hugepages.sh@93 -- # local resv 00:03:05.616 20:08:37 -- setup/hugepages.sh@94 -- # local anon 00:03:05.616 20:08:37 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:05.616 20:08:37 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:05.616 20:08:37 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:05.616 20:08:37 -- setup/common.sh@18 -- # local node= 00:03:05.616 20:08:37 -- setup/common.sh@19 -- # local var val 00:03:05.616 20:08:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.617 20:08:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.617 20:08:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.617 20:08:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.617 20:08:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.617 20:08:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171332284 kB' 'MemAvailable: 174251856 kB' 'Buffers: 3896 kB' 'Cached: 14366216 kB' 'SwapCached: 0 kB' 'Active: 11325752 kB' 'Inactive: 3519248 kB' 'Active(anon): 10908372 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478276 kB' 'Mapped: 162932 kB' 'Shmem: 10433484 kB' 'KReclaimable: 254320 kB' 'Slab: 872712 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 618392 kB' 'KernelStack: 20688 kB' 'PageTables: 8908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12438600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316144 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.617 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.617 20:08:37 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.618 20:08:37 -- setup/common.sh@33 -- # echo 0 00:03:05.618 20:08:37 -- setup/common.sh@33 -- # return 0 00:03:05.618 20:08:37 -- setup/hugepages.sh@97 -- # anon=0 00:03:05.618 20:08:37 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:05.618 20:08:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:05.618 20:08:37 -- setup/common.sh@18 -- # local node= 00:03:05.618 20:08:37 -- setup/common.sh@19 -- # local var val 00:03:05.618 20:08:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.618 20:08:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.618 20:08:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.618 20:08:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.618 20:08:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.618 20:08:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171335452 kB' 'MemAvailable: 174255024 kB' 'Buffers: 3896 kB' 'Cached: 14366220 kB' 'SwapCached: 0 kB' 'Active: 11324984 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907604 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477464 kB' 'Mapped: 162944 kB' 'Shmem: 10433488 kB' 'KReclaimable: 254320 kB' 'Slab: 872700 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 618380 kB' 'KernelStack: 20496 kB' 'PageTables: 8352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12436212 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316112 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.618 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.618 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.619 20:08:37 -- setup/common.sh@33 -- # echo 0 00:03:05.619 20:08:37 -- setup/common.sh@33 -- # return 0 00:03:05.619 20:08:37 -- setup/hugepages.sh@99 -- # surp=0 00:03:05.619 20:08:37 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:05.619 20:08:37 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:05.619 20:08:37 -- setup/common.sh@18 -- # local node= 00:03:05.619 20:08:37 -- setup/common.sh@19 -- # local var val 00:03:05.619 20:08:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.619 20:08:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.619 20:08:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.619 20:08:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.619 20:08:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.619 20:08:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171337888 kB' 'MemAvailable: 174257460 kB' 'Buffers: 3896 kB' 'Cached: 14366232 kB' 'SwapCached: 0 kB' 'Active: 11324904 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907524 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477340 kB' 'Mapped: 162944 kB' 'Shmem: 10433500 kB' 'KReclaimable: 254320 kB' 'Slab: 872724 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 618404 kB' 'KernelStack: 20512 kB' 'PageTables: 8404 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12436228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316096 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.619 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.619 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.620 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.620 20:08:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.621 20:08:37 -- setup/common.sh@33 -- # echo 0 00:03:05.621 20:08:37 -- setup/common.sh@33 -- # return 0 00:03:05.621 20:08:37 -- setup/hugepages.sh@100 -- # resv=0 00:03:05.621 20:08:37 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:05.621 nr_hugepages=1024 00:03:05.621 20:08:37 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:05.621 resv_hugepages=0 00:03:05.621 20:08:37 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:05.621 surplus_hugepages=0 00:03:05.621 20:08:37 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:05.621 anon_hugepages=0 00:03:05.621 20:08:37 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:05.621 20:08:37 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:05.621 20:08:37 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:05.621 20:08:37 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:05.621 20:08:37 -- setup/common.sh@18 -- # local node= 00:03:05.621 20:08:37 -- setup/common.sh@19 -- # local var val 00:03:05.621 20:08:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.621 20:08:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.621 20:08:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.621 20:08:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.621 20:08:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.621 20:08:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381136 kB' 'MemFree: 171338436 kB' 'MemAvailable: 174258008 kB' 'Buffers: 3896 kB' 'Cached: 14366244 kB' 'SwapCached: 0 kB' 'Active: 11324768 kB' 'Inactive: 3519248 kB' 'Active(anon): 10907388 kB' 'Inactive(anon): 0 kB' 'Active(file): 417380 kB' 'Inactive(file): 3519248 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477188 kB' 'Mapped: 162944 kB' 'Shmem: 10433512 kB' 'KReclaimable: 254320 kB' 'Slab: 872724 kB' 'SReclaimable: 254320 kB' 'SUnreclaim: 618404 kB' 'KernelStack: 20496 kB' 'PageTables: 8344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030596 kB' 'Committed_AS: 12436244 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316096 kB' 'VmallocChunk: 0 kB' 'Percpu: 92160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3326932 kB' 'DirectMap2M: 23615488 kB' 'DirectMap1G: 175112192 kB' 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.621 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.621 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.622 20:08:37 -- setup/common.sh@33 -- # echo 1024 00:03:05.622 20:08:37 -- setup/common.sh@33 -- # return 0 00:03:05.622 20:08:37 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:05.622 20:08:37 -- setup/hugepages.sh@112 -- # get_nodes 00:03:05.622 20:08:37 -- setup/hugepages.sh@27 -- # local node 00:03:05.622 20:08:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:05.622 20:08:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:05.622 20:08:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:05.622 20:08:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:05.622 20:08:37 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:05.622 20:08:37 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:05.622 20:08:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:05.622 20:08:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:05.622 20:08:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:05.622 20:08:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:05.622 20:08:37 -- setup/common.sh@18 -- # local node=0 00:03:05.622 20:08:37 -- setup/common.sh@19 -- # local var val 00:03:05.622 20:08:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.622 20:08:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.622 20:08:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:05.622 20:08:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:05.622 20:08:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.622 20:08:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 91741952 kB' 'MemUsed: 5873676 kB' 'SwapCached: 0 kB' 'Active: 2046652 kB' 'Inactive: 202016 kB' 'Active(anon): 1884892 kB' 'Inactive(anon): 0 kB' 'Active(file): 161760 kB' 'Inactive(file): 202016 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2062564 kB' 'Mapped: 62408 kB' 'AnonPages: 189252 kB' 'Shmem: 1698788 kB' 'KernelStack: 11288 kB' 'PageTables: 3516 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132620 kB' 'Slab: 413644 kB' 'SReclaimable: 132620 kB' 'SUnreclaim: 281024 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.622 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.622 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # continue 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.623 20:08:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.623 20:08:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.623 20:08:37 -- setup/common.sh@33 -- # echo 0 00:03:05.623 20:08:37 -- setup/common.sh@33 -- # return 0 00:03:05.623 20:08:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:05.623 20:08:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:05.623 20:08:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:05.623 20:08:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:05.623 20:08:37 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:05.623 node0=1024 expecting 1024 00:03:05.623 20:08:37 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:05.623 00:03:05.623 real 0m5.670s 00:03:05.623 user 0m2.291s 00:03:05.623 sys 0m3.519s 00:03:05.623 20:08:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:05.623 20:08:37 -- common/autotest_common.sh@10 -- # set +x 00:03:05.623 ************************************ 00:03:05.623 END TEST no_shrink_alloc 00:03:05.623 ************************************ 00:03:05.883 20:08:37 -- setup/hugepages.sh@217 -- # clear_hp 00:03:05.883 20:08:37 -- setup/hugepages.sh@37 -- # local node hp 00:03:05.883 20:08:37 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:05.883 20:08:37 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:05.883 20:08:37 -- setup/hugepages.sh@41 -- # echo 0 00:03:05.883 20:08:37 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:05.883 20:08:37 -- setup/hugepages.sh@41 -- # echo 0 00:03:05.883 20:08:37 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:05.883 20:08:37 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:05.883 20:08:37 -- setup/hugepages.sh@41 -- # echo 0 00:03:05.883 20:08:37 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:05.883 20:08:37 -- setup/hugepages.sh@41 -- # echo 0 00:03:05.883 20:08:37 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:05.883 20:08:37 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:05.883 00:03:05.883 real 0m21.167s 00:03:05.883 user 0m8.160s 00:03:05.883 sys 0m12.551s 00:03:05.883 20:08:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:05.883 20:08:37 -- common/autotest_common.sh@10 -- # set +x 00:03:05.883 ************************************ 00:03:05.883 END TEST hugepages 00:03:05.883 ************************************ 00:03:05.883 20:08:37 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:05.883 20:08:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:05.883 20:08:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:05.883 20:08:37 -- common/autotest_common.sh@10 -- # set +x 00:03:05.883 ************************************ 00:03:05.883 START TEST driver 00:03:05.883 ************************************ 00:03:05.883 20:08:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:05.883 * Looking for test storage... 00:03:05.883 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:05.883 20:08:37 -- setup/driver.sh@68 -- # setup reset 00:03:05.883 20:08:37 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:05.883 20:08:37 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:10.134 20:08:41 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:10.134 20:08:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:10.134 20:08:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:10.134 20:08:41 -- common/autotest_common.sh@10 -- # set +x 00:03:10.134 ************************************ 00:03:10.134 START TEST guess_driver 00:03:10.134 ************************************ 00:03:10.134 20:08:41 -- common/autotest_common.sh@1104 -- # guess_driver 00:03:10.134 20:08:41 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:10.134 20:08:41 -- setup/driver.sh@47 -- # local fail=0 00:03:10.134 20:08:41 -- setup/driver.sh@49 -- # pick_driver 00:03:10.134 20:08:41 -- setup/driver.sh@36 -- # vfio 00:03:10.134 20:08:41 -- setup/driver.sh@21 -- # local iommu_grups 00:03:10.134 20:08:41 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:10.134 20:08:41 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:10.134 20:08:41 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:10.134 20:08:41 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:10.134 20:08:41 -- setup/driver.sh@29 -- # (( 174 > 0 )) 00:03:10.134 20:08:41 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:10.134 20:08:41 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:10.134 20:08:41 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:10.134 20:08:41 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:10.134 20:08:41 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:10.134 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:10.134 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:10.134 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:10.134 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:10.134 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:10.134 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:10.134 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:10.134 20:08:41 -- setup/driver.sh@30 -- # return 0 00:03:10.134 20:08:41 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:10.134 20:08:41 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:10.134 20:08:41 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:10.134 20:08:41 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:10.134 Looking for driver=vfio-pci 00:03:10.134 20:08:41 -- setup/driver.sh@45 -- # setup output config 00:03:10.134 20:08:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:10.134 20:08:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.134 20:08:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:12.041 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.041 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.041 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.041 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.041 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.041 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.041 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.041 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.041 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.041 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.041 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.041 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.301 20:08:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.301 20:08:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.301 20:08:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:13.313 20:08:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:13.313 20:08:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:13.313 20:08:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:13.313 20:08:45 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:13.313 20:08:45 -- setup/driver.sh@65 -- # setup reset 00:03:13.313 20:08:45 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:13.313 20:08:45 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:17.509 00:03:17.509 real 0m7.145s 00:03:17.509 user 0m1.875s 00:03:17.509 sys 0m3.533s 00:03:17.509 20:08:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:17.509 20:08:48 -- common/autotest_common.sh@10 -- # set +x 00:03:17.509 ************************************ 00:03:17.509 END TEST guess_driver 00:03:17.509 ************************************ 00:03:17.509 00:03:17.509 real 0m11.197s 00:03:17.509 user 0m3.068s 00:03:17.509 sys 0m5.698s 00:03:17.509 20:08:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:17.509 20:08:48 -- common/autotest_common.sh@10 -- # set +x 00:03:17.509 ************************************ 00:03:17.509 END TEST driver 00:03:17.509 ************************************ 00:03:17.509 20:08:48 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:17.509 20:08:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:17.509 20:08:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:17.509 20:08:48 -- common/autotest_common.sh@10 -- # set +x 00:03:17.509 ************************************ 00:03:17.509 START TEST devices 00:03:17.509 ************************************ 00:03:17.509 20:08:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:17.509 * Looking for test storage... 00:03:17.509 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:17.509 20:08:48 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:17.509 20:08:48 -- setup/devices.sh@192 -- # setup reset 00:03:17.509 20:08:48 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:17.509 20:08:48 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:20.045 20:08:51 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:20.045 20:08:51 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:20.045 20:08:51 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:20.045 20:08:51 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:20.045 20:08:51 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:20.045 20:08:51 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:20.045 20:08:51 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:20.045 20:08:51 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:20.045 20:08:51 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:20.045 20:08:51 -- setup/devices.sh@196 -- # blocks=() 00:03:20.045 20:08:51 -- setup/devices.sh@196 -- # declare -a blocks 00:03:20.045 20:08:51 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:20.045 20:08:51 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:20.045 20:08:51 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:20.045 20:08:51 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:20.045 20:08:51 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:20.045 20:08:51 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:20.045 20:08:51 -- setup/devices.sh@202 -- # pci=0000:5e:00.0 00:03:20.045 20:08:51 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:03:20.045 20:08:51 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:20.045 20:08:51 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:20.045 20:08:51 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:20.045 No valid GPT data, bailing 00:03:20.045 20:08:51 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:20.045 20:08:51 -- scripts/common.sh@393 -- # pt= 00:03:20.045 20:08:51 -- scripts/common.sh@394 -- # return 1 00:03:20.045 20:08:51 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:20.045 20:08:51 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:20.045 20:08:51 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:20.046 20:08:51 -- setup/common.sh@80 -- # echo 1000204886016 00:03:20.046 20:08:51 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:20.046 20:08:51 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:20.046 20:08:51 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5e:00.0 00:03:20.046 20:08:51 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:20.046 20:08:51 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:20.046 20:08:51 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:20.046 20:08:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:20.046 20:08:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:20.046 20:08:51 -- common/autotest_common.sh@10 -- # set +x 00:03:20.046 ************************************ 00:03:20.046 START TEST nvme_mount 00:03:20.046 ************************************ 00:03:20.046 20:08:51 -- common/autotest_common.sh@1104 -- # nvme_mount 00:03:20.046 20:08:51 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:20.046 20:08:51 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:20.046 20:08:51 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:20.046 20:08:51 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:20.046 20:08:51 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:20.046 20:08:51 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:20.046 20:08:51 -- setup/common.sh@40 -- # local part_no=1 00:03:20.046 20:08:51 -- setup/common.sh@41 -- # local size=1073741824 00:03:20.046 20:08:51 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:20.046 20:08:51 -- setup/common.sh@44 -- # parts=() 00:03:20.046 20:08:51 -- setup/common.sh@44 -- # local parts 00:03:20.046 20:08:51 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:20.046 20:08:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:20.046 20:08:51 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:20.046 20:08:51 -- setup/common.sh@46 -- # (( part++ )) 00:03:20.046 20:08:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:20.046 20:08:51 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:20.046 20:08:51 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:20.046 20:08:51 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:20.982 Creating new GPT entries in memory. 00:03:20.982 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:20.982 other utilities. 00:03:20.982 20:08:52 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:20.982 20:08:52 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:20.982 20:08:52 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:20.982 20:08:52 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:20.982 20:08:52 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:22.360 Creating new GPT entries in memory. 00:03:22.360 The operation has completed successfully. 00:03:22.360 20:08:53 -- setup/common.sh@57 -- # (( part++ )) 00:03:22.360 20:08:53 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:22.360 20:08:53 -- setup/common.sh@62 -- # wait 3208902 00:03:22.360 20:08:53 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:22.360 20:08:53 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:22.360 20:08:53 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:22.360 20:08:53 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:22.360 20:08:53 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:22.360 20:08:53 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:22.360 20:08:54 -- setup/devices.sh@105 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:22.360 20:08:54 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:22.360 20:08:54 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:22.360 20:08:54 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:22.360 20:08:54 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:22.360 20:08:54 -- setup/devices.sh@53 -- # local found=0 00:03:22.360 20:08:54 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:22.360 20:08:54 -- setup/devices.sh@56 -- # : 00:03:22.360 20:08:54 -- setup/devices.sh@59 -- # local pci status 00:03:22.360 20:08:54 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:22.360 20:08:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.360 20:08:54 -- setup/devices.sh@47 -- # setup output config 00:03:22.360 20:08:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.360 20:08:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:24.892 20:08:56 -- setup/devices.sh@63 -- # found=1 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:24.892 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:24.892 20:08:56 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:24.892 20:08:56 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:24.892 20:08:56 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:24.892 20:08:56 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:24.892 20:08:56 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:24.893 20:08:56 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:24.893 20:08:56 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:24.893 20:08:56 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:24.893 20:08:56 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:24.893 20:08:56 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:24.893 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:24.893 20:08:56 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:24.893 20:08:56 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:24.893 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:24.893 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:24.893 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:24.893 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:24.893 20:08:56 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:24.893 20:08:56 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:24.893 20:08:56 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:24.893 20:08:56 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:24.893 20:08:56 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:25.152 20:08:56 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:25.152 20:08:56 -- setup/devices.sh@116 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:25.152 20:08:56 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:25.152 20:08:56 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:25.152 20:08:56 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:25.152 20:08:56 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:25.152 20:08:56 -- setup/devices.sh@53 -- # local found=0 00:03:25.152 20:08:56 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:25.152 20:08:56 -- setup/devices.sh@56 -- # : 00:03:25.152 20:08:56 -- setup/devices.sh@59 -- # local pci status 00:03:25.152 20:08:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:25.152 20:08:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:25.152 20:08:56 -- setup/devices.sh@47 -- # setup output config 00:03:25.152 20:08:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.152 20:08:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:27.081 20:08:58 -- setup/devices.sh@63 -- # found=1 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.081 20:08:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:27.081 20:08:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.340 20:08:59 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:27.340 20:08:59 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:27.340 20:08:59 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:27.340 20:08:59 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:27.340 20:08:59 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:27.340 20:08:59 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:27.340 20:08:59 -- setup/devices.sh@125 -- # verify 0000:5e:00.0 data@nvme0n1 '' '' 00:03:27.340 20:08:59 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:27.340 20:08:59 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:27.340 20:08:59 -- setup/devices.sh@50 -- # local mount_point= 00:03:27.340 20:08:59 -- setup/devices.sh@51 -- # local test_file= 00:03:27.340 20:08:59 -- setup/devices.sh@53 -- # local found=0 00:03:27.340 20:08:59 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:27.340 20:08:59 -- setup/devices.sh@59 -- # local pci status 00:03:27.340 20:08:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:27.340 20:08:59 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:27.340 20:08:59 -- setup/devices.sh@47 -- # setup output config 00:03:27.340 20:08:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:27.340 20:08:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:29.873 20:09:01 -- setup/devices.sh@63 -- # found=1 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.873 20:09:01 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:29.873 20:09:01 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:29.873 20:09:01 -- setup/devices.sh@68 -- # return 0 00:03:29.873 20:09:01 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:29.873 20:09:01 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.873 20:09:01 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:29.873 20:09:01 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:29.873 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:29.873 00:03:29.873 real 0m9.901s 00:03:29.873 user 0m2.640s 00:03:29.873 sys 0m4.806s 00:03:29.873 20:09:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:29.873 20:09:01 -- common/autotest_common.sh@10 -- # set +x 00:03:29.873 ************************************ 00:03:29.873 END TEST nvme_mount 00:03:29.873 ************************************ 00:03:30.133 20:09:01 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:30.133 20:09:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:30.133 20:09:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:30.133 20:09:01 -- common/autotest_common.sh@10 -- # set +x 00:03:30.133 ************************************ 00:03:30.133 START TEST dm_mount 00:03:30.133 ************************************ 00:03:30.133 20:09:01 -- common/autotest_common.sh@1104 -- # dm_mount 00:03:30.133 20:09:01 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:30.133 20:09:01 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:30.133 20:09:01 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:30.133 20:09:01 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:30.133 20:09:01 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:30.133 20:09:01 -- setup/common.sh@40 -- # local part_no=2 00:03:30.133 20:09:01 -- setup/common.sh@41 -- # local size=1073741824 00:03:30.133 20:09:01 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:30.133 20:09:01 -- setup/common.sh@44 -- # parts=() 00:03:30.133 20:09:01 -- setup/common.sh@44 -- # local parts 00:03:30.133 20:09:01 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:30.133 20:09:01 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:30.133 20:09:01 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:30.133 20:09:01 -- setup/common.sh@46 -- # (( part++ )) 00:03:30.133 20:09:01 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:30.133 20:09:01 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:30.133 20:09:01 -- setup/common.sh@46 -- # (( part++ )) 00:03:30.133 20:09:01 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:30.133 20:09:01 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:30.133 20:09:01 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:30.133 20:09:01 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:31.070 Creating new GPT entries in memory. 00:03:31.070 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:31.070 other utilities. 00:03:31.070 20:09:02 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:31.070 20:09:02 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:31.070 20:09:02 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:31.070 20:09:02 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:31.070 20:09:02 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:32.007 Creating new GPT entries in memory. 00:03:32.007 The operation has completed successfully. 00:03:32.007 20:09:03 -- setup/common.sh@57 -- # (( part++ )) 00:03:32.007 20:09:03 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:32.007 20:09:03 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:32.007 20:09:03 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:32.007 20:09:03 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:32.943 The operation has completed successfully. 00:03:32.943 20:09:04 -- setup/common.sh@57 -- # (( part++ )) 00:03:32.943 20:09:04 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:32.943 20:09:04 -- setup/common.sh@62 -- # wait 3213137 00:03:33.203 20:09:04 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:33.203 20:09:04 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:33.203 20:09:04 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:33.203 20:09:04 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:33.203 20:09:04 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:33.203 20:09:04 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:33.203 20:09:04 -- setup/devices.sh@161 -- # break 00:03:33.203 20:09:04 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:33.203 20:09:04 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:33.203 20:09:04 -- setup/devices.sh@165 -- # dm=/dev/dm-2 00:03:33.203 20:09:04 -- setup/devices.sh@166 -- # dm=dm-2 00:03:33.203 20:09:04 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-2 ]] 00:03:33.203 20:09:04 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-2 ]] 00:03:33.203 20:09:04 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:33.203 20:09:04 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:33.203 20:09:04 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:33.203 20:09:04 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:33.203 20:09:04 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:33.203 20:09:04 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:33.203 20:09:04 -- setup/devices.sh@174 -- # verify 0000:5e:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:33.203 20:09:04 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:33.203 20:09:04 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:33.203 20:09:04 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:33.203 20:09:04 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:33.203 20:09:04 -- setup/devices.sh@53 -- # local found=0 00:03:33.203 20:09:04 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:33.203 20:09:04 -- setup/devices.sh@56 -- # : 00:03:33.203 20:09:04 -- setup/devices.sh@59 -- # local pci status 00:03:33.203 20:09:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.203 20:09:04 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:33.203 20:09:04 -- setup/devices.sh@47 -- # setup output config 00:03:33.203 20:09:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:33.203 20:09:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:35.817 20:09:07 -- setup/devices.sh@63 -- # found=1 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:35.817 20:09:07 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:35.817 20:09:07 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:35.817 20:09:07 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:35.817 20:09:07 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:35.817 20:09:07 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:35.817 20:09:07 -- setup/devices.sh@184 -- # verify 0000:5e:00.0 holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2 '' '' 00:03:35.817 20:09:07 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:35.817 20:09:07 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2 00:03:35.817 20:09:07 -- setup/devices.sh@50 -- # local mount_point= 00:03:35.817 20:09:07 -- setup/devices.sh@51 -- # local test_file= 00:03:35.817 20:09:07 -- setup/devices.sh@53 -- # local found=0 00:03:35.817 20:09:07 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:35.817 20:09:07 -- setup/devices.sh@59 -- # local pci status 00:03:35.817 20:09:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.817 20:09:07 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:35.817 20:09:07 -- setup/devices.sh@47 -- # setup output config 00:03:35.817 20:09:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:35.817 20:09:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.350 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.350 20:09:10 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\2\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\2* ]] 00:03:38.350 20:09:10 -- setup/devices.sh@63 -- # found=1 00:03:38.350 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.350 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.351 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.351 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.351 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.351 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.351 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.609 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.609 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.609 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.609 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.609 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.609 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.609 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.609 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.609 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.609 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.609 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.609 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.609 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.609 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.609 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.610 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.610 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.610 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.610 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.610 20:09:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.610 20:09:10 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:38.610 20:09:10 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:38.610 20:09:10 -- setup/devices.sh@68 -- # return 0 00:03:38.610 20:09:10 -- setup/devices.sh@187 -- # cleanup_dm 00:03:38.610 20:09:10 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.610 20:09:10 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:38.610 20:09:10 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:38.610 20:09:10 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:38.610 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:38.610 20:09:10 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:38.610 00:03:38.610 real 0m8.670s 00:03:38.610 user 0m2.031s 00:03:38.610 sys 0m3.692s 00:03:38.610 20:09:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:38.610 20:09:10 -- common/autotest_common.sh@10 -- # set +x 00:03:38.610 ************************************ 00:03:38.610 END TEST dm_mount 00:03:38.610 ************************************ 00:03:38.610 20:09:10 -- setup/devices.sh@1 -- # cleanup 00:03:38.610 20:09:10 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:38.610 20:09:10 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.610 20:09:10 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:38.610 20:09:10 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:38.610 20:09:10 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:38.868 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:38.868 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:38.869 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:38.869 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:38.869 20:09:10 -- setup/devices.sh@12 -- # cleanup_dm 00:03:38.869 20:09:10 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.869 20:09:10 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:38.869 20:09:10 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:38.869 20:09:10 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:38.869 20:09:10 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:38.869 20:09:10 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:39.127 00:03:39.127 real 0m21.956s 00:03:39.127 user 0m5.843s 00:03:39.127 sys 0m10.559s 00:03:39.127 20:09:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:39.127 20:09:10 -- common/autotest_common.sh@10 -- # set +x 00:03:39.127 ************************************ 00:03:39.127 END TEST devices 00:03:39.127 ************************************ 00:03:39.127 00:03:39.127 real 1m13.717s 00:03:39.127 user 0m23.606s 00:03:39.127 sys 0m40.405s 00:03:39.127 20:09:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:39.127 20:09:10 -- common/autotest_common.sh@10 -- # set +x 00:03:39.127 ************************************ 00:03:39.127 END TEST setup.sh 00:03:39.127 ************************************ 00:03:39.127 20:09:10 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:41.662 Hugepages 00:03:41.662 node hugesize free / total 00:03:41.662 node0 1048576kB 0 / 0 00:03:41.662 node0 2048kB 2048 / 2048 00:03:41.662 node1 1048576kB 0 / 0 00:03:41.662 node1 2048kB 0 / 0 00:03:41.662 00:03:41.662 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:41.662 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:03:41.662 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:03:41.662 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:03:41.662 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:03:41.662 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:03:41.662 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:03:41.662 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:03:41.662 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:03:41.662 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:03:41.662 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:03:41.662 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:03:41.662 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:03:41.662 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:03:41.662 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:03:41.662 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:03:41.662 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:03:41.662 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:03:41.662 20:09:13 -- spdk/autotest.sh@141 -- # uname -s 00:03:41.662 20:09:13 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:03:41.662 20:09:13 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:03:41.662 20:09:13 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:44.196 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:44.196 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:45.130 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:03:45.130 20:09:16 -- common/autotest_common.sh@1517 -- # sleep 1 00:03:46.065 20:09:17 -- common/autotest_common.sh@1518 -- # bdfs=() 00:03:46.065 20:09:17 -- common/autotest_common.sh@1518 -- # local bdfs 00:03:46.065 20:09:17 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:03:46.065 20:09:17 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:03:46.065 20:09:17 -- common/autotest_common.sh@1498 -- # bdfs=() 00:03:46.065 20:09:17 -- common/autotest_common.sh@1498 -- # local bdfs 00:03:46.065 20:09:17 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:46.065 20:09:17 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:46.065 20:09:17 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:03:46.065 20:09:17 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:03:46.065 20:09:17 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:5e:00.0 00:03:46.065 20:09:17 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:48.607 Waiting for block devices as requested 00:03:48.607 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:03:48.607 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:03:48.607 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:03:48.607 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:03:48.607 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:03:48.607 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:03:48.607 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:03:48.607 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:03:48.867 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:03:48.867 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:03:48.867 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:03:48.867 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:03:49.127 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:03:49.127 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:03:49.127 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:03:49.386 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:03:49.386 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:03:49.386 20:09:21 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:03:49.386 20:09:21 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:5e:00.0 00:03:49.386 20:09:21 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:03:49.386 20:09:21 -- common/autotest_common.sh@1487 -- # grep 0000:5e:00.0/nvme/nvme 00:03:49.386 20:09:21 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:03:49.386 20:09:21 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 ]] 00:03:49.386 20:09:21 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:03:49.386 20:09:21 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:03:49.386 20:09:21 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:03:49.386 20:09:21 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:03:49.386 20:09:21 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:03:49.386 20:09:21 -- common/autotest_common.sh@1530 -- # grep oacs 00:03:49.386 20:09:21 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:03:49.386 20:09:21 -- common/autotest_common.sh@1530 -- # oacs=' 0xe' 00:03:49.386 20:09:21 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:03:49.386 20:09:21 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:03:49.386 20:09:21 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:03:49.386 20:09:21 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:03:49.386 20:09:21 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:03:49.386 20:09:21 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:03:49.386 20:09:21 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:03:49.386 20:09:21 -- common/autotest_common.sh@1542 -- # continue 00:03:49.386 20:09:21 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:03:49.386 20:09:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:49.386 20:09:21 -- common/autotest_common.sh@10 -- # set +x 00:03:49.386 20:09:21 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:03:49.386 20:09:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:49.386 20:09:21 -- common/autotest_common.sh@10 -- # set +x 00:03:49.386 20:09:21 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:51.922 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:51.922 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:51.922 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:51.922 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:51.922 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:51.922 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:52.180 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:53.119 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:03:53.119 20:09:24 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:03:53.119 20:09:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:53.119 20:09:24 -- common/autotest_common.sh@10 -- # set +x 00:03:53.119 20:09:24 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:03:53.119 20:09:24 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:03:53.119 20:09:24 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:03:53.119 20:09:24 -- common/autotest_common.sh@1562 -- # bdfs=() 00:03:53.119 20:09:24 -- common/autotest_common.sh@1562 -- # local bdfs 00:03:53.119 20:09:24 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:03:53.119 20:09:24 -- common/autotest_common.sh@1498 -- # bdfs=() 00:03:53.119 20:09:24 -- common/autotest_common.sh@1498 -- # local bdfs 00:03:53.119 20:09:24 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:53.119 20:09:24 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:53.119 20:09:24 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:03:53.119 20:09:24 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:03:53.119 20:09:24 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:5e:00.0 00:03:53.119 20:09:24 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:03:53.119 20:09:24 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:5e:00.0/device 00:03:53.119 20:09:24 -- common/autotest_common.sh@1565 -- # device=0x0a54 00:03:53.119 20:09:24 -- common/autotest_common.sh@1566 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:53.119 20:09:24 -- common/autotest_common.sh@1567 -- # bdfs+=($bdf) 00:03:53.119 20:09:24 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:5e:00.0 00:03:53.119 20:09:24 -- common/autotest_common.sh@1577 -- # [[ -z 0000:5e:00.0 ]] 00:03:53.119 20:09:24 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=3222340 00:03:53.119 20:09:24 -- common/autotest_common.sh@1583 -- # waitforlisten 3222340 00:03:53.119 20:09:24 -- common/autotest_common.sh@819 -- # '[' -z 3222340 ']' 00:03:53.119 20:09:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:53.119 20:09:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:53.119 20:09:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:53.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:53.119 20:09:24 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:53.119 20:09:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:53.119 20:09:24 -- common/autotest_common.sh@10 -- # set +x 00:03:53.119 [2024-07-22 20:09:25.036264] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:03:53.119 [2024-07-22 20:09:25.036309] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3222340 ] 00:03:53.378 EAL: No free 2048 kB hugepages reported on node 1 00:03:53.378 [2024-07-22 20:09:25.089708] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:53.378 [2024-07-22 20:09:25.169029] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:53.378 [2024-07-22 20:09:25.169146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:53.947 20:09:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:53.947 20:09:25 -- common/autotest_common.sh@852 -- # return 0 00:03:53.947 20:09:25 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:03:53.947 20:09:25 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:03:53.947 20:09:25 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5e:00.0 00:03:57.238 nvme0n1 00:03:57.238 20:09:28 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:57.238 [2024-07-22 20:09:28.951507] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:03:57.238 request: 00:03:57.238 { 00:03:57.238 "nvme_ctrlr_name": "nvme0", 00:03:57.238 "password": "test", 00:03:57.238 "method": "bdev_nvme_opal_revert", 00:03:57.238 "req_id": 1 00:03:57.238 } 00:03:57.238 Got JSON-RPC error response 00:03:57.238 response: 00:03:57.238 { 00:03:57.238 "code": -32602, 00:03:57.238 "message": "Invalid parameters" 00:03:57.238 } 00:03:57.238 20:09:28 -- common/autotest_common.sh@1589 -- # true 00:03:57.238 20:09:28 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:03:57.238 20:09:28 -- common/autotest_common.sh@1593 -- # killprocess 3222340 00:03:57.238 20:09:28 -- common/autotest_common.sh@926 -- # '[' -z 3222340 ']' 00:03:57.238 20:09:28 -- common/autotest_common.sh@930 -- # kill -0 3222340 00:03:57.238 20:09:28 -- common/autotest_common.sh@931 -- # uname 00:03:57.238 20:09:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:57.238 20:09:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3222340 00:03:57.238 20:09:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:57.238 20:09:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:57.238 20:09:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3222340' 00:03:57.238 killing process with pid 3222340 00:03:57.238 20:09:29 -- common/autotest_common.sh@945 -- # kill 3222340 00:03:57.238 20:09:29 -- common/autotest_common.sh@950 -- # wait 3222340 00:03:58.778 20:09:30 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:03:58.778 20:09:30 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:03:58.778 20:09:30 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:03:58.778 20:09:30 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:03:58.778 20:09:30 -- spdk/autotest.sh@173 -- # timing_enter lib 00:03:58.778 20:09:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:58.778 20:09:30 -- common/autotest_common.sh@10 -- # set +x 00:03:58.778 20:09:30 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:58.778 20:09:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:58.778 20:09:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:58.778 20:09:30 -- common/autotest_common.sh@10 -- # set +x 00:03:58.778 ************************************ 00:03:58.778 START TEST env 00:03:58.778 ************************************ 00:03:58.778 20:09:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:59.038 * Looking for test storage... 00:03:59.038 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:59.038 20:09:30 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:59.038 20:09:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:59.038 20:09:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:59.038 20:09:30 -- common/autotest_common.sh@10 -- # set +x 00:03:59.038 ************************************ 00:03:59.038 START TEST env_memory 00:03:59.038 ************************************ 00:03:59.038 20:09:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:59.038 00:03:59.038 00:03:59.038 CUnit - A unit testing framework for C - Version 2.1-3 00:03:59.038 http://cunit.sourceforge.net/ 00:03:59.038 00:03:59.038 00:03:59.038 Suite: memory 00:03:59.038 Test: alloc and free memory map ...[2024-07-22 20:09:30.787127] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:59.038 passed 00:03:59.038 Test: mem map translation ...[2024-07-22 20:09:30.806362] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:59.038 [2024-07-22 20:09:30.806375] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:59.038 [2024-07-22 20:09:30.806427] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:59.038 [2024-07-22 20:09:30.806434] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:59.038 passed 00:03:59.038 Test: mem map registration ...[2024-07-22 20:09:30.845448] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:59.038 [2024-07-22 20:09:30.845462] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:59.038 passed 00:03:59.038 Test: mem map adjacent registrations ...passed 00:03:59.038 00:03:59.038 Run Summary: Type Total Ran Passed Failed Inactive 00:03:59.038 suites 1 1 n/a 0 0 00:03:59.038 tests 4 4 4 0 0 00:03:59.038 asserts 152 152 152 0 n/a 00:03:59.038 00:03:59.038 Elapsed time = 0.141 seconds 00:03:59.038 00:03:59.038 real 0m0.153s 00:03:59.038 user 0m0.144s 00:03:59.038 sys 0m0.009s 00:03:59.038 20:09:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:59.038 20:09:30 -- common/autotest_common.sh@10 -- # set +x 00:03:59.038 ************************************ 00:03:59.038 END TEST env_memory 00:03:59.038 ************************************ 00:03:59.038 20:09:30 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:59.038 20:09:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:59.038 20:09:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:59.038 20:09:30 -- common/autotest_common.sh@10 -- # set +x 00:03:59.038 ************************************ 00:03:59.038 START TEST env_vtophys 00:03:59.038 ************************************ 00:03:59.038 20:09:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:59.038 EAL: lib.eal log level changed from notice to debug 00:03:59.038 EAL: Detected lcore 0 as core 0 on socket 0 00:03:59.038 EAL: Detected lcore 1 as core 1 on socket 0 00:03:59.038 EAL: Detected lcore 2 as core 2 on socket 0 00:03:59.038 EAL: Detected lcore 3 as core 3 on socket 0 00:03:59.038 EAL: Detected lcore 4 as core 4 on socket 0 00:03:59.038 EAL: Detected lcore 5 as core 5 on socket 0 00:03:59.038 EAL: Detected lcore 6 as core 6 on socket 0 00:03:59.038 EAL: Detected lcore 7 as core 8 on socket 0 00:03:59.038 EAL: Detected lcore 8 as core 9 on socket 0 00:03:59.038 EAL: Detected lcore 9 as core 10 on socket 0 00:03:59.038 EAL: Detected lcore 10 as core 11 on socket 0 00:03:59.038 EAL: Detected lcore 11 as core 12 on socket 0 00:03:59.038 EAL: Detected lcore 12 as core 13 on socket 0 00:03:59.038 EAL: Detected lcore 13 as core 16 on socket 0 00:03:59.038 EAL: Detected lcore 14 as core 17 on socket 0 00:03:59.038 EAL: Detected lcore 15 as core 18 on socket 0 00:03:59.038 EAL: Detected lcore 16 as core 19 on socket 0 00:03:59.038 EAL: Detected lcore 17 as core 20 on socket 0 00:03:59.038 EAL: Detected lcore 18 as core 21 on socket 0 00:03:59.038 EAL: Detected lcore 19 as core 25 on socket 0 00:03:59.038 EAL: Detected lcore 20 as core 26 on socket 0 00:03:59.039 EAL: Detected lcore 21 as core 27 on socket 0 00:03:59.039 EAL: Detected lcore 22 as core 28 on socket 0 00:03:59.039 EAL: Detected lcore 23 as core 29 on socket 0 00:03:59.039 EAL: Detected lcore 24 as core 0 on socket 1 00:03:59.039 EAL: Detected lcore 25 as core 1 on socket 1 00:03:59.039 EAL: Detected lcore 26 as core 2 on socket 1 00:03:59.039 EAL: Detected lcore 27 as core 3 on socket 1 00:03:59.039 EAL: Detected lcore 28 as core 4 on socket 1 00:03:59.039 EAL: Detected lcore 29 as core 5 on socket 1 00:03:59.039 EAL: Detected lcore 30 as core 6 on socket 1 00:03:59.039 EAL: Detected lcore 31 as core 9 on socket 1 00:03:59.039 EAL: Detected lcore 32 as core 10 on socket 1 00:03:59.039 EAL: Detected lcore 33 as core 11 on socket 1 00:03:59.039 EAL: Detected lcore 34 as core 12 on socket 1 00:03:59.039 EAL: Detected lcore 35 as core 13 on socket 1 00:03:59.039 EAL: Detected lcore 36 as core 16 on socket 1 00:03:59.039 EAL: Detected lcore 37 as core 17 on socket 1 00:03:59.039 EAL: Detected lcore 38 as core 18 on socket 1 00:03:59.039 EAL: Detected lcore 39 as core 19 on socket 1 00:03:59.039 EAL: Detected lcore 40 as core 20 on socket 1 00:03:59.039 EAL: Detected lcore 41 as core 21 on socket 1 00:03:59.039 EAL: Detected lcore 42 as core 24 on socket 1 00:03:59.039 EAL: Detected lcore 43 as core 25 on socket 1 00:03:59.039 EAL: Detected lcore 44 as core 26 on socket 1 00:03:59.039 EAL: Detected lcore 45 as core 27 on socket 1 00:03:59.039 EAL: Detected lcore 46 as core 28 on socket 1 00:03:59.039 EAL: Detected lcore 47 as core 29 on socket 1 00:03:59.039 EAL: Detected lcore 48 as core 0 on socket 0 00:03:59.039 EAL: Detected lcore 49 as core 1 on socket 0 00:03:59.039 EAL: Detected lcore 50 as core 2 on socket 0 00:03:59.039 EAL: Detected lcore 51 as core 3 on socket 0 00:03:59.039 EAL: Detected lcore 52 as core 4 on socket 0 00:03:59.039 EAL: Detected lcore 53 as core 5 on socket 0 00:03:59.039 EAL: Detected lcore 54 as core 6 on socket 0 00:03:59.039 EAL: Detected lcore 55 as core 8 on socket 0 00:03:59.039 EAL: Detected lcore 56 as core 9 on socket 0 00:03:59.039 EAL: Detected lcore 57 as core 10 on socket 0 00:03:59.039 EAL: Detected lcore 58 as core 11 on socket 0 00:03:59.039 EAL: Detected lcore 59 as core 12 on socket 0 00:03:59.039 EAL: Detected lcore 60 as core 13 on socket 0 00:03:59.039 EAL: Detected lcore 61 as core 16 on socket 0 00:03:59.039 EAL: Detected lcore 62 as core 17 on socket 0 00:03:59.039 EAL: Detected lcore 63 as core 18 on socket 0 00:03:59.039 EAL: Detected lcore 64 as core 19 on socket 0 00:03:59.039 EAL: Detected lcore 65 as core 20 on socket 0 00:03:59.039 EAL: Detected lcore 66 as core 21 on socket 0 00:03:59.039 EAL: Detected lcore 67 as core 25 on socket 0 00:03:59.039 EAL: Detected lcore 68 as core 26 on socket 0 00:03:59.039 EAL: Detected lcore 69 as core 27 on socket 0 00:03:59.039 EAL: Detected lcore 70 as core 28 on socket 0 00:03:59.039 EAL: Detected lcore 71 as core 29 on socket 0 00:03:59.039 EAL: Detected lcore 72 as core 0 on socket 1 00:03:59.039 EAL: Detected lcore 73 as core 1 on socket 1 00:03:59.039 EAL: Detected lcore 74 as core 2 on socket 1 00:03:59.039 EAL: Detected lcore 75 as core 3 on socket 1 00:03:59.039 EAL: Detected lcore 76 as core 4 on socket 1 00:03:59.039 EAL: Detected lcore 77 as core 5 on socket 1 00:03:59.039 EAL: Detected lcore 78 as core 6 on socket 1 00:03:59.039 EAL: Detected lcore 79 as core 9 on socket 1 00:03:59.039 EAL: Detected lcore 80 as core 10 on socket 1 00:03:59.039 EAL: Detected lcore 81 as core 11 on socket 1 00:03:59.039 EAL: Detected lcore 82 as core 12 on socket 1 00:03:59.039 EAL: Detected lcore 83 as core 13 on socket 1 00:03:59.039 EAL: Detected lcore 84 as core 16 on socket 1 00:03:59.039 EAL: Detected lcore 85 as core 17 on socket 1 00:03:59.039 EAL: Detected lcore 86 as core 18 on socket 1 00:03:59.039 EAL: Detected lcore 87 as core 19 on socket 1 00:03:59.039 EAL: Detected lcore 88 as core 20 on socket 1 00:03:59.039 EAL: Detected lcore 89 as core 21 on socket 1 00:03:59.039 EAL: Detected lcore 90 as core 24 on socket 1 00:03:59.039 EAL: Detected lcore 91 as core 25 on socket 1 00:03:59.039 EAL: Detected lcore 92 as core 26 on socket 1 00:03:59.039 EAL: Detected lcore 93 as core 27 on socket 1 00:03:59.039 EAL: Detected lcore 94 as core 28 on socket 1 00:03:59.039 EAL: Detected lcore 95 as core 29 on socket 1 00:03:59.039 EAL: Maximum logical cores by configuration: 128 00:03:59.039 EAL: Detected CPU lcores: 96 00:03:59.039 EAL: Detected NUMA nodes: 2 00:03:59.039 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:59.039 EAL: Detected shared linkage of DPDK 00:03:59.039 EAL: No shared files mode enabled, IPC will be disabled 00:03:59.299 EAL: Bus pci wants IOVA as 'DC' 00:03:59.299 EAL: Buses did not request a specific IOVA mode. 00:03:59.299 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:59.300 EAL: Selected IOVA mode 'VA' 00:03:59.300 EAL: No free 2048 kB hugepages reported on node 1 00:03:59.300 EAL: Probing VFIO support... 00:03:59.300 EAL: IOMMU type 1 (Type 1) is supported 00:03:59.300 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:59.300 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:59.300 EAL: VFIO support initialized 00:03:59.300 EAL: Ask a virtual area of 0x2e000 bytes 00:03:59.300 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:59.300 EAL: Setting up physically contiguous memory... 00:03:59.300 EAL: Setting maximum number of open files to 524288 00:03:59.300 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:59.300 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:59.300 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:59.300 EAL: Ask a virtual area of 0x61000 bytes 00:03:59.300 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:59.300 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:59.300 EAL: Ask a virtual area of 0x400000000 bytes 00:03:59.300 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:59.300 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:59.300 EAL: Ask a virtual area of 0x61000 bytes 00:03:59.300 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:59.300 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:59.300 EAL: Ask a virtual area of 0x400000000 bytes 00:03:59.300 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:59.300 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:59.300 EAL: Ask a virtual area of 0x61000 bytes 00:03:59.300 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:59.300 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:59.300 EAL: Ask a virtual area of 0x400000000 bytes 00:03:59.300 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:59.300 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:59.300 EAL: Ask a virtual area of 0x61000 bytes 00:03:59.300 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:59.300 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:59.300 EAL: Ask a virtual area of 0x400000000 bytes 00:03:59.300 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:59.300 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:59.300 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:59.300 EAL: Ask a virtual area of 0x61000 bytes 00:03:59.300 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:59.300 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:59.300 EAL: Ask a virtual area of 0x400000000 bytes 00:03:59.300 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:59.300 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:59.300 EAL: Ask a virtual area of 0x61000 bytes 00:03:59.300 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:59.300 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:59.300 EAL: Ask a virtual area of 0x400000000 bytes 00:03:59.300 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:59.300 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:59.300 EAL: Ask a virtual area of 0x61000 bytes 00:03:59.300 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:59.300 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:59.300 EAL: Ask a virtual area of 0x400000000 bytes 00:03:59.300 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:59.300 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:59.300 EAL: Ask a virtual area of 0x61000 bytes 00:03:59.300 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:59.300 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:59.300 EAL: Ask a virtual area of 0x400000000 bytes 00:03:59.300 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:59.300 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:59.300 EAL: Hugepages will be freed exactly as allocated. 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: TSC frequency is ~2300000 KHz 00:03:59.300 EAL: Main lcore 0 is ready (tid=7eff4f53da00;cpuset=[0]) 00:03:59.300 EAL: Trying to obtain current memory policy. 00:03:59.300 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.300 EAL: Restoring previous memory policy: 0 00:03:59.300 EAL: request: mp_malloc_sync 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: Heap on socket 0 was expanded by 2MB 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:59.300 EAL: Mem event callback 'spdk:(nil)' registered 00:03:59.300 00:03:59.300 00:03:59.300 CUnit - A unit testing framework for C - Version 2.1-3 00:03:59.300 http://cunit.sourceforge.net/ 00:03:59.300 00:03:59.300 00:03:59.300 Suite: components_suite 00:03:59.300 Test: vtophys_malloc_test ...passed 00:03:59.300 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:59.300 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.300 EAL: Restoring previous memory policy: 4 00:03:59.300 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.300 EAL: request: mp_malloc_sync 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: Heap on socket 0 was expanded by 4MB 00:03:59.300 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.300 EAL: request: mp_malloc_sync 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: Heap on socket 0 was shrunk by 4MB 00:03:59.300 EAL: Trying to obtain current memory policy. 00:03:59.300 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.300 EAL: Restoring previous memory policy: 4 00:03:59.300 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.300 EAL: request: mp_malloc_sync 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: Heap on socket 0 was expanded by 6MB 00:03:59.300 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.300 EAL: request: mp_malloc_sync 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: Heap on socket 0 was shrunk by 6MB 00:03:59.300 EAL: Trying to obtain current memory policy. 00:03:59.300 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.300 EAL: Restoring previous memory policy: 4 00:03:59.300 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.300 EAL: request: mp_malloc_sync 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: Heap on socket 0 was expanded by 10MB 00:03:59.300 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.300 EAL: request: mp_malloc_sync 00:03:59.300 EAL: No shared files mode enabled, IPC is disabled 00:03:59.300 EAL: Heap on socket 0 was shrunk by 10MB 00:03:59.300 EAL: Trying to obtain current memory policy. 00:03:59.300 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.300 EAL: Restoring previous memory policy: 4 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was expanded by 18MB 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was shrunk by 18MB 00:03:59.301 EAL: Trying to obtain current memory policy. 00:03:59.301 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.301 EAL: Restoring previous memory policy: 4 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was expanded by 34MB 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was shrunk by 34MB 00:03:59.301 EAL: Trying to obtain current memory policy. 00:03:59.301 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.301 EAL: Restoring previous memory policy: 4 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was expanded by 66MB 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was shrunk by 66MB 00:03:59.301 EAL: Trying to obtain current memory policy. 00:03:59.301 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.301 EAL: Restoring previous memory policy: 4 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was expanded by 130MB 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was shrunk by 130MB 00:03:59.301 EAL: Trying to obtain current memory policy. 00:03:59.301 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.301 EAL: Restoring previous memory policy: 4 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.301 EAL: request: mp_malloc_sync 00:03:59.301 EAL: No shared files mode enabled, IPC is disabled 00:03:59.301 EAL: Heap on socket 0 was expanded by 258MB 00:03:59.301 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.560 EAL: request: mp_malloc_sync 00:03:59.560 EAL: No shared files mode enabled, IPC is disabled 00:03:59.560 EAL: Heap on socket 0 was shrunk by 258MB 00:03:59.560 EAL: Trying to obtain current memory policy. 00:03:59.560 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.560 EAL: Restoring previous memory policy: 4 00:03:59.560 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.560 EAL: request: mp_malloc_sync 00:03:59.560 EAL: No shared files mode enabled, IPC is disabled 00:03:59.560 EAL: Heap on socket 0 was expanded by 514MB 00:03:59.560 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.819 EAL: request: mp_malloc_sync 00:03:59.819 EAL: No shared files mode enabled, IPC is disabled 00:03:59.819 EAL: Heap on socket 0 was shrunk by 514MB 00:03:59.819 EAL: Trying to obtain current memory policy. 00:03:59.819 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:59.819 EAL: Restoring previous memory policy: 4 00:03:59.819 EAL: Calling mem event callback 'spdk:(nil)' 00:03:59.819 EAL: request: mp_malloc_sync 00:03:59.819 EAL: No shared files mode enabled, IPC is disabled 00:03:59.819 EAL: Heap on socket 0 was expanded by 1026MB 00:04:00.078 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.078 EAL: request: mp_malloc_sync 00:04:00.078 EAL: No shared files mode enabled, IPC is disabled 00:04:00.078 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:00.078 passed 00:04:00.078 00:04:00.078 Run Summary: Type Total Ran Passed Failed Inactive 00:04:00.078 suites 1 1 n/a 0 0 00:04:00.078 tests 2 2 2 0 0 00:04:00.078 asserts 497 497 497 0 n/a 00:04:00.078 00:04:00.078 Elapsed time = 0.962 seconds 00:04:00.078 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.078 EAL: request: mp_malloc_sync 00:04:00.078 EAL: No shared files mode enabled, IPC is disabled 00:04:00.078 EAL: Heap on socket 0 was shrunk by 2MB 00:04:00.078 EAL: No shared files mode enabled, IPC is disabled 00:04:00.078 EAL: No shared files mode enabled, IPC is disabled 00:04:00.078 EAL: No shared files mode enabled, IPC is disabled 00:04:00.078 00:04:00.078 real 0m1.074s 00:04:00.078 user 0m0.626s 00:04:00.078 sys 0m0.417s 00:04:00.078 20:09:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:00.078 20:09:32 -- common/autotest_common.sh@10 -- # set +x 00:04:00.078 ************************************ 00:04:00.078 END TEST env_vtophys 00:04:00.078 ************************************ 00:04:00.338 20:09:32 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:00.338 20:09:32 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:00.338 20:09:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:00.338 20:09:32 -- common/autotest_common.sh@10 -- # set +x 00:04:00.338 ************************************ 00:04:00.338 START TEST env_pci 00:04:00.338 ************************************ 00:04:00.338 20:09:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:00.338 00:04:00.338 00:04:00.338 CUnit - A unit testing framework for C - Version 2.1-3 00:04:00.338 http://cunit.sourceforge.net/ 00:04:00.338 00:04:00.338 00:04:00.338 Suite: pci 00:04:00.338 Test: pci_hook ...[2024-07-22 20:09:32.066476] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3223692 has claimed it 00:04:00.338 EAL: Cannot find device (10000:00:01.0) 00:04:00.338 EAL: Failed to attach device on primary process 00:04:00.338 passed 00:04:00.338 00:04:00.338 Run Summary: Type Total Ran Passed Failed Inactive 00:04:00.338 suites 1 1 n/a 0 0 00:04:00.338 tests 1 1 1 0 0 00:04:00.338 asserts 25 25 25 0 n/a 00:04:00.338 00:04:00.338 Elapsed time = 0.024 seconds 00:04:00.338 00:04:00.338 real 0m0.041s 00:04:00.338 user 0m0.016s 00:04:00.338 sys 0m0.025s 00:04:00.338 20:09:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:00.338 20:09:32 -- common/autotest_common.sh@10 -- # set +x 00:04:00.338 ************************************ 00:04:00.338 END TEST env_pci 00:04:00.338 ************************************ 00:04:00.338 20:09:32 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:00.338 20:09:32 -- env/env.sh@15 -- # uname 00:04:00.338 20:09:32 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:00.338 20:09:32 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:00.338 20:09:32 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:00.338 20:09:32 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:04:00.338 20:09:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:00.338 20:09:32 -- common/autotest_common.sh@10 -- # set +x 00:04:00.338 ************************************ 00:04:00.338 START TEST env_dpdk_post_init 00:04:00.338 ************************************ 00:04:00.338 20:09:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:00.338 EAL: Detected CPU lcores: 96 00:04:00.338 EAL: Detected NUMA nodes: 2 00:04:00.338 EAL: Detected shared linkage of DPDK 00:04:00.338 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:00.338 EAL: Selected IOVA mode 'VA' 00:04:00.338 EAL: No free 2048 kB hugepages reported on node 1 00:04:00.338 EAL: VFIO support initialized 00:04:00.338 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:00.338 EAL: Using IOMMU type 1 (Type 1) 00:04:00.338 EAL: Ignore mapping IO port bar(1) 00:04:00.338 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:04:00.338 EAL: Ignore mapping IO port bar(1) 00:04:00.338 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:04:00.338 EAL: Ignore mapping IO port bar(1) 00:04:00.338 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:04:00.598 EAL: Ignore mapping IO port bar(1) 00:04:00.598 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:04:00.598 EAL: Ignore mapping IO port bar(1) 00:04:00.598 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:04:00.598 EAL: Ignore mapping IO port bar(1) 00:04:00.598 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:04:00.598 EAL: Ignore mapping IO port bar(1) 00:04:00.598 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:04:00.598 EAL: Ignore mapping IO port bar(1) 00:04:00.598 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:04:01.174 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5e:00.0 (socket 0) 00:04:01.174 EAL: Ignore mapping IO port bar(1) 00:04:01.174 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:04:01.174 EAL: Ignore mapping IO port bar(1) 00:04:01.174 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:04:01.174 EAL: Ignore mapping IO port bar(1) 00:04:01.174 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:04:01.433 EAL: Ignore mapping IO port bar(1) 00:04:01.433 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:04:01.433 EAL: Ignore mapping IO port bar(1) 00:04:01.433 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:04:01.433 EAL: Ignore mapping IO port bar(1) 00:04:01.433 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:04:01.433 EAL: Ignore mapping IO port bar(1) 00:04:01.433 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:04:01.433 EAL: Ignore mapping IO port bar(1) 00:04:01.433 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:04:04.720 EAL: Releasing PCI mapped resource for 0000:5e:00.0 00:04:04.720 EAL: Calling pci_unmap_resource for 0000:5e:00.0 at 0x202001020000 00:04:04.720 Starting DPDK initialization... 00:04:04.720 Starting SPDK post initialization... 00:04:04.720 SPDK NVMe probe 00:04:04.720 Attaching to 0000:5e:00.0 00:04:04.720 Attached to 0000:5e:00.0 00:04:04.720 Cleaning up... 00:04:04.720 00:04:04.720 real 0m4.297s 00:04:04.720 user 0m3.265s 00:04:04.720 sys 0m0.104s 00:04:04.720 20:09:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:04.720 20:09:36 -- common/autotest_common.sh@10 -- # set +x 00:04:04.720 ************************************ 00:04:04.720 END TEST env_dpdk_post_init 00:04:04.720 ************************************ 00:04:04.720 20:09:36 -- env/env.sh@26 -- # uname 00:04:04.720 20:09:36 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:04.720 20:09:36 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:04.720 20:09:36 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:04.720 20:09:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:04.720 20:09:36 -- common/autotest_common.sh@10 -- # set +x 00:04:04.720 ************************************ 00:04:04.720 START TEST env_mem_callbacks 00:04:04.720 ************************************ 00:04:04.720 20:09:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:04.720 EAL: Detected CPU lcores: 96 00:04:04.720 EAL: Detected NUMA nodes: 2 00:04:04.720 EAL: Detected shared linkage of DPDK 00:04:04.720 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:04.720 EAL: Selected IOVA mode 'VA' 00:04:04.720 EAL: No free 2048 kB hugepages reported on node 1 00:04:04.720 EAL: VFIO support initialized 00:04:04.720 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:04.720 00:04:04.720 00:04:04.721 CUnit - A unit testing framework for C - Version 2.1-3 00:04:04.721 http://cunit.sourceforge.net/ 00:04:04.721 00:04:04.721 00:04:04.721 Suite: memory 00:04:04.721 Test: test ... 00:04:04.721 register 0x200000200000 2097152 00:04:04.721 malloc 3145728 00:04:04.721 register 0x200000400000 4194304 00:04:04.721 buf 0x200000500000 len 3145728 PASSED 00:04:04.721 malloc 64 00:04:04.721 buf 0x2000004fff40 len 64 PASSED 00:04:04.721 malloc 4194304 00:04:04.721 register 0x200000800000 6291456 00:04:04.721 buf 0x200000a00000 len 4194304 PASSED 00:04:04.721 free 0x200000500000 3145728 00:04:04.721 free 0x2000004fff40 64 00:04:04.721 unregister 0x200000400000 4194304 PASSED 00:04:04.721 free 0x200000a00000 4194304 00:04:04.721 unregister 0x200000800000 6291456 PASSED 00:04:04.721 malloc 8388608 00:04:04.721 register 0x200000400000 10485760 00:04:04.721 buf 0x200000600000 len 8388608 PASSED 00:04:04.721 free 0x200000600000 8388608 00:04:04.721 unregister 0x200000400000 10485760 PASSED 00:04:04.721 passed 00:04:04.721 00:04:04.721 Run Summary: Type Total Ran Passed Failed Inactive 00:04:04.721 suites 1 1 n/a 0 0 00:04:04.721 tests 1 1 1 0 0 00:04:04.721 asserts 15 15 15 0 n/a 00:04:04.721 00:04:04.721 Elapsed time = 0.005 seconds 00:04:04.721 00:04:04.721 real 0m0.053s 00:04:04.721 user 0m0.014s 00:04:04.721 sys 0m0.038s 00:04:04.721 20:09:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:04.721 20:09:36 -- common/autotest_common.sh@10 -- # set +x 00:04:04.721 ************************************ 00:04:04.721 END TEST env_mem_callbacks 00:04:04.721 ************************************ 00:04:04.721 00:04:04.721 real 0m5.898s 00:04:04.721 user 0m4.171s 00:04:04.721 sys 0m0.801s 00:04:04.721 20:09:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:04.721 20:09:36 -- common/autotest_common.sh@10 -- # set +x 00:04:04.721 ************************************ 00:04:04.721 END TEST env 00:04:04.721 ************************************ 00:04:04.721 20:09:36 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:04.721 20:09:36 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:04.721 20:09:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:04.721 20:09:36 -- common/autotest_common.sh@10 -- # set +x 00:04:04.721 ************************************ 00:04:04.721 START TEST rpc 00:04:04.721 ************************************ 00:04:04.721 20:09:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:04.982 * Looking for test storage... 00:04:04.982 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:04.982 20:09:36 -- rpc/rpc.sh@65 -- # spdk_pid=3224517 00:04:04.982 20:09:36 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:04.982 20:09:36 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:04.982 20:09:36 -- rpc/rpc.sh@67 -- # waitforlisten 3224517 00:04:04.982 20:09:36 -- common/autotest_common.sh@819 -- # '[' -z 3224517 ']' 00:04:04.982 20:09:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:04.982 20:09:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:04.982 20:09:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:04.982 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:04.982 20:09:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:04.982 20:09:36 -- common/autotest_common.sh@10 -- # set +x 00:04:04.982 [2024-07-22 20:09:36.715068] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:04.982 [2024-07-22 20:09:36.715118] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3224517 ] 00:04:04.982 EAL: No free 2048 kB hugepages reported on node 1 00:04:04.982 [2024-07-22 20:09:36.768805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:04.982 [2024-07-22 20:09:36.839914] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:04.982 [2024-07-22 20:09:36.840039] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:04.982 [2024-07-22 20:09:36.840052] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3224517' to capture a snapshot of events at runtime. 00:04:04.982 [2024-07-22 20:09:36.840058] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3224517 for offline analysis/debug. 00:04:04.982 [2024-07-22 20:09:36.840080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:05.919 20:09:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:05.919 20:09:37 -- common/autotest_common.sh@852 -- # return 0 00:04:05.919 20:09:37 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:05.919 20:09:37 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:05.919 20:09:37 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:05.919 20:09:37 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:05.919 20:09:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:05.919 20:09:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:05.919 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.919 ************************************ 00:04:05.919 START TEST rpc_integrity 00:04:05.919 ************************************ 00:04:05.919 20:09:37 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:05.919 20:09:37 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:05.919 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.919 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.919 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.919 20:09:37 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:05.919 20:09:37 -- rpc/rpc.sh@13 -- # jq length 00:04:05.919 20:09:37 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:05.919 20:09:37 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:05.919 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.919 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.920 20:09:37 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:05.920 20:09:37 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:05.920 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.920 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.920 20:09:37 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:05.920 { 00:04:05.920 "name": "Malloc0", 00:04:05.920 "aliases": [ 00:04:05.920 "36854e86-2284-44e2-b6ec-73a8731d8198" 00:04:05.920 ], 00:04:05.920 "product_name": "Malloc disk", 00:04:05.920 "block_size": 512, 00:04:05.920 "num_blocks": 16384, 00:04:05.920 "uuid": "36854e86-2284-44e2-b6ec-73a8731d8198", 00:04:05.920 "assigned_rate_limits": { 00:04:05.920 "rw_ios_per_sec": 0, 00:04:05.920 "rw_mbytes_per_sec": 0, 00:04:05.920 "r_mbytes_per_sec": 0, 00:04:05.920 "w_mbytes_per_sec": 0 00:04:05.920 }, 00:04:05.920 "claimed": false, 00:04:05.920 "zoned": false, 00:04:05.920 "supported_io_types": { 00:04:05.920 "read": true, 00:04:05.920 "write": true, 00:04:05.920 "unmap": true, 00:04:05.920 "write_zeroes": true, 00:04:05.920 "flush": true, 00:04:05.920 "reset": true, 00:04:05.920 "compare": false, 00:04:05.920 "compare_and_write": false, 00:04:05.920 "abort": true, 00:04:05.920 "nvme_admin": false, 00:04:05.920 "nvme_io": false 00:04:05.920 }, 00:04:05.920 "memory_domains": [ 00:04:05.920 { 00:04:05.920 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.920 "dma_device_type": 2 00:04:05.920 } 00:04:05.920 ], 00:04:05.920 "driver_specific": {} 00:04:05.920 } 00:04:05.920 ]' 00:04:05.920 20:09:37 -- rpc/rpc.sh@17 -- # jq length 00:04:05.920 20:09:37 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:05.920 20:09:37 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:05.920 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.920 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 [2024-07-22 20:09:37.642546] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:05.920 [2024-07-22 20:09:37.642579] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:05.920 [2024-07-22 20:09:37.642591] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xee5860 00:04:05.920 [2024-07-22 20:09:37.642597] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:05.920 [2024-07-22 20:09:37.643692] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:05.920 [2024-07-22 20:09:37.643712] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:05.920 Passthru0 00:04:05.920 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.920 20:09:37 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:05.920 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.920 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.920 20:09:37 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:05.920 { 00:04:05.920 "name": "Malloc0", 00:04:05.920 "aliases": [ 00:04:05.920 "36854e86-2284-44e2-b6ec-73a8731d8198" 00:04:05.920 ], 00:04:05.920 "product_name": "Malloc disk", 00:04:05.920 "block_size": 512, 00:04:05.920 "num_blocks": 16384, 00:04:05.920 "uuid": "36854e86-2284-44e2-b6ec-73a8731d8198", 00:04:05.920 "assigned_rate_limits": { 00:04:05.920 "rw_ios_per_sec": 0, 00:04:05.920 "rw_mbytes_per_sec": 0, 00:04:05.920 "r_mbytes_per_sec": 0, 00:04:05.920 "w_mbytes_per_sec": 0 00:04:05.920 }, 00:04:05.920 "claimed": true, 00:04:05.920 "claim_type": "exclusive_write", 00:04:05.920 "zoned": false, 00:04:05.920 "supported_io_types": { 00:04:05.920 "read": true, 00:04:05.920 "write": true, 00:04:05.920 "unmap": true, 00:04:05.920 "write_zeroes": true, 00:04:05.920 "flush": true, 00:04:05.920 "reset": true, 00:04:05.920 "compare": false, 00:04:05.920 "compare_and_write": false, 00:04:05.920 "abort": true, 00:04:05.920 "nvme_admin": false, 00:04:05.920 "nvme_io": false 00:04:05.920 }, 00:04:05.920 "memory_domains": [ 00:04:05.920 { 00:04:05.920 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.920 "dma_device_type": 2 00:04:05.920 } 00:04:05.920 ], 00:04:05.920 "driver_specific": {} 00:04:05.920 }, 00:04:05.920 { 00:04:05.920 "name": "Passthru0", 00:04:05.920 "aliases": [ 00:04:05.920 "f1741c41-af13-5117-8462-d2cc910c95e8" 00:04:05.920 ], 00:04:05.920 "product_name": "passthru", 00:04:05.920 "block_size": 512, 00:04:05.920 "num_blocks": 16384, 00:04:05.920 "uuid": "f1741c41-af13-5117-8462-d2cc910c95e8", 00:04:05.920 "assigned_rate_limits": { 00:04:05.920 "rw_ios_per_sec": 0, 00:04:05.920 "rw_mbytes_per_sec": 0, 00:04:05.920 "r_mbytes_per_sec": 0, 00:04:05.920 "w_mbytes_per_sec": 0 00:04:05.920 }, 00:04:05.920 "claimed": false, 00:04:05.920 "zoned": false, 00:04:05.920 "supported_io_types": { 00:04:05.920 "read": true, 00:04:05.920 "write": true, 00:04:05.920 "unmap": true, 00:04:05.920 "write_zeroes": true, 00:04:05.920 "flush": true, 00:04:05.920 "reset": true, 00:04:05.920 "compare": false, 00:04:05.920 "compare_and_write": false, 00:04:05.920 "abort": true, 00:04:05.920 "nvme_admin": false, 00:04:05.920 "nvme_io": false 00:04:05.920 }, 00:04:05.920 "memory_domains": [ 00:04:05.920 { 00:04:05.920 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.920 "dma_device_type": 2 00:04:05.920 } 00:04:05.920 ], 00:04:05.920 "driver_specific": { 00:04:05.920 "passthru": { 00:04:05.920 "name": "Passthru0", 00:04:05.920 "base_bdev_name": "Malloc0" 00:04:05.920 } 00:04:05.920 } 00:04:05.920 } 00:04:05.920 ]' 00:04:05.920 20:09:37 -- rpc/rpc.sh@21 -- # jq length 00:04:05.920 20:09:37 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:05.920 20:09:37 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:05.920 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.920 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.920 20:09:37 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:05.920 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.920 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.920 20:09:37 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:05.920 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.920 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.920 20:09:37 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:05.920 20:09:37 -- rpc/rpc.sh@26 -- # jq length 00:04:05.920 20:09:37 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:05.920 00:04:05.920 real 0m0.269s 00:04:05.920 user 0m0.174s 00:04:05.920 sys 0m0.031s 00:04:05.920 20:09:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:05.920 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 ************************************ 00:04:05.920 END TEST rpc_integrity 00:04:05.920 ************************************ 00:04:05.920 20:09:37 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:05.920 20:09:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:05.920 20:09:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:05.920 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.920 ************************************ 00:04:05.920 START TEST rpc_plugins 00:04:05.920 ************************************ 00:04:05.921 20:09:37 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:04:05.921 20:09:37 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:05.921 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.921 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.921 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.921 20:09:37 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:05.921 20:09:37 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:05.921 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:05.921 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:05.921 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:05.921 20:09:37 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:05.921 { 00:04:05.921 "name": "Malloc1", 00:04:05.921 "aliases": [ 00:04:05.921 "f0d73ad9-6106-4320-b140-1f6a1dabe676" 00:04:05.921 ], 00:04:05.921 "product_name": "Malloc disk", 00:04:05.921 "block_size": 4096, 00:04:05.921 "num_blocks": 256, 00:04:05.921 "uuid": "f0d73ad9-6106-4320-b140-1f6a1dabe676", 00:04:05.921 "assigned_rate_limits": { 00:04:05.921 "rw_ios_per_sec": 0, 00:04:05.921 "rw_mbytes_per_sec": 0, 00:04:05.921 "r_mbytes_per_sec": 0, 00:04:05.921 "w_mbytes_per_sec": 0 00:04:05.921 }, 00:04:05.921 "claimed": false, 00:04:05.921 "zoned": false, 00:04:05.921 "supported_io_types": { 00:04:05.921 "read": true, 00:04:05.921 "write": true, 00:04:05.921 "unmap": true, 00:04:05.921 "write_zeroes": true, 00:04:05.921 "flush": true, 00:04:05.921 "reset": true, 00:04:05.921 "compare": false, 00:04:05.921 "compare_and_write": false, 00:04:05.921 "abort": true, 00:04:05.921 "nvme_admin": false, 00:04:05.921 "nvme_io": false 00:04:05.921 }, 00:04:05.921 "memory_domains": [ 00:04:05.921 { 00:04:05.921 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.921 "dma_device_type": 2 00:04:05.921 } 00:04:05.921 ], 00:04:05.921 "driver_specific": {} 00:04:05.921 } 00:04:05.921 ]' 00:04:05.921 20:09:37 -- rpc/rpc.sh@32 -- # jq length 00:04:06.180 20:09:37 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:06.180 20:09:37 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:06.180 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.180 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:06.180 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.180 20:09:37 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:06.180 20:09:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.180 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:06.180 20:09:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.180 20:09:37 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:06.180 20:09:37 -- rpc/rpc.sh@36 -- # jq length 00:04:06.180 20:09:37 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:06.180 00:04:06.180 real 0m0.142s 00:04:06.180 user 0m0.093s 00:04:06.180 sys 0m0.015s 00:04:06.180 20:09:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:06.180 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:06.180 ************************************ 00:04:06.180 END TEST rpc_plugins 00:04:06.180 ************************************ 00:04:06.180 20:09:37 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:06.180 20:09:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:06.180 20:09:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:06.180 20:09:37 -- common/autotest_common.sh@10 -- # set +x 00:04:06.180 ************************************ 00:04:06.180 START TEST rpc_trace_cmd_test 00:04:06.180 ************************************ 00:04:06.180 20:09:38 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:04:06.180 20:09:38 -- rpc/rpc.sh@40 -- # local info 00:04:06.180 20:09:38 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:06.180 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.180 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.180 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.180 20:09:38 -- rpc/rpc.sh@42 -- # info='{ 00:04:06.180 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3224517", 00:04:06.180 "tpoint_group_mask": "0x8", 00:04:06.180 "iscsi_conn": { 00:04:06.180 "mask": "0x2", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "scsi": { 00:04:06.180 "mask": "0x4", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "bdev": { 00:04:06.180 "mask": "0x8", 00:04:06.180 "tpoint_mask": "0xffffffffffffffff" 00:04:06.180 }, 00:04:06.180 "nvmf_rdma": { 00:04:06.180 "mask": "0x10", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "nvmf_tcp": { 00:04:06.180 "mask": "0x20", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "ftl": { 00:04:06.180 "mask": "0x40", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "blobfs": { 00:04:06.180 "mask": "0x80", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "dsa": { 00:04:06.180 "mask": "0x200", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "thread": { 00:04:06.180 "mask": "0x400", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "nvme_pcie": { 00:04:06.180 "mask": "0x800", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "iaa": { 00:04:06.180 "mask": "0x1000", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "nvme_tcp": { 00:04:06.180 "mask": "0x2000", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 }, 00:04:06.180 "bdev_nvme": { 00:04:06.180 "mask": "0x4000", 00:04:06.180 "tpoint_mask": "0x0" 00:04:06.180 } 00:04:06.180 }' 00:04:06.180 20:09:38 -- rpc/rpc.sh@43 -- # jq length 00:04:06.180 20:09:38 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:06.180 20:09:38 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:06.180 20:09:38 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:06.180 20:09:38 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:06.439 20:09:38 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:06.439 20:09:38 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:06.439 20:09:38 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:06.439 20:09:38 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:06.439 20:09:38 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:06.439 00:04:06.439 real 0m0.227s 00:04:06.439 user 0m0.194s 00:04:06.439 sys 0m0.024s 00:04:06.439 20:09:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:06.439 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.439 ************************************ 00:04:06.439 END TEST rpc_trace_cmd_test 00:04:06.439 ************************************ 00:04:06.439 20:09:38 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:06.439 20:09:38 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:06.439 20:09:38 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:06.439 20:09:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:06.439 20:09:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:06.439 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.439 ************************************ 00:04:06.439 START TEST rpc_daemon_integrity 00:04:06.439 ************************************ 00:04:06.439 20:09:38 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:06.439 20:09:38 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:06.439 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.439 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.439 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.439 20:09:38 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:06.439 20:09:38 -- rpc/rpc.sh@13 -- # jq length 00:04:06.439 20:09:38 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:06.439 20:09:38 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:06.439 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.439 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.439 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.439 20:09:38 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:06.439 20:09:38 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:06.439 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.439 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.439 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.439 20:09:38 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:06.440 { 00:04:06.440 "name": "Malloc2", 00:04:06.440 "aliases": [ 00:04:06.440 "8789af28-8f77-4b26-bb15-76d8d0fcf9b6" 00:04:06.440 ], 00:04:06.440 "product_name": "Malloc disk", 00:04:06.440 "block_size": 512, 00:04:06.440 "num_blocks": 16384, 00:04:06.440 "uuid": "8789af28-8f77-4b26-bb15-76d8d0fcf9b6", 00:04:06.440 "assigned_rate_limits": { 00:04:06.440 "rw_ios_per_sec": 0, 00:04:06.440 "rw_mbytes_per_sec": 0, 00:04:06.440 "r_mbytes_per_sec": 0, 00:04:06.440 "w_mbytes_per_sec": 0 00:04:06.440 }, 00:04:06.440 "claimed": false, 00:04:06.440 "zoned": false, 00:04:06.440 "supported_io_types": { 00:04:06.440 "read": true, 00:04:06.440 "write": true, 00:04:06.440 "unmap": true, 00:04:06.440 "write_zeroes": true, 00:04:06.440 "flush": true, 00:04:06.440 "reset": true, 00:04:06.440 "compare": false, 00:04:06.440 "compare_and_write": false, 00:04:06.440 "abort": true, 00:04:06.440 "nvme_admin": false, 00:04:06.440 "nvme_io": false 00:04:06.440 }, 00:04:06.440 "memory_domains": [ 00:04:06.440 { 00:04:06.440 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:06.440 "dma_device_type": 2 00:04:06.440 } 00:04:06.440 ], 00:04:06.440 "driver_specific": {} 00:04:06.440 } 00:04:06.440 ]' 00:04:06.440 20:09:38 -- rpc/rpc.sh@17 -- # jq length 00:04:06.699 20:09:38 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:06.699 20:09:38 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:06.699 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.699 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.699 [2024-07-22 20:09:38.392591] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:06.699 [2024-07-22 20:09:38.392619] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:06.699 [2024-07-22 20:09:38.392631] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xee6360 00:04:06.699 [2024-07-22 20:09:38.392637] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:06.699 [2024-07-22 20:09:38.393592] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:06.699 [2024-07-22 20:09:38.393611] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:06.699 Passthru0 00:04:06.699 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.699 20:09:38 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:06.699 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.699 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.699 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.699 20:09:38 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:06.699 { 00:04:06.699 "name": "Malloc2", 00:04:06.699 "aliases": [ 00:04:06.699 "8789af28-8f77-4b26-bb15-76d8d0fcf9b6" 00:04:06.699 ], 00:04:06.699 "product_name": "Malloc disk", 00:04:06.699 "block_size": 512, 00:04:06.699 "num_blocks": 16384, 00:04:06.699 "uuid": "8789af28-8f77-4b26-bb15-76d8d0fcf9b6", 00:04:06.699 "assigned_rate_limits": { 00:04:06.699 "rw_ios_per_sec": 0, 00:04:06.699 "rw_mbytes_per_sec": 0, 00:04:06.699 "r_mbytes_per_sec": 0, 00:04:06.699 "w_mbytes_per_sec": 0 00:04:06.699 }, 00:04:06.699 "claimed": true, 00:04:06.699 "claim_type": "exclusive_write", 00:04:06.699 "zoned": false, 00:04:06.699 "supported_io_types": { 00:04:06.699 "read": true, 00:04:06.699 "write": true, 00:04:06.699 "unmap": true, 00:04:06.699 "write_zeroes": true, 00:04:06.699 "flush": true, 00:04:06.699 "reset": true, 00:04:06.699 "compare": false, 00:04:06.699 "compare_and_write": false, 00:04:06.699 "abort": true, 00:04:06.699 "nvme_admin": false, 00:04:06.699 "nvme_io": false 00:04:06.699 }, 00:04:06.699 "memory_domains": [ 00:04:06.699 { 00:04:06.699 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:06.699 "dma_device_type": 2 00:04:06.699 } 00:04:06.699 ], 00:04:06.699 "driver_specific": {} 00:04:06.699 }, 00:04:06.699 { 00:04:06.699 "name": "Passthru0", 00:04:06.699 "aliases": [ 00:04:06.699 "8d79acd4-40aa-55bd-8805-527222830a4e" 00:04:06.699 ], 00:04:06.699 "product_name": "passthru", 00:04:06.699 "block_size": 512, 00:04:06.699 "num_blocks": 16384, 00:04:06.699 "uuid": "8d79acd4-40aa-55bd-8805-527222830a4e", 00:04:06.699 "assigned_rate_limits": { 00:04:06.699 "rw_ios_per_sec": 0, 00:04:06.699 "rw_mbytes_per_sec": 0, 00:04:06.699 "r_mbytes_per_sec": 0, 00:04:06.699 "w_mbytes_per_sec": 0 00:04:06.699 }, 00:04:06.699 "claimed": false, 00:04:06.699 "zoned": false, 00:04:06.699 "supported_io_types": { 00:04:06.699 "read": true, 00:04:06.699 "write": true, 00:04:06.699 "unmap": true, 00:04:06.699 "write_zeroes": true, 00:04:06.699 "flush": true, 00:04:06.699 "reset": true, 00:04:06.699 "compare": false, 00:04:06.699 "compare_and_write": false, 00:04:06.699 "abort": true, 00:04:06.699 "nvme_admin": false, 00:04:06.700 "nvme_io": false 00:04:06.700 }, 00:04:06.700 "memory_domains": [ 00:04:06.700 { 00:04:06.700 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:06.700 "dma_device_type": 2 00:04:06.700 } 00:04:06.700 ], 00:04:06.700 "driver_specific": { 00:04:06.700 "passthru": { 00:04:06.700 "name": "Passthru0", 00:04:06.700 "base_bdev_name": "Malloc2" 00:04:06.700 } 00:04:06.700 } 00:04:06.700 } 00:04:06.700 ]' 00:04:06.700 20:09:38 -- rpc/rpc.sh@21 -- # jq length 00:04:06.700 20:09:38 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:06.700 20:09:38 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:06.700 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.700 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.700 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.700 20:09:38 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:06.700 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.700 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.700 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.700 20:09:38 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:06.700 20:09:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.700 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.700 20:09:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.700 20:09:38 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:06.700 20:09:38 -- rpc/rpc.sh@26 -- # jq length 00:04:06.700 20:09:38 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:06.700 00:04:06.700 real 0m0.265s 00:04:06.700 user 0m0.173s 00:04:06.700 sys 0m0.031s 00:04:06.700 20:09:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:06.700 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:06.700 ************************************ 00:04:06.700 END TEST rpc_daemon_integrity 00:04:06.700 ************************************ 00:04:06.700 20:09:38 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:06.700 20:09:38 -- rpc/rpc.sh@84 -- # killprocess 3224517 00:04:06.700 20:09:38 -- common/autotest_common.sh@926 -- # '[' -z 3224517 ']' 00:04:06.700 20:09:38 -- common/autotest_common.sh@930 -- # kill -0 3224517 00:04:06.700 20:09:38 -- common/autotest_common.sh@931 -- # uname 00:04:06.700 20:09:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:06.700 20:09:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3224517 00:04:06.700 20:09:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:06.700 20:09:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:06.700 20:09:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3224517' 00:04:06.700 killing process with pid 3224517 00:04:06.700 20:09:38 -- common/autotest_common.sh@945 -- # kill 3224517 00:04:06.700 20:09:38 -- common/autotest_common.sh@950 -- # wait 3224517 00:04:07.269 00:04:07.269 real 0m2.355s 00:04:07.269 user 0m3.040s 00:04:07.269 sys 0m0.590s 00:04:07.269 20:09:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:07.269 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:07.269 ************************************ 00:04:07.269 END TEST rpc 00:04:07.269 ************************************ 00:04:07.269 20:09:38 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:07.269 20:09:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:07.269 20:09:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:07.269 20:09:38 -- common/autotest_common.sh@10 -- # set +x 00:04:07.269 ************************************ 00:04:07.269 START TEST rpc_client 00:04:07.269 ************************************ 00:04:07.269 20:09:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:07.269 * Looking for test storage... 00:04:07.269 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:07.269 20:09:39 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:07.269 OK 00:04:07.269 20:09:39 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:07.269 00:04:07.269 real 0m0.103s 00:04:07.269 user 0m0.040s 00:04:07.269 sys 0m0.070s 00:04:07.269 20:09:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:07.269 20:09:39 -- common/autotest_common.sh@10 -- # set +x 00:04:07.269 ************************************ 00:04:07.269 END TEST rpc_client 00:04:07.269 ************************************ 00:04:07.269 20:09:39 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:07.269 20:09:39 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:07.269 20:09:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:07.269 20:09:39 -- common/autotest_common.sh@10 -- # set +x 00:04:07.269 ************************************ 00:04:07.269 START TEST json_config 00:04:07.269 ************************************ 00:04:07.269 20:09:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:07.269 20:09:39 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:07.269 20:09:39 -- nvmf/common.sh@7 -- # uname -s 00:04:07.269 20:09:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:07.269 20:09:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:07.269 20:09:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:07.269 20:09:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:07.269 20:09:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:07.269 20:09:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:07.269 20:09:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:07.269 20:09:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:07.269 20:09:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:07.269 20:09:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:07.269 20:09:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:04:07.269 20:09:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:04:07.269 20:09:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:07.269 20:09:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:07.269 20:09:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:07.269 20:09:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:07.269 20:09:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:07.269 20:09:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:07.269 20:09:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:07.269 20:09:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:07.269 20:09:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:07.269 20:09:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:07.269 20:09:39 -- paths/export.sh@5 -- # export PATH 00:04:07.269 20:09:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:07.269 20:09:39 -- nvmf/common.sh@46 -- # : 0 00:04:07.269 20:09:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:07.269 20:09:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:07.269 20:09:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:07.269 20:09:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:07.269 20:09:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:07.269 20:09:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:07.269 20:09:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:07.269 20:09:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:07.269 20:09:39 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:07.269 20:09:39 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:07.269 20:09:39 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:07.269 20:09:39 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:07.269 20:09:39 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:07.269 20:09:39 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:07.269 20:09:39 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:07.269 20:09:39 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:07.269 20:09:39 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:07.269 20:09:39 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:07.269 20:09:39 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:07.269 20:09:39 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:07.270 20:09:39 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:07.529 20:09:39 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:07.529 20:09:39 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:07.529 INFO: JSON configuration test init 00:04:07.529 20:09:39 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:07.529 20:09:39 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:07.529 20:09:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:07.529 20:09:39 -- common/autotest_common.sh@10 -- # set +x 00:04:07.529 20:09:39 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:07.529 20:09:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:07.529 20:09:39 -- common/autotest_common.sh@10 -- # set +x 00:04:07.529 20:09:39 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:07.529 20:09:39 -- json_config/json_config.sh@98 -- # local app=target 00:04:07.529 20:09:39 -- json_config/json_config.sh@99 -- # shift 00:04:07.529 20:09:39 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:07.529 20:09:39 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:07.529 20:09:39 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:07.529 20:09:39 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:07.529 20:09:39 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:07.529 20:09:39 -- json_config/json_config.sh@111 -- # app_pid[$app]=3225184 00:04:07.529 20:09:39 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:07.529 Waiting for target to run... 00:04:07.529 20:09:39 -- json_config/json_config.sh@114 -- # waitforlisten 3225184 /var/tmp/spdk_tgt.sock 00:04:07.529 20:09:39 -- common/autotest_common.sh@819 -- # '[' -z 3225184 ']' 00:04:07.529 20:09:39 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:07.529 20:09:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:07.529 20:09:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:07.529 20:09:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:07.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:07.529 20:09:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:07.529 20:09:39 -- common/autotest_common.sh@10 -- # set +x 00:04:07.529 [2024-07-22 20:09:39.264779] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:07.529 [2024-07-22 20:09:39.264827] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3225184 ] 00:04:07.529 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.788 [2024-07-22 20:09:39.527800] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:07.788 [2024-07-22 20:09:39.594057] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:07.788 [2024-07-22 20:09:39.594169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:08.356 20:09:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:08.356 20:09:40 -- common/autotest_common.sh@852 -- # return 0 00:04:08.356 20:09:40 -- json_config/json_config.sh@115 -- # echo '' 00:04:08.356 00:04:08.356 20:09:40 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:08.356 20:09:40 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:08.356 20:09:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:08.356 20:09:40 -- common/autotest_common.sh@10 -- # set +x 00:04:08.356 20:09:40 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:08.356 20:09:40 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:08.356 20:09:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:08.356 20:09:40 -- common/autotest_common.sh@10 -- # set +x 00:04:08.356 20:09:40 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:08.356 20:09:40 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:08.356 20:09:40 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:11.645 20:09:43 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:11.646 20:09:43 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:11.646 20:09:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:11.646 20:09:43 -- common/autotest_common.sh@10 -- # set +x 00:04:11.646 20:09:43 -- json_config/json_config.sh@48 -- # local ret=0 00:04:11.646 20:09:43 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:11.646 20:09:43 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:11.646 20:09:43 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:11.646 20:09:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:11.646 20:09:43 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:11.646 20:09:43 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:11.646 20:09:43 -- json_config/json_config.sh@51 -- # local get_types 00:04:11.646 20:09:43 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:11.646 20:09:43 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:11.646 20:09:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:11.646 20:09:43 -- common/autotest_common.sh@10 -- # set +x 00:04:11.646 20:09:43 -- json_config/json_config.sh@58 -- # return 0 00:04:11.646 20:09:43 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:11.646 20:09:43 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:11.646 20:09:43 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:11.646 20:09:43 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:11.646 20:09:43 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:11.646 20:09:43 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:11.646 20:09:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:11.646 20:09:43 -- common/autotest_common.sh@10 -- # set +x 00:04:11.646 20:09:43 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:11.646 20:09:43 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:11.646 20:09:43 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:11.646 20:09:43 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:11.646 20:09:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:11.646 MallocForNvmf0 00:04:11.646 20:09:43 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:11.646 20:09:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:11.905 MallocForNvmf1 00:04:11.905 20:09:43 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:11.905 20:09:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:12.164 [2024-07-22 20:09:43.860482] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:12.164 20:09:43 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:12.164 20:09:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:12.164 20:09:44 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:12.164 20:09:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:12.422 20:09:44 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:12.422 20:09:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:12.682 20:09:44 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:12.682 20:09:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:12.682 [2024-07-22 20:09:44.542645] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:12.682 20:09:44 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:12.682 20:09:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:12.682 20:09:44 -- common/autotest_common.sh@10 -- # set +x 00:04:12.682 20:09:44 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:12.682 20:09:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:12.682 20:09:44 -- common/autotest_common.sh@10 -- # set +x 00:04:12.941 20:09:44 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:12.941 20:09:44 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:12.941 20:09:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:12.941 MallocBdevForConfigChangeCheck 00:04:12.941 20:09:44 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:12.941 20:09:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:12.941 20:09:44 -- common/autotest_common.sh@10 -- # set +x 00:04:12.941 20:09:44 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:12.941 20:09:44 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:13.200 20:09:45 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:13.200 INFO: shutting down applications... 00:04:13.200 20:09:45 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:13.200 20:09:45 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:13.201 20:09:45 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:13.201 20:09:45 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:15.104 Calling clear_iscsi_subsystem 00:04:15.104 Calling clear_nvmf_subsystem 00:04:15.104 Calling clear_nbd_subsystem 00:04:15.104 Calling clear_ublk_subsystem 00:04:15.104 Calling clear_vhost_blk_subsystem 00:04:15.104 Calling clear_vhost_scsi_subsystem 00:04:15.104 Calling clear_scheduler_subsystem 00:04:15.104 Calling clear_bdev_subsystem 00:04:15.104 Calling clear_accel_subsystem 00:04:15.104 Calling clear_vmd_subsystem 00:04:15.104 Calling clear_sock_subsystem 00:04:15.104 Calling clear_iobuf_subsystem 00:04:15.104 20:09:46 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:15.104 20:09:46 -- json_config/json_config.sh@396 -- # count=100 00:04:15.104 20:09:46 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:15.104 20:09:46 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:15.104 20:09:46 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:15.104 20:09:46 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:15.104 20:09:47 -- json_config/json_config.sh@398 -- # break 00:04:15.104 20:09:47 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:15.104 20:09:47 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:15.104 20:09:47 -- json_config/json_config.sh@120 -- # local app=target 00:04:15.104 20:09:47 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:15.104 20:09:47 -- json_config/json_config.sh@124 -- # [[ -n 3225184 ]] 00:04:15.104 20:09:47 -- json_config/json_config.sh@127 -- # kill -SIGINT 3225184 00:04:15.104 20:09:47 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:15.104 20:09:47 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:15.104 20:09:47 -- json_config/json_config.sh@130 -- # kill -0 3225184 00:04:15.104 20:09:47 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:15.734 20:09:47 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:15.734 20:09:47 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:15.734 20:09:47 -- json_config/json_config.sh@130 -- # kill -0 3225184 00:04:15.734 20:09:47 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:15.734 20:09:47 -- json_config/json_config.sh@132 -- # break 00:04:15.734 20:09:47 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:15.734 20:09:47 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:15.734 SPDK target shutdown done 00:04:15.734 20:09:47 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:15.734 INFO: relaunching applications... 00:04:15.734 20:09:47 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:15.734 20:09:47 -- json_config/json_config.sh@98 -- # local app=target 00:04:15.734 20:09:47 -- json_config/json_config.sh@99 -- # shift 00:04:15.734 20:09:47 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:15.734 20:09:47 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:15.734 20:09:47 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:15.734 20:09:47 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:15.734 20:09:47 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:15.734 20:09:47 -- json_config/json_config.sh@111 -- # app_pid[$app]=3226709 00:04:15.734 20:09:47 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:15.734 Waiting for target to run... 00:04:15.734 20:09:47 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:15.734 20:09:47 -- json_config/json_config.sh@114 -- # waitforlisten 3226709 /var/tmp/spdk_tgt.sock 00:04:15.734 20:09:47 -- common/autotest_common.sh@819 -- # '[' -z 3226709 ']' 00:04:15.734 20:09:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:15.734 20:09:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:15.734 20:09:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:15.734 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:15.734 20:09:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:15.734 20:09:47 -- common/autotest_common.sh@10 -- # set +x 00:04:15.734 [2024-07-22 20:09:47.565515] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:15.734 [2024-07-22 20:09:47.565568] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3226709 ] 00:04:15.734 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.994 [2024-07-22 20:09:47.837442] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:15.994 [2024-07-22 20:09:47.903370] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:15.994 [2024-07-22 20:09:47.903472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:19.284 [2024-07-22 20:09:50.907029] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:19.284 [2024-07-22 20:09:50.939344] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:19.284 20:09:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:19.284 20:09:51 -- common/autotest_common.sh@852 -- # return 0 00:04:19.284 20:09:51 -- json_config/json_config.sh@115 -- # echo '' 00:04:19.284 00:04:19.284 20:09:51 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:19.284 20:09:51 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:19.284 INFO: Checking if target configuration is the same... 00:04:19.284 20:09:51 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:19.284 20:09:51 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.284 20:09:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:19.284 + '[' 2 -ne 2 ']' 00:04:19.284 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:19.284 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:19.284 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:19.284 +++ basename /dev/fd/62 00:04:19.284 ++ mktemp /tmp/62.XXX 00:04:19.284 + tmp_file_1=/tmp/62.XjR 00:04:19.284 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.284 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:19.284 + tmp_file_2=/tmp/spdk_tgt_config.json.DDd 00:04:19.284 + ret=0 00:04:19.284 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:19.543 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:19.543 + diff -u /tmp/62.XjR /tmp/spdk_tgt_config.json.DDd 00:04:19.543 + echo 'INFO: JSON config files are the same' 00:04:19.543 INFO: JSON config files are the same 00:04:19.543 + rm /tmp/62.XjR /tmp/spdk_tgt_config.json.DDd 00:04:19.543 + exit 0 00:04:19.543 20:09:51 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:19.543 20:09:51 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:19.543 INFO: changing configuration and checking if this can be detected... 00:04:19.543 20:09:51 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:19.543 20:09:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:19.801 20:09:51 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.801 20:09:51 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:19.801 20:09:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:19.802 + '[' 2 -ne 2 ']' 00:04:19.802 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:19.802 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:19.802 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:19.802 +++ basename /dev/fd/62 00:04:19.802 ++ mktemp /tmp/62.XXX 00:04:19.802 + tmp_file_1=/tmp/62.0YE 00:04:19.802 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.802 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:19.802 + tmp_file_2=/tmp/spdk_tgt_config.json.R2i 00:04:19.802 + ret=0 00:04:19.802 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.061 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.061 + diff -u /tmp/62.0YE /tmp/spdk_tgt_config.json.R2i 00:04:20.061 + ret=1 00:04:20.061 + echo '=== Start of file: /tmp/62.0YE ===' 00:04:20.061 + cat /tmp/62.0YE 00:04:20.061 + echo '=== End of file: /tmp/62.0YE ===' 00:04:20.061 + echo '' 00:04:20.061 + echo '=== Start of file: /tmp/spdk_tgt_config.json.R2i ===' 00:04:20.061 + cat /tmp/spdk_tgt_config.json.R2i 00:04:20.061 + echo '=== End of file: /tmp/spdk_tgt_config.json.R2i ===' 00:04:20.061 + echo '' 00:04:20.061 + rm /tmp/62.0YE /tmp/spdk_tgt_config.json.R2i 00:04:20.061 + exit 1 00:04:20.061 20:09:51 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:20.061 INFO: configuration change detected. 00:04:20.061 20:09:51 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:20.061 20:09:51 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:20.061 20:09:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:20.061 20:09:51 -- common/autotest_common.sh@10 -- # set +x 00:04:20.061 20:09:51 -- json_config/json_config.sh@360 -- # local ret=0 00:04:20.061 20:09:51 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:20.061 20:09:51 -- json_config/json_config.sh@370 -- # [[ -n 3226709 ]] 00:04:20.061 20:09:51 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:20.061 20:09:51 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:20.061 20:09:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:20.061 20:09:51 -- common/autotest_common.sh@10 -- # set +x 00:04:20.061 20:09:51 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:20.061 20:09:51 -- json_config/json_config.sh@246 -- # uname -s 00:04:20.061 20:09:51 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:20.061 20:09:51 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:20.061 20:09:51 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:20.061 20:09:51 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:20.061 20:09:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:20.061 20:09:51 -- common/autotest_common.sh@10 -- # set +x 00:04:20.061 20:09:51 -- json_config/json_config.sh@376 -- # killprocess 3226709 00:04:20.061 20:09:51 -- common/autotest_common.sh@926 -- # '[' -z 3226709 ']' 00:04:20.061 20:09:51 -- common/autotest_common.sh@930 -- # kill -0 3226709 00:04:20.061 20:09:51 -- common/autotest_common.sh@931 -- # uname 00:04:20.061 20:09:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:20.061 20:09:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3226709 00:04:20.061 20:09:51 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:20.061 20:09:51 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:20.061 20:09:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3226709' 00:04:20.061 killing process with pid 3226709 00:04:20.061 20:09:51 -- common/autotest_common.sh@945 -- # kill 3226709 00:04:20.061 20:09:51 -- common/autotest_common.sh@950 -- # wait 3226709 00:04:21.969 20:09:53 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:21.969 20:09:53 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:21.969 20:09:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:21.969 20:09:53 -- common/autotest_common.sh@10 -- # set +x 00:04:21.969 20:09:53 -- json_config/json_config.sh@381 -- # return 0 00:04:21.969 20:09:53 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:21.969 INFO: Success 00:04:21.969 00:04:21.969 real 0m14.380s 00:04:21.969 user 0m15.569s 00:04:21.969 sys 0m1.741s 00:04:21.969 20:09:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:21.969 20:09:53 -- common/autotest_common.sh@10 -- # set +x 00:04:21.969 ************************************ 00:04:21.969 END TEST json_config 00:04:21.969 ************************************ 00:04:21.969 20:09:53 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:21.969 20:09:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:21.969 20:09:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:21.969 20:09:53 -- common/autotest_common.sh@10 -- # set +x 00:04:21.969 ************************************ 00:04:21.969 START TEST json_config_extra_key 00:04:21.969 ************************************ 00:04:21.969 20:09:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:21.969 20:09:53 -- nvmf/common.sh@7 -- # uname -s 00:04:21.969 20:09:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:21.969 20:09:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:21.969 20:09:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:21.969 20:09:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:21.969 20:09:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:21.969 20:09:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:21.969 20:09:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:21.969 20:09:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:21.969 20:09:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:21.969 20:09:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:21.969 20:09:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:04:21.969 20:09:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:04:21.969 20:09:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:21.969 20:09:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:21.969 20:09:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:21.969 20:09:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:21.969 20:09:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:21.969 20:09:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:21.969 20:09:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:21.969 20:09:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:21.969 20:09:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:21.969 20:09:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:21.969 20:09:53 -- paths/export.sh@5 -- # export PATH 00:04:21.969 20:09:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:21.969 20:09:53 -- nvmf/common.sh@46 -- # : 0 00:04:21.969 20:09:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:21.969 20:09:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:21.969 20:09:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:21.969 20:09:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:21.969 20:09:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:21.969 20:09:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:21.969 20:09:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:21.969 20:09:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:21.969 INFO: launching applications... 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:21.969 20:09:53 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3227772 00:04:21.970 20:09:53 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:21.970 Waiting for target to run... 00:04:21.970 20:09:53 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3227772 /var/tmp/spdk_tgt.sock 00:04:21.970 20:09:53 -- common/autotest_common.sh@819 -- # '[' -z 3227772 ']' 00:04:21.970 20:09:53 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:21.970 20:09:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:21.970 20:09:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:21.970 20:09:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:21.970 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:21.970 20:09:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:21.970 20:09:53 -- common/autotest_common.sh@10 -- # set +x 00:04:21.970 [2024-07-22 20:09:53.666107] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:21.970 [2024-07-22 20:09:53.666156] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3227772 ] 00:04:21.970 EAL: No free 2048 kB hugepages reported on node 1 00:04:22.229 [2024-07-22 20:09:53.934703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:22.229 [2024-07-22 20:09:54.002050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:22.229 [2024-07-22 20:09:54.002162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:22.797 20:09:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:22.797 20:09:54 -- common/autotest_common.sh@852 -- # return 0 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:22.797 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:22.797 INFO: shutting down applications... 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3227772 ]] 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3227772 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3227772 00:04:22.797 20:09:54 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:23.057 20:09:54 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:23.057 20:09:54 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:23.057 20:09:54 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3227772 00:04:23.057 20:09:54 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:23.057 20:09:54 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:23.057 20:09:54 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:23.057 20:09:54 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:23.057 SPDK target shutdown done 00:04:23.057 20:09:54 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:23.057 Success 00:04:23.057 00:04:23.057 real 0m1.430s 00:04:23.057 user 0m1.249s 00:04:23.057 sys 0m0.344s 00:04:23.057 20:09:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:23.057 20:09:54 -- common/autotest_common.sh@10 -- # set +x 00:04:23.057 ************************************ 00:04:23.057 END TEST json_config_extra_key 00:04:23.057 ************************************ 00:04:23.316 20:09:54 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:23.316 20:09:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:23.316 20:09:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:23.316 20:09:54 -- common/autotest_common.sh@10 -- # set +x 00:04:23.316 ************************************ 00:04:23.316 START TEST alias_rpc 00:04:23.316 ************************************ 00:04:23.316 20:09:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:23.316 * Looking for test storage... 00:04:23.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:23.316 20:09:55 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:23.316 20:09:55 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3228085 00:04:23.316 20:09:55 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3228085 00:04:23.316 20:09:55 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:23.316 20:09:55 -- common/autotest_common.sh@819 -- # '[' -z 3228085 ']' 00:04:23.316 20:09:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:23.316 20:09:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:23.316 20:09:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:23.316 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:23.316 20:09:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:23.316 20:09:55 -- common/autotest_common.sh@10 -- # set +x 00:04:23.316 [2024-07-22 20:09:55.126448] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:23.316 [2024-07-22 20:09:55.126501] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3228085 ] 00:04:23.316 EAL: No free 2048 kB hugepages reported on node 1 00:04:23.316 [2024-07-22 20:09:55.179637] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:23.575 [2024-07-22 20:09:55.258445] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:23.575 [2024-07-22 20:09:55.258554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:24.143 20:09:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:24.143 20:09:55 -- common/autotest_common.sh@852 -- # return 0 00:04:24.143 20:09:55 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:24.403 20:09:56 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3228085 00:04:24.403 20:09:56 -- common/autotest_common.sh@926 -- # '[' -z 3228085 ']' 00:04:24.403 20:09:56 -- common/autotest_common.sh@930 -- # kill -0 3228085 00:04:24.403 20:09:56 -- common/autotest_common.sh@931 -- # uname 00:04:24.403 20:09:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:24.403 20:09:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3228085 00:04:24.403 20:09:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:24.403 20:09:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:24.403 20:09:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3228085' 00:04:24.403 killing process with pid 3228085 00:04:24.403 20:09:56 -- common/autotest_common.sh@945 -- # kill 3228085 00:04:24.403 20:09:56 -- common/autotest_common.sh@950 -- # wait 3228085 00:04:24.662 00:04:24.662 real 0m1.498s 00:04:24.662 user 0m1.659s 00:04:24.662 sys 0m0.375s 00:04:24.662 20:09:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:24.662 20:09:56 -- common/autotest_common.sh@10 -- # set +x 00:04:24.662 ************************************ 00:04:24.662 END TEST alias_rpc 00:04:24.662 ************************************ 00:04:24.662 20:09:56 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:04:24.662 20:09:56 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:24.662 20:09:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:24.662 20:09:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:24.662 20:09:56 -- common/autotest_common.sh@10 -- # set +x 00:04:24.662 ************************************ 00:04:24.662 START TEST spdkcli_tcp 00:04:24.662 ************************************ 00:04:24.662 20:09:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:24.921 * Looking for test storage... 00:04:24.921 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:24.921 20:09:56 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:24.921 20:09:56 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:24.922 20:09:56 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:24.922 20:09:56 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:24.922 20:09:56 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:24.922 20:09:56 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:24.922 20:09:56 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:24.922 20:09:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:24.922 20:09:56 -- common/autotest_common.sh@10 -- # set +x 00:04:24.922 20:09:56 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:24.922 20:09:56 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3228480 00:04:24.922 20:09:56 -- spdkcli/tcp.sh@27 -- # waitforlisten 3228480 00:04:24.922 20:09:56 -- common/autotest_common.sh@819 -- # '[' -z 3228480 ']' 00:04:24.922 20:09:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:24.922 20:09:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:24.922 20:09:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:24.922 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:24.922 20:09:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:24.922 20:09:56 -- common/autotest_common.sh@10 -- # set +x 00:04:24.922 [2024-07-22 20:09:56.649807] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:24.922 [2024-07-22 20:09:56.649857] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3228480 ] 00:04:24.922 EAL: No free 2048 kB hugepages reported on node 1 00:04:24.922 [2024-07-22 20:09:56.703732] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:24.922 [2024-07-22 20:09:56.783780] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:24.922 [2024-07-22 20:09:56.783921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:24.922 [2024-07-22 20:09:56.783923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.860 20:09:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:25.860 20:09:57 -- common/autotest_common.sh@852 -- # return 0 00:04:25.860 20:09:57 -- spdkcli/tcp.sh@31 -- # socat_pid=3228575 00:04:25.860 20:09:57 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:25.860 20:09:57 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:25.860 [ 00:04:25.860 "bdev_malloc_delete", 00:04:25.860 "bdev_malloc_create", 00:04:25.860 "bdev_null_resize", 00:04:25.860 "bdev_null_delete", 00:04:25.860 "bdev_null_create", 00:04:25.860 "bdev_nvme_cuse_unregister", 00:04:25.860 "bdev_nvme_cuse_register", 00:04:25.860 "bdev_opal_new_user", 00:04:25.860 "bdev_opal_set_lock_state", 00:04:25.860 "bdev_opal_delete", 00:04:25.860 "bdev_opal_get_info", 00:04:25.860 "bdev_opal_create", 00:04:25.860 "bdev_nvme_opal_revert", 00:04:25.860 "bdev_nvme_opal_init", 00:04:25.860 "bdev_nvme_send_cmd", 00:04:25.860 "bdev_nvme_get_path_iostat", 00:04:25.860 "bdev_nvme_get_mdns_discovery_info", 00:04:25.860 "bdev_nvme_stop_mdns_discovery", 00:04:25.860 "bdev_nvme_start_mdns_discovery", 00:04:25.860 "bdev_nvme_set_multipath_policy", 00:04:25.860 "bdev_nvme_set_preferred_path", 00:04:25.860 "bdev_nvme_get_io_paths", 00:04:25.860 "bdev_nvme_remove_error_injection", 00:04:25.860 "bdev_nvme_add_error_injection", 00:04:25.860 "bdev_nvme_get_discovery_info", 00:04:25.860 "bdev_nvme_stop_discovery", 00:04:25.860 "bdev_nvme_start_discovery", 00:04:25.860 "bdev_nvme_get_controller_health_info", 00:04:25.860 "bdev_nvme_disable_controller", 00:04:25.860 "bdev_nvme_enable_controller", 00:04:25.860 "bdev_nvme_reset_controller", 00:04:25.860 "bdev_nvme_get_transport_statistics", 00:04:25.860 "bdev_nvme_apply_firmware", 00:04:25.860 "bdev_nvme_detach_controller", 00:04:25.860 "bdev_nvme_get_controllers", 00:04:25.860 "bdev_nvme_attach_controller", 00:04:25.860 "bdev_nvme_set_hotplug", 00:04:25.860 "bdev_nvme_set_options", 00:04:25.860 "bdev_passthru_delete", 00:04:25.860 "bdev_passthru_create", 00:04:25.860 "bdev_lvol_grow_lvstore", 00:04:25.860 "bdev_lvol_get_lvols", 00:04:25.860 "bdev_lvol_get_lvstores", 00:04:25.860 "bdev_lvol_delete", 00:04:25.860 "bdev_lvol_set_read_only", 00:04:25.860 "bdev_lvol_resize", 00:04:25.860 "bdev_lvol_decouple_parent", 00:04:25.860 "bdev_lvol_inflate", 00:04:25.860 "bdev_lvol_rename", 00:04:25.860 "bdev_lvol_clone_bdev", 00:04:25.860 "bdev_lvol_clone", 00:04:25.860 "bdev_lvol_snapshot", 00:04:25.860 "bdev_lvol_create", 00:04:25.860 "bdev_lvol_delete_lvstore", 00:04:25.860 "bdev_lvol_rename_lvstore", 00:04:25.860 "bdev_lvol_create_lvstore", 00:04:25.860 "bdev_raid_set_options", 00:04:25.860 "bdev_raid_remove_base_bdev", 00:04:25.860 "bdev_raid_add_base_bdev", 00:04:25.860 "bdev_raid_delete", 00:04:25.860 "bdev_raid_create", 00:04:25.860 "bdev_raid_get_bdevs", 00:04:25.860 "bdev_error_inject_error", 00:04:25.860 "bdev_error_delete", 00:04:25.860 "bdev_error_create", 00:04:25.860 "bdev_split_delete", 00:04:25.860 "bdev_split_create", 00:04:25.860 "bdev_delay_delete", 00:04:25.860 "bdev_delay_create", 00:04:25.860 "bdev_delay_update_latency", 00:04:25.860 "bdev_zone_block_delete", 00:04:25.860 "bdev_zone_block_create", 00:04:25.860 "blobfs_create", 00:04:25.860 "blobfs_detect", 00:04:25.860 "blobfs_set_cache_size", 00:04:25.860 "bdev_aio_delete", 00:04:25.860 "bdev_aio_rescan", 00:04:25.860 "bdev_aio_create", 00:04:25.860 "bdev_ftl_set_property", 00:04:25.860 "bdev_ftl_get_properties", 00:04:25.860 "bdev_ftl_get_stats", 00:04:25.860 "bdev_ftl_unmap", 00:04:25.861 "bdev_ftl_unload", 00:04:25.861 "bdev_ftl_delete", 00:04:25.861 "bdev_ftl_load", 00:04:25.861 "bdev_ftl_create", 00:04:25.861 "bdev_virtio_attach_controller", 00:04:25.861 "bdev_virtio_scsi_get_devices", 00:04:25.861 "bdev_virtio_detach_controller", 00:04:25.861 "bdev_virtio_blk_set_hotplug", 00:04:25.861 "bdev_iscsi_delete", 00:04:25.861 "bdev_iscsi_create", 00:04:25.861 "bdev_iscsi_set_options", 00:04:25.861 "accel_error_inject_error", 00:04:25.861 "ioat_scan_accel_module", 00:04:25.861 "dsa_scan_accel_module", 00:04:25.861 "iaa_scan_accel_module", 00:04:25.861 "iscsi_set_options", 00:04:25.861 "iscsi_get_auth_groups", 00:04:25.861 "iscsi_auth_group_remove_secret", 00:04:25.861 "iscsi_auth_group_add_secret", 00:04:25.861 "iscsi_delete_auth_group", 00:04:25.861 "iscsi_create_auth_group", 00:04:25.861 "iscsi_set_discovery_auth", 00:04:25.861 "iscsi_get_options", 00:04:25.861 "iscsi_target_node_request_logout", 00:04:25.861 "iscsi_target_node_set_redirect", 00:04:25.861 "iscsi_target_node_set_auth", 00:04:25.861 "iscsi_target_node_add_lun", 00:04:25.861 "iscsi_get_connections", 00:04:25.861 "iscsi_portal_group_set_auth", 00:04:25.861 "iscsi_start_portal_group", 00:04:25.861 "iscsi_delete_portal_group", 00:04:25.861 "iscsi_create_portal_group", 00:04:25.861 "iscsi_get_portal_groups", 00:04:25.861 "iscsi_delete_target_node", 00:04:25.861 "iscsi_target_node_remove_pg_ig_maps", 00:04:25.861 "iscsi_target_node_add_pg_ig_maps", 00:04:25.861 "iscsi_create_target_node", 00:04:25.861 "iscsi_get_target_nodes", 00:04:25.861 "iscsi_delete_initiator_group", 00:04:25.861 "iscsi_initiator_group_remove_initiators", 00:04:25.861 "iscsi_initiator_group_add_initiators", 00:04:25.861 "iscsi_create_initiator_group", 00:04:25.861 "iscsi_get_initiator_groups", 00:04:25.861 "nvmf_set_crdt", 00:04:25.861 "nvmf_set_config", 00:04:25.861 "nvmf_set_max_subsystems", 00:04:25.861 "nvmf_subsystem_get_listeners", 00:04:25.861 "nvmf_subsystem_get_qpairs", 00:04:25.861 "nvmf_subsystem_get_controllers", 00:04:25.861 "nvmf_get_stats", 00:04:25.861 "nvmf_get_transports", 00:04:25.861 "nvmf_create_transport", 00:04:25.861 "nvmf_get_targets", 00:04:25.861 "nvmf_delete_target", 00:04:25.861 "nvmf_create_target", 00:04:25.861 "nvmf_subsystem_allow_any_host", 00:04:25.861 "nvmf_subsystem_remove_host", 00:04:25.861 "nvmf_subsystem_add_host", 00:04:25.861 "nvmf_subsystem_remove_ns", 00:04:25.861 "nvmf_subsystem_add_ns", 00:04:25.861 "nvmf_subsystem_listener_set_ana_state", 00:04:25.861 "nvmf_discovery_get_referrals", 00:04:25.861 "nvmf_discovery_remove_referral", 00:04:25.861 "nvmf_discovery_add_referral", 00:04:25.861 "nvmf_subsystem_remove_listener", 00:04:25.861 "nvmf_subsystem_add_listener", 00:04:25.861 "nvmf_delete_subsystem", 00:04:25.861 "nvmf_create_subsystem", 00:04:25.861 "nvmf_get_subsystems", 00:04:25.861 "env_dpdk_get_mem_stats", 00:04:25.861 "nbd_get_disks", 00:04:25.861 "nbd_stop_disk", 00:04:25.861 "nbd_start_disk", 00:04:25.861 "ublk_recover_disk", 00:04:25.861 "ublk_get_disks", 00:04:25.861 "ublk_stop_disk", 00:04:25.861 "ublk_start_disk", 00:04:25.861 "ublk_destroy_target", 00:04:25.861 "ublk_create_target", 00:04:25.861 "virtio_blk_create_transport", 00:04:25.861 "virtio_blk_get_transports", 00:04:25.861 "vhost_controller_set_coalescing", 00:04:25.861 "vhost_get_controllers", 00:04:25.861 "vhost_delete_controller", 00:04:25.861 "vhost_create_blk_controller", 00:04:25.861 "vhost_scsi_controller_remove_target", 00:04:25.861 "vhost_scsi_controller_add_target", 00:04:25.861 "vhost_start_scsi_controller", 00:04:25.861 "vhost_create_scsi_controller", 00:04:25.861 "thread_set_cpumask", 00:04:25.861 "framework_get_scheduler", 00:04:25.861 "framework_set_scheduler", 00:04:25.861 "framework_get_reactors", 00:04:25.861 "thread_get_io_channels", 00:04:25.861 "thread_get_pollers", 00:04:25.861 "thread_get_stats", 00:04:25.861 "framework_monitor_context_switch", 00:04:25.861 "spdk_kill_instance", 00:04:25.861 "log_enable_timestamps", 00:04:25.861 "log_get_flags", 00:04:25.861 "log_clear_flag", 00:04:25.861 "log_set_flag", 00:04:25.861 "log_get_level", 00:04:25.861 "log_set_level", 00:04:25.861 "log_get_print_level", 00:04:25.861 "log_set_print_level", 00:04:25.861 "framework_enable_cpumask_locks", 00:04:25.861 "framework_disable_cpumask_locks", 00:04:25.861 "framework_wait_init", 00:04:25.861 "framework_start_init", 00:04:25.861 "scsi_get_devices", 00:04:25.861 "bdev_get_histogram", 00:04:25.861 "bdev_enable_histogram", 00:04:25.861 "bdev_set_qos_limit", 00:04:25.861 "bdev_set_qd_sampling_period", 00:04:25.861 "bdev_get_bdevs", 00:04:25.861 "bdev_reset_iostat", 00:04:25.861 "bdev_get_iostat", 00:04:25.861 "bdev_examine", 00:04:25.861 "bdev_wait_for_examine", 00:04:25.861 "bdev_set_options", 00:04:25.861 "notify_get_notifications", 00:04:25.861 "notify_get_types", 00:04:25.861 "accel_get_stats", 00:04:25.861 "accel_set_options", 00:04:25.861 "accel_set_driver", 00:04:25.861 "accel_crypto_key_destroy", 00:04:25.861 "accel_crypto_keys_get", 00:04:25.861 "accel_crypto_key_create", 00:04:25.861 "accel_assign_opc", 00:04:25.861 "accel_get_module_info", 00:04:25.861 "accel_get_opc_assignments", 00:04:25.861 "vmd_rescan", 00:04:25.861 "vmd_remove_device", 00:04:25.861 "vmd_enable", 00:04:25.861 "sock_set_default_impl", 00:04:25.861 "sock_impl_set_options", 00:04:25.861 "sock_impl_get_options", 00:04:25.861 "iobuf_get_stats", 00:04:25.861 "iobuf_set_options", 00:04:25.861 "framework_get_pci_devices", 00:04:25.861 "framework_get_config", 00:04:25.861 "framework_get_subsystems", 00:04:25.861 "trace_get_info", 00:04:25.861 "trace_get_tpoint_group_mask", 00:04:25.861 "trace_disable_tpoint_group", 00:04:25.861 "trace_enable_tpoint_group", 00:04:25.861 "trace_clear_tpoint_mask", 00:04:25.861 "trace_set_tpoint_mask", 00:04:25.861 "spdk_get_version", 00:04:25.861 "rpc_get_methods" 00:04:25.861 ] 00:04:25.861 20:09:57 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:25.861 20:09:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:25.861 20:09:57 -- common/autotest_common.sh@10 -- # set +x 00:04:25.861 20:09:57 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:25.861 20:09:57 -- spdkcli/tcp.sh@38 -- # killprocess 3228480 00:04:25.861 20:09:57 -- common/autotest_common.sh@926 -- # '[' -z 3228480 ']' 00:04:25.861 20:09:57 -- common/autotest_common.sh@930 -- # kill -0 3228480 00:04:25.861 20:09:57 -- common/autotest_common.sh@931 -- # uname 00:04:25.861 20:09:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:25.861 20:09:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3228480 00:04:25.861 20:09:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:25.861 20:09:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:25.861 20:09:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3228480' 00:04:25.861 killing process with pid 3228480 00:04:25.861 20:09:57 -- common/autotest_common.sh@945 -- # kill 3228480 00:04:25.861 20:09:57 -- common/autotest_common.sh@950 -- # wait 3228480 00:04:26.121 00:04:26.121 real 0m1.500s 00:04:26.121 user 0m2.780s 00:04:26.121 sys 0m0.425s 00:04:26.121 20:09:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:26.121 20:09:58 -- common/autotest_common.sh@10 -- # set +x 00:04:26.121 ************************************ 00:04:26.121 END TEST spdkcli_tcp 00:04:26.121 ************************************ 00:04:26.381 20:09:58 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:26.381 20:09:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:26.381 20:09:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:26.381 20:09:58 -- common/autotest_common.sh@10 -- # set +x 00:04:26.381 ************************************ 00:04:26.381 START TEST dpdk_mem_utility 00:04:26.381 ************************************ 00:04:26.381 20:09:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:26.381 * Looking for test storage... 00:04:26.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:26.381 20:09:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:26.381 20:09:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3228866 00:04:26.381 20:09:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:26.381 20:09:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3228866 00:04:26.381 20:09:58 -- common/autotest_common.sh@819 -- # '[' -z 3228866 ']' 00:04:26.381 20:09:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:26.381 20:09:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:26.381 20:09:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:26.381 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:26.381 20:09:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:26.381 20:09:58 -- common/autotest_common.sh@10 -- # set +x 00:04:26.381 [2024-07-22 20:09:58.196124] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:26.381 [2024-07-22 20:09:58.196174] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3228866 ] 00:04:26.381 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.381 [2024-07-22 20:09:58.250223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:26.641 [2024-07-22 20:09:58.322271] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:26.641 [2024-07-22 20:09:58.322390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.209 20:09:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:27.209 20:09:58 -- common/autotest_common.sh@852 -- # return 0 00:04:27.209 20:09:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:27.209 20:09:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:27.209 20:09:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:27.209 20:09:58 -- common/autotest_common.sh@10 -- # set +x 00:04:27.209 { 00:04:27.209 "filename": "/tmp/spdk_mem_dump.txt" 00:04:27.209 } 00:04:27.209 20:09:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:27.209 20:09:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:27.209 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:27.209 1 heaps totaling size 814.000000 MiB 00:04:27.209 size: 814.000000 MiB heap id: 0 00:04:27.209 end heaps---------- 00:04:27.209 8 mempools totaling size 598.116089 MiB 00:04:27.209 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:27.209 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:27.209 size: 84.521057 MiB name: bdev_io_3228866 00:04:27.209 size: 51.011292 MiB name: evtpool_3228866 00:04:27.209 size: 50.003479 MiB name: msgpool_3228866 00:04:27.209 size: 21.763794 MiB name: PDU_Pool 00:04:27.209 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:27.209 size: 0.026123 MiB name: Session_Pool 00:04:27.209 end mempools------- 00:04:27.209 6 memzones totaling size 4.142822 MiB 00:04:27.209 size: 1.000366 MiB name: RG_ring_0_3228866 00:04:27.209 size: 1.000366 MiB name: RG_ring_1_3228866 00:04:27.209 size: 1.000366 MiB name: RG_ring_4_3228866 00:04:27.209 size: 1.000366 MiB name: RG_ring_5_3228866 00:04:27.209 size: 0.125366 MiB name: RG_ring_2_3228866 00:04:27.209 size: 0.015991 MiB name: RG_ring_3_3228866 00:04:27.209 end memzones------- 00:04:27.209 20:09:59 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:27.209 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:27.209 list of free elements. size: 12.519348 MiB 00:04:27.209 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:27.209 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:27.209 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:27.209 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:27.209 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:27.209 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:27.209 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:27.209 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:27.209 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:27.209 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:27.209 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:27.209 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:27.209 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:27.209 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:27.209 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:27.209 list of standard malloc elements. size: 199.218079 MiB 00:04:27.209 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:27.209 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:27.209 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:27.209 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:27.209 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:27.209 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:27.209 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:27.209 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:27.209 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:27.209 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:27.209 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:27.209 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:27.209 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:27.209 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:27.209 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:27.209 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:27.209 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:27.209 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:27.209 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:27.209 list of memzone associated elements. size: 602.262573 MiB 00:04:27.209 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:27.209 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:27.209 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:27.209 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:27.209 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:27.209 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3228866_0 00:04:27.209 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:27.209 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3228866_0 00:04:27.209 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:27.209 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3228866_0 00:04:27.209 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:27.209 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:27.209 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:27.209 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:27.209 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:27.209 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3228866 00:04:27.209 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:27.209 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3228866 00:04:27.209 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:27.209 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3228866 00:04:27.209 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:27.209 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:27.209 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:27.209 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:27.209 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:27.209 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:27.209 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:27.209 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:27.210 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:27.210 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3228866 00:04:27.210 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:27.210 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3228866 00:04:27.210 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:27.210 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3228866 00:04:27.210 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:27.210 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3228866 00:04:27.210 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:27.210 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3228866 00:04:27.210 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:27.210 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:27.210 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:27.210 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:27.210 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:27.210 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:27.210 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:27.210 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3228866 00:04:27.210 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:27.210 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:27.210 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:27.210 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:27.210 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:27.210 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3228866 00:04:27.210 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:27.210 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:27.210 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:27.210 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3228866 00:04:27.210 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:27.210 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3228866 00:04:27.210 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:27.210 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:27.210 20:09:59 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:27.210 20:09:59 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3228866 00:04:27.210 20:09:59 -- common/autotest_common.sh@926 -- # '[' -z 3228866 ']' 00:04:27.210 20:09:59 -- common/autotest_common.sh@930 -- # kill -0 3228866 00:04:27.210 20:09:59 -- common/autotest_common.sh@931 -- # uname 00:04:27.210 20:09:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:27.210 20:09:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3228866 00:04:27.210 20:09:59 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:27.210 20:09:59 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:27.210 20:09:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3228866' 00:04:27.210 killing process with pid 3228866 00:04:27.210 20:09:59 -- common/autotest_common.sh@945 -- # kill 3228866 00:04:27.210 20:09:59 -- common/autotest_common.sh@950 -- # wait 3228866 00:04:27.780 00:04:27.780 real 0m1.395s 00:04:27.780 user 0m1.458s 00:04:27.780 sys 0m0.389s 00:04:27.780 20:09:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:27.780 20:09:59 -- common/autotest_common.sh@10 -- # set +x 00:04:27.780 ************************************ 00:04:27.780 END TEST dpdk_mem_utility 00:04:27.780 ************************************ 00:04:27.780 20:09:59 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:27.780 20:09:59 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:27.780 20:09:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:27.780 20:09:59 -- common/autotest_common.sh@10 -- # set +x 00:04:27.780 ************************************ 00:04:27.780 START TEST event 00:04:27.780 ************************************ 00:04:27.780 20:09:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:27.780 * Looking for test storage... 00:04:27.780 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:27.780 20:09:59 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:27.780 20:09:59 -- bdev/nbd_common.sh@6 -- # set -e 00:04:27.780 20:09:59 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:27.780 20:09:59 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:04:27.780 20:09:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:27.780 20:09:59 -- common/autotest_common.sh@10 -- # set +x 00:04:27.780 ************************************ 00:04:27.780 START TEST event_perf 00:04:27.780 ************************************ 00:04:27.781 20:09:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:27.781 Running I/O for 1 seconds...[2024-07-22 20:09:59.607744] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:27.781 [2024-07-22 20:09:59.607824] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3229149 ] 00:04:27.781 EAL: No free 2048 kB hugepages reported on node 1 00:04:27.781 [2024-07-22 20:09:59.667260] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:28.040 [2024-07-22 20:09:59.744099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:28.040 [2024-07-22 20:09:59.744199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:28.040 [2024-07-22 20:09:59.744274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:28.040 [2024-07-22 20:09:59.744275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:28.978 Running I/O for 1 seconds... 00:04:28.978 lcore 0: 198958 00:04:28.978 lcore 1: 198957 00:04:28.978 lcore 2: 198958 00:04:28.978 lcore 3: 198958 00:04:28.978 done. 00:04:28.978 00:04:28.978 real 0m1.255s 00:04:28.978 user 0m4.178s 00:04:28.978 sys 0m0.074s 00:04:28.978 20:10:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:28.978 20:10:00 -- common/autotest_common.sh@10 -- # set +x 00:04:28.978 ************************************ 00:04:28.978 END TEST event_perf 00:04:28.978 ************************************ 00:04:28.978 20:10:00 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:28.978 20:10:00 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:28.978 20:10:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:28.978 20:10:00 -- common/autotest_common.sh@10 -- # set +x 00:04:28.978 ************************************ 00:04:28.978 START TEST event_reactor 00:04:28.978 ************************************ 00:04:28.978 20:10:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:28.978 [2024-07-22 20:10:00.903859] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:28.978 [2024-07-22 20:10:00.903939] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3229411 ] 00:04:29.240 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.240 [2024-07-22 20:10:00.962183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:29.240 [2024-07-22 20:10:01.029204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.179 test_start 00:04:30.179 oneshot 00:04:30.179 tick 100 00:04:30.179 tick 100 00:04:30.179 tick 250 00:04:30.179 tick 100 00:04:30.179 tick 100 00:04:30.179 tick 250 00:04:30.179 tick 100 00:04:30.179 tick 500 00:04:30.179 tick 100 00:04:30.179 tick 100 00:04:30.179 tick 250 00:04:30.179 tick 100 00:04:30.179 tick 100 00:04:30.179 test_end 00:04:30.438 00:04:30.438 real 0m1.236s 00:04:30.438 user 0m1.163s 00:04:30.438 sys 0m0.069s 00:04:30.439 20:10:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:30.439 20:10:02 -- common/autotest_common.sh@10 -- # set +x 00:04:30.439 ************************************ 00:04:30.439 END TEST event_reactor 00:04:30.439 ************************************ 00:04:30.439 20:10:02 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:30.439 20:10:02 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:30.439 20:10:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:30.439 20:10:02 -- common/autotest_common.sh@10 -- # set +x 00:04:30.439 ************************************ 00:04:30.439 START TEST event_reactor_perf 00:04:30.439 ************************************ 00:04:30.439 20:10:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:30.439 [2024-07-22 20:10:02.167161] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:30.439 [2024-07-22 20:10:02.167220] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3229605 ] 00:04:30.439 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.439 [2024-07-22 20:10:02.220601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.439 [2024-07-22 20:10:02.289840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.817 test_start 00:04:31.817 test_end 00:04:31.817 Performance: 499882 events per second 00:04:31.817 00:04:31.817 real 0m1.221s 00:04:31.817 user 0m1.145s 00:04:31.817 sys 0m0.072s 00:04:31.817 20:10:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:31.817 20:10:03 -- common/autotest_common.sh@10 -- # set +x 00:04:31.817 ************************************ 00:04:31.817 END TEST event_reactor_perf 00:04:31.817 ************************************ 00:04:31.817 20:10:03 -- event/event.sh@49 -- # uname -s 00:04:31.817 20:10:03 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:31.817 20:10:03 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:31.817 20:10:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:31.817 20:10:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:31.817 20:10:03 -- common/autotest_common.sh@10 -- # set +x 00:04:31.817 ************************************ 00:04:31.817 START TEST event_scheduler 00:04:31.817 ************************************ 00:04:31.817 20:10:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:31.817 * Looking for test storage... 00:04:31.817 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:31.817 20:10:03 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:31.817 20:10:03 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:31.817 20:10:03 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3229858 00:04:31.817 20:10:03 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:31.817 20:10:03 -- scheduler/scheduler.sh@37 -- # waitforlisten 3229858 00:04:31.817 20:10:03 -- common/autotest_common.sh@819 -- # '[' -z 3229858 ']' 00:04:31.817 20:10:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:31.817 20:10:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:31.817 20:10:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:31.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:31.817 20:10:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:31.817 20:10:03 -- common/autotest_common.sh@10 -- # set +x 00:04:31.817 [2024-07-22 20:10:03.529526] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:31.817 [2024-07-22 20:10:03.529575] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3229858 ] 00:04:31.817 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.817 [2024-07-22 20:10:03.581347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:31.817 [2024-07-22 20:10:03.660926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.817 [2024-07-22 20:10:03.661015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:31.817 [2024-07-22 20:10:03.661051] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:31.817 [2024-07-22 20:10:03.661056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:32.757 20:10:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:32.757 20:10:04 -- common/autotest_common.sh@852 -- # return 0 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 POWER: Env isn't set yet! 00:04:32.757 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:32.757 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:04:32.757 POWER: Cannot set governor of lcore 0 to userspace 00:04:32.757 POWER: Attempting to initialise PSTAT power management... 00:04:32.757 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:32.757 POWER: Initialized successfully for lcore 0 power management 00:04:32.757 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:32.757 POWER: Initialized successfully for lcore 1 power management 00:04:32.757 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:32.757 POWER: Initialized successfully for lcore 2 power management 00:04:32.757 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:32.757 POWER: Initialized successfully for lcore 3 power management 00:04:32.757 [2024-07-22 20:10:04.369214] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:32.757 [2024-07-22 20:10:04.369227] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:32.757 [2024-07-22 20:10:04.369234] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 [2024-07-22 20:10:04.437155] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:32.757 20:10:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:32.757 20:10:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 ************************************ 00:04:32.757 START TEST scheduler_create_thread 00:04:32.757 ************************************ 00:04:32.757 20:10:04 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 2 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 3 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 4 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 5 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 6 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 7 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 8 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 9 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 10 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:32.757 20:10:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:32.757 20:10:04 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:32.757 20:10:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.757 20:10:04 -- common/autotest_common.sh@10 -- # set +x 00:04:33.694 20:10:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:33.694 20:10:05 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:33.694 20:10:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:33.694 20:10:05 -- common/autotest_common.sh@10 -- # set +x 00:04:35.072 20:10:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:35.072 20:10:06 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:35.072 20:10:06 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:35.072 20:10:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:35.072 20:10:06 -- common/autotest_common.sh@10 -- # set +x 00:04:36.056 20:10:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.056 00:04:36.056 real 0m3.380s 00:04:36.056 user 0m0.020s 00:04:36.056 sys 0m0.008s 00:04:36.056 20:10:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:36.056 20:10:07 -- common/autotest_common.sh@10 -- # set +x 00:04:36.056 ************************************ 00:04:36.056 END TEST scheduler_create_thread 00:04:36.056 ************************************ 00:04:36.056 20:10:07 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:36.056 20:10:07 -- scheduler/scheduler.sh@46 -- # killprocess 3229858 00:04:36.056 20:10:07 -- common/autotest_common.sh@926 -- # '[' -z 3229858 ']' 00:04:36.056 20:10:07 -- common/autotest_common.sh@930 -- # kill -0 3229858 00:04:36.056 20:10:07 -- common/autotest_common.sh@931 -- # uname 00:04:36.056 20:10:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:36.056 20:10:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3229858 00:04:36.056 20:10:07 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:04:36.056 20:10:07 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:04:36.056 20:10:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3229858' 00:04:36.056 killing process with pid 3229858 00:04:36.056 20:10:07 -- common/autotest_common.sh@945 -- # kill 3229858 00:04:36.056 20:10:07 -- common/autotest_common.sh@950 -- # wait 3229858 00:04:36.347 [2024-07-22 20:10:08.205044] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:36.606 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:04:36.606 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:36.606 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:04:36.606 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:36.606 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:04:36.606 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:36.606 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:04:36.606 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:36.606 00:04:36.606 real 0m5.039s 00:04:36.606 user 0m10.419s 00:04:36.606 sys 0m0.316s 00:04:36.606 20:10:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:36.606 20:10:08 -- common/autotest_common.sh@10 -- # set +x 00:04:36.606 ************************************ 00:04:36.606 END TEST event_scheduler 00:04:36.606 ************************************ 00:04:36.606 20:10:08 -- event/event.sh@51 -- # modprobe -n nbd 00:04:36.606 20:10:08 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:36.606 20:10:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:36.606 20:10:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:36.606 20:10:08 -- common/autotest_common.sh@10 -- # set +x 00:04:36.606 ************************************ 00:04:36.606 START TEST app_repeat 00:04:36.606 ************************************ 00:04:36.606 20:10:08 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:04:36.606 20:10:08 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:36.606 20:10:08 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:36.606 20:10:08 -- event/event.sh@13 -- # local nbd_list 00:04:36.606 20:10:08 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:36.606 20:10:08 -- event/event.sh@14 -- # local bdev_list 00:04:36.606 20:10:08 -- event/event.sh@15 -- # local repeat_times=4 00:04:36.606 20:10:08 -- event/event.sh@17 -- # modprobe nbd 00:04:36.606 20:10:08 -- event/event.sh@19 -- # repeat_pid=3230705 00:04:36.606 20:10:08 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:36.606 20:10:08 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:36.606 20:10:08 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3230705' 00:04:36.606 Process app_repeat pid: 3230705 00:04:36.606 20:10:08 -- event/event.sh@23 -- # for i in {0..2} 00:04:36.606 20:10:08 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:36.606 spdk_app_start Round 0 00:04:36.606 20:10:08 -- event/event.sh@25 -- # waitforlisten 3230705 /var/tmp/spdk-nbd.sock 00:04:36.606 20:10:08 -- common/autotest_common.sh@819 -- # '[' -z 3230705 ']' 00:04:36.606 20:10:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:36.606 20:10:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:36.606 20:10:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:36.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:36.606 20:10:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:36.606 20:10:08 -- common/autotest_common.sh@10 -- # set +x 00:04:36.606 [2024-07-22 20:10:08.527214] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:36.606 [2024-07-22 20:10:08.527260] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3230705 ] 00:04:36.866 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.866 [2024-07-22 20:10:08.573714] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:36.866 [2024-07-22 20:10:08.644745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:36.866 [2024-07-22 20:10:08.644748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.434 20:10:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:37.434 20:10:09 -- common/autotest_common.sh@852 -- # return 0 00:04:37.434 20:10:09 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:37.693 Malloc0 00:04:37.693 20:10:09 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:37.952 Malloc1 00:04:37.952 20:10:09 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@12 -- # local i 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:37.952 /dev/nbd0 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:37.952 20:10:09 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:37.952 20:10:09 -- common/autotest_common.sh@857 -- # local i 00:04:37.952 20:10:09 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:37.952 20:10:09 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:37.952 20:10:09 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:37.952 20:10:09 -- common/autotest_common.sh@861 -- # break 00:04:37.952 20:10:09 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:37.952 20:10:09 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:37.952 20:10:09 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:37.952 1+0 records in 00:04:37.952 1+0 records out 00:04:37.952 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203026 s, 20.2 MB/s 00:04:37.952 20:10:09 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:37.952 20:10:09 -- common/autotest_common.sh@874 -- # size=4096 00:04:37.952 20:10:09 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:37.952 20:10:09 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:37.952 20:10:09 -- common/autotest_common.sh@877 -- # return 0 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:37.952 20:10:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:38.211 /dev/nbd1 00:04:38.211 20:10:10 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:38.211 20:10:10 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:38.211 20:10:10 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:38.211 20:10:10 -- common/autotest_common.sh@857 -- # local i 00:04:38.211 20:10:10 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:38.211 20:10:10 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:38.211 20:10:10 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:38.211 20:10:10 -- common/autotest_common.sh@861 -- # break 00:04:38.211 20:10:10 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:38.211 20:10:10 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:38.211 20:10:10 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:38.211 1+0 records in 00:04:38.211 1+0 records out 00:04:38.211 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00023824 s, 17.2 MB/s 00:04:38.211 20:10:10 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:38.211 20:10:10 -- common/autotest_common.sh@874 -- # size=4096 00:04:38.211 20:10:10 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:38.211 20:10:10 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:38.211 20:10:10 -- common/autotest_common.sh@877 -- # return 0 00:04:38.211 20:10:10 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:38.211 20:10:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:38.211 20:10:10 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:38.211 20:10:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:38.211 20:10:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:38.470 { 00:04:38.470 "nbd_device": "/dev/nbd0", 00:04:38.470 "bdev_name": "Malloc0" 00:04:38.470 }, 00:04:38.470 { 00:04:38.470 "nbd_device": "/dev/nbd1", 00:04:38.470 "bdev_name": "Malloc1" 00:04:38.470 } 00:04:38.470 ]' 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:38.470 { 00:04:38.470 "nbd_device": "/dev/nbd0", 00:04:38.470 "bdev_name": "Malloc0" 00:04:38.470 }, 00:04:38.470 { 00:04:38.470 "nbd_device": "/dev/nbd1", 00:04:38.470 "bdev_name": "Malloc1" 00:04:38.470 } 00:04:38.470 ]' 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:38.470 /dev/nbd1' 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:38.470 /dev/nbd1' 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@65 -- # count=2 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@95 -- # count=2 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:38.470 256+0 records in 00:04:38.470 256+0 records out 00:04:38.470 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102981 s, 102 MB/s 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:38.470 256+0 records in 00:04:38.470 256+0 records out 00:04:38.470 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140316 s, 74.7 MB/s 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:38.470 256+0 records in 00:04:38.470 256+0 records out 00:04:38.470 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147641 s, 71.0 MB/s 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:38.470 20:10:10 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@51 -- # local i 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:38.471 20:10:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@41 -- # break 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@45 -- # return 0 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:38.730 20:10:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:38.988 20:10:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@41 -- # break 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@45 -- # return 0 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:38.989 20:10:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@65 -- # true 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@65 -- # count=0 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@104 -- # count=0 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:39.247 20:10:10 -- bdev/nbd_common.sh@109 -- # return 0 00:04:39.247 20:10:10 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:39.247 20:10:11 -- event/event.sh@35 -- # sleep 3 00:04:39.505 [2024-07-22 20:10:11.327789] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:39.505 [2024-07-22 20:10:11.392656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:39.505 [2024-07-22 20:10:11.392659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.505 [2024-07-22 20:10:11.433822] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:39.505 [2024-07-22 20:10:11.433862] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:42.788 20:10:14 -- event/event.sh@23 -- # for i in {0..2} 00:04:42.788 20:10:14 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:42.788 spdk_app_start Round 1 00:04:42.788 20:10:14 -- event/event.sh@25 -- # waitforlisten 3230705 /var/tmp/spdk-nbd.sock 00:04:42.788 20:10:14 -- common/autotest_common.sh@819 -- # '[' -z 3230705 ']' 00:04:42.788 20:10:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:42.788 20:10:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:42.788 20:10:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:42.788 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:42.788 20:10:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:42.788 20:10:14 -- common/autotest_common.sh@10 -- # set +x 00:04:42.788 20:10:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:42.788 20:10:14 -- common/autotest_common.sh@852 -- # return 0 00:04:42.788 20:10:14 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:42.788 Malloc0 00:04:42.788 20:10:14 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:42.788 Malloc1 00:04:42.788 20:10:14 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@12 -- # local i 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:42.788 20:10:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:43.047 /dev/nbd0 00:04:43.047 20:10:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:43.047 20:10:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:43.047 20:10:14 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:43.047 20:10:14 -- common/autotest_common.sh@857 -- # local i 00:04:43.047 20:10:14 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:43.047 20:10:14 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:43.047 20:10:14 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:43.047 20:10:14 -- common/autotest_common.sh@861 -- # break 00:04:43.047 20:10:14 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:43.047 20:10:14 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:43.047 20:10:14 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:43.047 1+0 records in 00:04:43.047 1+0 records out 00:04:43.047 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000106993 s, 38.3 MB/s 00:04:43.047 20:10:14 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.047 20:10:14 -- common/autotest_common.sh@874 -- # size=4096 00:04:43.047 20:10:14 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.047 20:10:14 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:43.047 20:10:14 -- common/autotest_common.sh@877 -- # return 0 00:04:43.047 20:10:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:43.047 20:10:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:43.047 20:10:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:43.305 /dev/nbd1 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:43.305 20:10:15 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:43.305 20:10:15 -- common/autotest_common.sh@857 -- # local i 00:04:43.305 20:10:15 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:43.305 20:10:15 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:43.305 20:10:15 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:43.305 20:10:15 -- common/autotest_common.sh@861 -- # break 00:04:43.305 20:10:15 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:43.305 20:10:15 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:43.305 20:10:15 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:43.305 1+0 records in 00:04:43.305 1+0 records out 00:04:43.305 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000226795 s, 18.1 MB/s 00:04:43.305 20:10:15 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.305 20:10:15 -- common/autotest_common.sh@874 -- # size=4096 00:04:43.305 20:10:15 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.305 20:10:15 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:43.305 20:10:15 -- common/autotest_common.sh@877 -- # return 0 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:43.305 { 00:04:43.305 "nbd_device": "/dev/nbd0", 00:04:43.305 "bdev_name": "Malloc0" 00:04:43.305 }, 00:04:43.305 { 00:04:43.305 "nbd_device": "/dev/nbd1", 00:04:43.305 "bdev_name": "Malloc1" 00:04:43.305 } 00:04:43.305 ]' 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:43.305 { 00:04:43.305 "nbd_device": "/dev/nbd0", 00:04:43.305 "bdev_name": "Malloc0" 00:04:43.305 }, 00:04:43.305 { 00:04:43.305 "nbd_device": "/dev/nbd1", 00:04:43.305 "bdev_name": "Malloc1" 00:04:43.305 } 00:04:43.305 ]' 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:43.305 20:10:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:43.305 /dev/nbd1' 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:43.564 /dev/nbd1' 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@65 -- # count=2 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@95 -- # count=2 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:43.564 256+0 records in 00:04:43.564 256+0 records out 00:04:43.564 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723888 s, 145 MB/s 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:43.564 256+0 records in 00:04:43.564 256+0 records out 00:04:43.564 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01399 s, 75.0 MB/s 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:43.564 256+0 records in 00:04:43.564 256+0 records out 00:04:43.564 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150316 s, 69.8 MB/s 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.564 20:10:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@51 -- # local i 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@41 -- # break 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@45 -- # return 0 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:43.565 20:10:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@41 -- # break 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@45 -- # return 0 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.823 20:10:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@65 -- # true 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@65 -- # count=0 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@104 -- # count=0 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:44.081 20:10:15 -- bdev/nbd_common.sh@109 -- # return 0 00:04:44.081 20:10:15 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:44.339 20:10:16 -- event/event.sh@35 -- # sleep 3 00:04:44.598 [2024-07-22 20:10:16.292843] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:44.598 [2024-07-22 20:10:16.358199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:44.598 [2024-07-22 20:10:16.358202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.598 [2024-07-22 20:10:16.399474] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:44.598 [2024-07-22 20:10:16.399512] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:47.884 20:10:19 -- event/event.sh@23 -- # for i in {0..2} 00:04:47.884 20:10:19 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:47.884 spdk_app_start Round 2 00:04:47.884 20:10:19 -- event/event.sh@25 -- # waitforlisten 3230705 /var/tmp/spdk-nbd.sock 00:04:47.884 20:10:19 -- common/autotest_common.sh@819 -- # '[' -z 3230705 ']' 00:04:47.884 20:10:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:47.884 20:10:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:47.884 20:10:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:47.884 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:47.884 20:10:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:47.884 20:10:19 -- common/autotest_common.sh@10 -- # set +x 00:04:47.884 20:10:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:47.884 20:10:19 -- common/autotest_common.sh@852 -- # return 0 00:04:47.884 20:10:19 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:47.884 Malloc0 00:04:47.884 20:10:19 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:47.884 Malloc1 00:04:47.884 20:10:19 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@12 -- # local i 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:47.884 /dev/nbd0 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:47.884 20:10:19 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:47.884 20:10:19 -- common/autotest_common.sh@857 -- # local i 00:04:47.884 20:10:19 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:47.884 20:10:19 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:47.884 20:10:19 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:47.884 20:10:19 -- common/autotest_common.sh@861 -- # break 00:04:47.884 20:10:19 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:47.884 20:10:19 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:47.884 20:10:19 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:47.884 1+0 records in 00:04:47.884 1+0 records out 00:04:47.884 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000237506 s, 17.2 MB/s 00:04:47.884 20:10:19 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:47.884 20:10:19 -- common/autotest_common.sh@874 -- # size=4096 00:04:47.884 20:10:19 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:47.884 20:10:19 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:47.884 20:10:19 -- common/autotest_common.sh@877 -- # return 0 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:47.884 20:10:19 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:48.143 /dev/nbd1 00:04:48.143 20:10:19 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:48.143 20:10:19 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:48.143 20:10:19 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:48.143 20:10:19 -- common/autotest_common.sh@857 -- # local i 00:04:48.143 20:10:19 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:48.143 20:10:19 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:48.143 20:10:19 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:48.143 20:10:19 -- common/autotest_common.sh@861 -- # break 00:04:48.143 20:10:19 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:48.143 20:10:19 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:48.143 20:10:19 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:48.143 1+0 records in 00:04:48.143 1+0 records out 00:04:48.143 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000234757 s, 17.4 MB/s 00:04:48.143 20:10:19 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:48.143 20:10:19 -- common/autotest_common.sh@874 -- # size=4096 00:04:48.143 20:10:19 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:48.143 20:10:19 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:48.143 20:10:19 -- common/autotest_common.sh@877 -- # return 0 00:04:48.143 20:10:19 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:48.143 20:10:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:48.143 20:10:19 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:48.143 20:10:19 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.143 20:10:19 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:48.406 { 00:04:48.406 "nbd_device": "/dev/nbd0", 00:04:48.406 "bdev_name": "Malloc0" 00:04:48.406 }, 00:04:48.406 { 00:04:48.406 "nbd_device": "/dev/nbd1", 00:04:48.406 "bdev_name": "Malloc1" 00:04:48.406 } 00:04:48.406 ]' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:48.406 { 00:04:48.406 "nbd_device": "/dev/nbd0", 00:04:48.406 "bdev_name": "Malloc0" 00:04:48.406 }, 00:04:48.406 { 00:04:48.406 "nbd_device": "/dev/nbd1", 00:04:48.406 "bdev_name": "Malloc1" 00:04:48.406 } 00:04:48.406 ]' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:48.406 /dev/nbd1' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:48.406 /dev/nbd1' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@65 -- # count=2 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@95 -- # count=2 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:48.406 256+0 records in 00:04:48.406 256+0 records out 00:04:48.406 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00328325 s, 319 MB/s 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:48.406 256+0 records in 00:04:48.406 256+0 records out 00:04:48.406 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145898 s, 71.9 MB/s 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:48.406 256+0 records in 00:04:48.406 256+0 records out 00:04:48.406 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147482 s, 71.1 MB/s 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@51 -- # local i 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:48.406 20:10:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@41 -- # break 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@45 -- # return 0 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:48.666 20:10:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:48.925 20:10:20 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:48.925 20:10:20 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:48.925 20:10:20 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:48.925 20:10:20 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@41 -- # break 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@45 -- # return 0 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@65 -- # true 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@65 -- # count=0 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@104 -- # count=0 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:48.926 20:10:20 -- bdev/nbd_common.sh@109 -- # return 0 00:04:48.926 20:10:20 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:49.185 20:10:21 -- event/event.sh@35 -- # sleep 3 00:04:49.446 [2024-07-22 20:10:21.244269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:49.446 [2024-07-22 20:10:21.309607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:49.446 [2024-07-22 20:10:21.309611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.446 [2024-07-22 20:10:21.350765] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:49.446 [2024-07-22 20:10:21.350807] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:52.738 20:10:24 -- event/event.sh@38 -- # waitforlisten 3230705 /var/tmp/spdk-nbd.sock 00:04:52.738 20:10:24 -- common/autotest_common.sh@819 -- # '[' -z 3230705 ']' 00:04:52.738 20:10:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:52.738 20:10:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:52.738 20:10:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:52.738 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:52.738 20:10:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:52.738 20:10:24 -- common/autotest_common.sh@10 -- # set +x 00:04:52.738 20:10:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:52.738 20:10:24 -- common/autotest_common.sh@852 -- # return 0 00:04:52.738 20:10:24 -- event/event.sh@39 -- # killprocess 3230705 00:04:52.738 20:10:24 -- common/autotest_common.sh@926 -- # '[' -z 3230705 ']' 00:04:52.738 20:10:24 -- common/autotest_common.sh@930 -- # kill -0 3230705 00:04:52.738 20:10:24 -- common/autotest_common.sh@931 -- # uname 00:04:52.738 20:10:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:52.738 20:10:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3230705 00:04:52.738 20:10:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:52.738 20:10:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:52.738 20:10:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3230705' 00:04:52.738 killing process with pid 3230705 00:04:52.738 20:10:24 -- common/autotest_common.sh@945 -- # kill 3230705 00:04:52.738 20:10:24 -- common/autotest_common.sh@950 -- # wait 3230705 00:04:52.738 spdk_app_start is called in Round 0. 00:04:52.738 Shutdown signal received, stop current app iteration 00:04:52.738 Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 reinitialization... 00:04:52.738 spdk_app_start is called in Round 1. 00:04:52.738 Shutdown signal received, stop current app iteration 00:04:52.738 Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 reinitialization... 00:04:52.738 spdk_app_start is called in Round 2. 00:04:52.738 Shutdown signal received, stop current app iteration 00:04:52.738 Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 reinitialization... 00:04:52.738 spdk_app_start is called in Round 3. 00:04:52.738 Shutdown signal received, stop current app iteration 00:04:52.738 20:10:24 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:52.738 20:10:24 -- event/event.sh@42 -- # return 0 00:04:52.738 00:04:52.738 real 0m15.943s 00:04:52.738 user 0m34.538s 00:04:52.738 sys 0m2.210s 00:04:52.738 20:10:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:52.738 20:10:24 -- common/autotest_common.sh@10 -- # set +x 00:04:52.738 ************************************ 00:04:52.738 END TEST app_repeat 00:04:52.738 ************************************ 00:04:52.738 20:10:24 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:52.738 20:10:24 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:52.738 20:10:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:52.738 20:10:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:52.738 20:10:24 -- common/autotest_common.sh@10 -- # set +x 00:04:52.738 ************************************ 00:04:52.738 START TEST cpu_locks 00:04:52.738 ************************************ 00:04:52.738 20:10:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:52.738 * Looking for test storage... 00:04:52.738 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:52.738 20:10:24 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:52.738 20:10:24 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:52.738 20:10:24 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:52.738 20:10:24 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:52.738 20:10:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:52.738 20:10:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:52.738 20:10:24 -- common/autotest_common.sh@10 -- # set +x 00:04:52.738 ************************************ 00:04:52.738 START TEST default_locks 00:04:52.738 ************************************ 00:04:52.738 20:10:24 -- common/autotest_common.sh@1104 -- # default_locks 00:04:52.738 20:10:24 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3233733 00:04:52.738 20:10:24 -- event/cpu_locks.sh@47 -- # waitforlisten 3233733 00:04:52.738 20:10:24 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:52.738 20:10:24 -- common/autotest_common.sh@819 -- # '[' -z 3233733 ']' 00:04:52.738 20:10:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:52.739 20:10:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:52.739 20:10:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:52.739 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:52.739 20:10:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:52.739 20:10:24 -- common/autotest_common.sh@10 -- # set +x 00:04:52.739 [2024-07-22 20:10:24.624477] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:52.739 [2024-07-22 20:10:24.624528] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3233733 ] 00:04:52.739 EAL: No free 2048 kB hugepages reported on node 1 00:04:52.997 [2024-07-22 20:10:24.678338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:52.997 [2024-07-22 20:10:24.748356] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:52.997 [2024-07-22 20:10:24.748472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:53.565 20:10:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:53.565 20:10:25 -- common/autotest_common.sh@852 -- # return 0 00:04:53.565 20:10:25 -- event/cpu_locks.sh@49 -- # locks_exist 3233733 00:04:53.565 20:10:25 -- event/cpu_locks.sh@22 -- # lslocks -p 3233733 00:04:53.565 20:10:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:53.855 lslocks: write error 00:04:53.855 20:10:25 -- event/cpu_locks.sh@50 -- # killprocess 3233733 00:04:53.855 20:10:25 -- common/autotest_common.sh@926 -- # '[' -z 3233733 ']' 00:04:53.855 20:10:25 -- common/autotest_common.sh@930 -- # kill -0 3233733 00:04:53.855 20:10:25 -- common/autotest_common.sh@931 -- # uname 00:04:53.855 20:10:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:53.855 20:10:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3233733 00:04:54.114 20:10:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:54.114 20:10:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:54.114 20:10:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3233733' 00:04:54.114 killing process with pid 3233733 00:04:54.114 20:10:25 -- common/autotest_common.sh@945 -- # kill 3233733 00:04:54.114 20:10:25 -- common/autotest_common.sh@950 -- # wait 3233733 00:04:54.373 20:10:26 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3233733 00:04:54.373 20:10:26 -- common/autotest_common.sh@640 -- # local es=0 00:04:54.373 20:10:26 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3233733 00:04:54.373 20:10:26 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:04:54.373 20:10:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:54.373 20:10:26 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:04:54.373 20:10:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:54.373 20:10:26 -- common/autotest_common.sh@643 -- # waitforlisten 3233733 00:04:54.373 20:10:26 -- common/autotest_common.sh@819 -- # '[' -z 3233733 ']' 00:04:54.373 20:10:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:54.373 20:10:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:54.373 20:10:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:54.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:54.373 20:10:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:54.373 20:10:26 -- common/autotest_common.sh@10 -- # set +x 00:04:54.373 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3233733) - No such process 00:04:54.373 ERROR: process (pid: 3233733) is no longer running 00:04:54.373 20:10:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:54.373 20:10:26 -- common/autotest_common.sh@852 -- # return 1 00:04:54.373 20:10:26 -- common/autotest_common.sh@643 -- # es=1 00:04:54.373 20:10:26 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:54.373 20:10:26 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:54.373 20:10:26 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:54.373 20:10:26 -- event/cpu_locks.sh@54 -- # no_locks 00:04:54.373 20:10:26 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:54.373 20:10:26 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:54.373 20:10:26 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:54.373 00:04:54.373 real 0m1.578s 00:04:54.373 user 0m1.661s 00:04:54.373 sys 0m0.494s 00:04:54.373 20:10:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:54.373 20:10:26 -- common/autotest_common.sh@10 -- # set +x 00:04:54.373 ************************************ 00:04:54.373 END TEST default_locks 00:04:54.373 ************************************ 00:04:54.373 20:10:26 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:54.373 20:10:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:54.373 20:10:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:54.373 20:10:26 -- common/autotest_common.sh@10 -- # set +x 00:04:54.373 ************************************ 00:04:54.373 START TEST default_locks_via_rpc 00:04:54.373 ************************************ 00:04:54.373 20:10:26 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:04:54.373 20:10:26 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3233995 00:04:54.373 20:10:26 -- event/cpu_locks.sh@63 -- # waitforlisten 3233995 00:04:54.373 20:10:26 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:54.373 20:10:26 -- common/autotest_common.sh@819 -- # '[' -z 3233995 ']' 00:04:54.373 20:10:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:54.373 20:10:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:54.373 20:10:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:54.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:54.373 20:10:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:54.373 20:10:26 -- common/autotest_common.sh@10 -- # set +x 00:04:54.373 [2024-07-22 20:10:26.240602] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:54.373 [2024-07-22 20:10:26.240655] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3233995 ] 00:04:54.373 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.373 [2024-07-22 20:10:26.294570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.632 [2024-07-22 20:10:26.363912] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:54.632 [2024-07-22 20:10:26.364059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.199 20:10:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:55.199 20:10:27 -- common/autotest_common.sh@852 -- # return 0 00:04:55.199 20:10:27 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:55.199 20:10:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.199 20:10:27 -- common/autotest_common.sh@10 -- # set +x 00:04:55.199 20:10:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.199 20:10:27 -- event/cpu_locks.sh@67 -- # no_locks 00:04:55.199 20:10:27 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:55.199 20:10:27 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:55.199 20:10:27 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:55.199 20:10:27 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:55.199 20:10:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.199 20:10:27 -- common/autotest_common.sh@10 -- # set +x 00:04:55.199 20:10:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.199 20:10:27 -- event/cpu_locks.sh@71 -- # locks_exist 3233995 00:04:55.199 20:10:27 -- event/cpu_locks.sh@22 -- # lslocks -p 3233995 00:04:55.199 20:10:27 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:55.767 20:10:27 -- event/cpu_locks.sh@73 -- # killprocess 3233995 00:04:55.767 20:10:27 -- common/autotest_common.sh@926 -- # '[' -z 3233995 ']' 00:04:55.767 20:10:27 -- common/autotest_common.sh@930 -- # kill -0 3233995 00:04:55.767 20:10:27 -- common/autotest_common.sh@931 -- # uname 00:04:55.767 20:10:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:55.767 20:10:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3233995 00:04:55.767 20:10:27 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:55.767 20:10:27 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:55.767 20:10:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3233995' 00:04:55.767 killing process with pid 3233995 00:04:55.767 20:10:27 -- common/autotest_common.sh@945 -- # kill 3233995 00:04:55.767 20:10:27 -- common/autotest_common.sh@950 -- # wait 3233995 00:04:56.025 00:04:56.025 real 0m1.650s 00:04:56.025 user 0m1.722s 00:04:56.025 sys 0m0.540s 00:04:56.025 20:10:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:56.025 20:10:27 -- common/autotest_common.sh@10 -- # set +x 00:04:56.025 ************************************ 00:04:56.025 END TEST default_locks_via_rpc 00:04:56.025 ************************************ 00:04:56.025 20:10:27 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:04:56.025 20:10:27 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:56.025 20:10:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:56.025 20:10:27 -- common/autotest_common.sh@10 -- # set +x 00:04:56.025 ************************************ 00:04:56.025 START TEST non_locking_app_on_locked_coremask 00:04:56.025 ************************************ 00:04:56.025 20:10:27 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:04:56.025 20:10:27 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3234269 00:04:56.025 20:10:27 -- event/cpu_locks.sh@81 -- # waitforlisten 3234269 /var/tmp/spdk.sock 00:04:56.025 20:10:27 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:56.025 20:10:27 -- common/autotest_common.sh@819 -- # '[' -z 3234269 ']' 00:04:56.025 20:10:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:56.025 20:10:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:56.025 20:10:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:56.025 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:56.025 20:10:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:56.025 20:10:27 -- common/autotest_common.sh@10 -- # set +x 00:04:56.025 [2024-07-22 20:10:27.919677] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:56.025 [2024-07-22 20:10:27.919724] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3234269 ] 00:04:56.025 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.285 [2024-07-22 20:10:27.970934] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:56.285 [2024-07-22 20:10:28.050752] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:56.285 [2024-07-22 20:10:28.050865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.853 20:10:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:56.853 20:10:28 -- common/autotest_common.sh@852 -- # return 0 00:04:56.853 20:10:28 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:04:56.853 20:10:28 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3234495 00:04:56.853 20:10:28 -- event/cpu_locks.sh@85 -- # waitforlisten 3234495 /var/tmp/spdk2.sock 00:04:56.853 20:10:28 -- common/autotest_common.sh@819 -- # '[' -z 3234495 ']' 00:04:56.853 20:10:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:56.853 20:10:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:56.853 20:10:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:56.853 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:56.853 20:10:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:56.853 20:10:28 -- common/autotest_common.sh@10 -- # set +x 00:04:56.853 [2024-07-22 20:10:28.741960] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:56.853 [2024-07-22 20:10:28.742005] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3234495 ] 00:04:56.853 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.111 [2024-07-22 20:10:28.810210] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:57.111 [2024-07-22 20:10:28.810232] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.111 [2024-07-22 20:10:28.952148] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:57.111 [2024-07-22 20:10:28.952277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.679 20:10:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:57.679 20:10:29 -- common/autotest_common.sh@852 -- # return 0 00:04:57.679 20:10:29 -- event/cpu_locks.sh@87 -- # locks_exist 3234269 00:04:57.679 20:10:29 -- event/cpu_locks.sh@22 -- # lslocks -p 3234269 00:04:57.679 20:10:29 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:58.246 lslocks: write error 00:04:58.246 20:10:30 -- event/cpu_locks.sh@89 -- # killprocess 3234269 00:04:58.246 20:10:30 -- common/autotest_common.sh@926 -- # '[' -z 3234269 ']' 00:04:58.246 20:10:30 -- common/autotest_common.sh@930 -- # kill -0 3234269 00:04:58.246 20:10:30 -- common/autotest_common.sh@931 -- # uname 00:04:58.246 20:10:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:58.246 20:10:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3234269 00:04:58.246 20:10:30 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:58.246 20:10:30 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:58.246 20:10:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3234269' 00:04:58.246 killing process with pid 3234269 00:04:58.246 20:10:30 -- common/autotest_common.sh@945 -- # kill 3234269 00:04:58.246 20:10:30 -- common/autotest_common.sh@950 -- # wait 3234269 00:04:59.183 20:10:30 -- event/cpu_locks.sh@90 -- # killprocess 3234495 00:04:59.183 20:10:30 -- common/autotest_common.sh@926 -- # '[' -z 3234495 ']' 00:04:59.183 20:10:30 -- common/autotest_common.sh@930 -- # kill -0 3234495 00:04:59.183 20:10:30 -- common/autotest_common.sh@931 -- # uname 00:04:59.183 20:10:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:59.183 20:10:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3234495 00:04:59.183 20:10:30 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:59.183 20:10:30 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:59.183 20:10:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3234495' 00:04:59.183 killing process with pid 3234495 00:04:59.183 20:10:30 -- common/autotest_common.sh@945 -- # kill 3234495 00:04:59.183 20:10:30 -- common/autotest_common.sh@950 -- # wait 3234495 00:04:59.442 00:04:59.442 real 0m3.288s 00:04:59.442 user 0m3.522s 00:04:59.442 sys 0m0.901s 00:04:59.442 20:10:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:59.442 20:10:31 -- common/autotest_common.sh@10 -- # set +x 00:04:59.442 ************************************ 00:04:59.442 END TEST non_locking_app_on_locked_coremask 00:04:59.442 ************************************ 00:04:59.442 20:10:31 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:04:59.442 20:10:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:59.442 20:10:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:59.442 20:10:31 -- common/autotest_common.sh@10 -- # set +x 00:04:59.442 ************************************ 00:04:59.443 START TEST locking_app_on_unlocked_coremask 00:04:59.443 ************************************ 00:04:59.443 20:10:31 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:04:59.443 20:10:31 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3234996 00:04:59.443 20:10:31 -- event/cpu_locks.sh@99 -- # waitforlisten 3234996 /var/tmp/spdk.sock 00:04:59.443 20:10:31 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:04:59.443 20:10:31 -- common/autotest_common.sh@819 -- # '[' -z 3234996 ']' 00:04:59.443 20:10:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:59.443 20:10:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:59.443 20:10:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:59.443 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:59.443 20:10:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:59.443 20:10:31 -- common/autotest_common.sh@10 -- # set +x 00:04:59.443 [2024-07-22 20:10:31.247263] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:04:59.443 [2024-07-22 20:10:31.247310] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3234996 ] 00:04:59.443 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.443 [2024-07-22 20:10:31.299425] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:59.443 [2024-07-22 20:10:31.299451] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:59.443 [2024-07-22 20:10:31.376492] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:59.443 [2024-07-22 20:10:31.376601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.379 20:10:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:00.379 20:10:32 -- common/autotest_common.sh@852 -- # return 0 00:05:00.379 20:10:32 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:00.379 20:10:32 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3235008 00:05:00.379 20:10:32 -- event/cpu_locks.sh@103 -- # waitforlisten 3235008 /var/tmp/spdk2.sock 00:05:00.379 20:10:32 -- common/autotest_common.sh@819 -- # '[' -z 3235008 ']' 00:05:00.379 20:10:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:00.379 20:10:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:00.379 20:10:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:00.379 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:00.379 20:10:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:00.379 20:10:32 -- common/autotest_common.sh@10 -- # set +x 00:05:00.379 [2024-07-22 20:10:32.065619] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:00.379 [2024-07-22 20:10:32.065663] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3235008 ] 00:05:00.379 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.379 [2024-07-22 20:10:32.133966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.379 [2024-07-22 20:10:32.275785] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:00.379 [2024-07-22 20:10:32.275919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.947 20:10:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:00.947 20:10:32 -- common/autotest_common.sh@852 -- # return 0 00:05:01.205 20:10:32 -- event/cpu_locks.sh@105 -- # locks_exist 3235008 00:05:01.205 20:10:32 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:01.205 20:10:32 -- event/cpu_locks.sh@22 -- # lslocks -p 3235008 00:05:01.474 lslocks: write error 00:05:01.474 20:10:33 -- event/cpu_locks.sh@107 -- # killprocess 3234996 00:05:01.474 20:10:33 -- common/autotest_common.sh@926 -- # '[' -z 3234996 ']' 00:05:01.474 20:10:33 -- common/autotest_common.sh@930 -- # kill -0 3234996 00:05:01.474 20:10:33 -- common/autotest_common.sh@931 -- # uname 00:05:01.474 20:10:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:01.474 20:10:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3234996 00:05:01.474 20:10:33 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:01.474 20:10:33 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:01.474 20:10:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3234996' 00:05:01.474 killing process with pid 3234996 00:05:01.474 20:10:33 -- common/autotest_common.sh@945 -- # kill 3234996 00:05:01.474 20:10:33 -- common/autotest_common.sh@950 -- # wait 3234996 00:05:02.040 20:10:33 -- event/cpu_locks.sh@108 -- # killprocess 3235008 00:05:02.040 20:10:33 -- common/autotest_common.sh@926 -- # '[' -z 3235008 ']' 00:05:02.040 20:10:33 -- common/autotest_common.sh@930 -- # kill -0 3235008 00:05:02.040 20:10:33 -- common/autotest_common.sh@931 -- # uname 00:05:02.040 20:10:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:02.040 20:10:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3235008 00:05:02.300 20:10:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:02.300 20:10:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:02.300 20:10:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3235008' 00:05:02.300 killing process with pid 3235008 00:05:02.300 20:10:34 -- common/autotest_common.sh@945 -- # kill 3235008 00:05:02.300 20:10:34 -- common/autotest_common.sh@950 -- # wait 3235008 00:05:02.559 00:05:02.559 real 0m3.137s 00:05:02.559 user 0m3.353s 00:05:02.559 sys 0m0.840s 00:05:02.559 20:10:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:02.559 20:10:34 -- common/autotest_common.sh@10 -- # set +x 00:05:02.559 ************************************ 00:05:02.559 END TEST locking_app_on_unlocked_coremask 00:05:02.559 ************************************ 00:05:02.559 20:10:34 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:02.559 20:10:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:02.559 20:10:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:02.559 20:10:34 -- common/autotest_common.sh@10 -- # set +x 00:05:02.559 ************************************ 00:05:02.559 START TEST locking_app_on_locked_coremask 00:05:02.559 ************************************ 00:05:02.559 20:10:34 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:05:02.559 20:10:34 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3235505 00:05:02.559 20:10:34 -- event/cpu_locks.sh@116 -- # waitforlisten 3235505 /var/tmp/spdk.sock 00:05:02.559 20:10:34 -- common/autotest_common.sh@819 -- # '[' -z 3235505 ']' 00:05:02.559 20:10:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:02.559 20:10:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:02.559 20:10:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:02.559 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:02.559 20:10:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:02.559 20:10:34 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:02.559 20:10:34 -- common/autotest_common.sh@10 -- # set +x 00:05:02.559 [2024-07-22 20:10:34.415260] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:02.559 [2024-07-22 20:10:34.415307] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3235505 ] 00:05:02.559 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.559 [2024-07-22 20:10:34.468004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.818 [2024-07-22 20:10:34.546323] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:02.818 [2024-07-22 20:10:34.546434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.385 20:10:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:03.385 20:10:35 -- common/autotest_common.sh@852 -- # return 0 00:05:03.385 20:10:35 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3235713 00:05:03.385 20:10:35 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3235713 /var/tmp/spdk2.sock 00:05:03.385 20:10:35 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:03.385 20:10:35 -- common/autotest_common.sh@640 -- # local es=0 00:05:03.385 20:10:35 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3235713 /var/tmp/spdk2.sock 00:05:03.385 20:10:35 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:03.385 20:10:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:03.385 20:10:35 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:03.385 20:10:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:03.385 20:10:35 -- common/autotest_common.sh@643 -- # waitforlisten 3235713 /var/tmp/spdk2.sock 00:05:03.385 20:10:35 -- common/autotest_common.sh@819 -- # '[' -z 3235713 ']' 00:05:03.385 20:10:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:03.385 20:10:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:03.385 20:10:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:03.385 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:03.385 20:10:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:03.385 20:10:35 -- common/autotest_common.sh@10 -- # set +x 00:05:03.385 [2024-07-22 20:10:35.220855] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:03.385 [2024-07-22 20:10:35.220901] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3235713 ] 00:05:03.385 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.385 [2024-07-22 20:10:35.296337] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3235505 has claimed it. 00:05:03.385 [2024-07-22 20:10:35.296371] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:03.952 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3235713) - No such process 00:05:03.952 ERROR: process (pid: 3235713) is no longer running 00:05:03.952 20:10:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:03.952 20:10:35 -- common/autotest_common.sh@852 -- # return 1 00:05:03.952 20:10:35 -- common/autotest_common.sh@643 -- # es=1 00:05:03.952 20:10:35 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:03.952 20:10:35 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:03.952 20:10:35 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:03.952 20:10:35 -- event/cpu_locks.sh@122 -- # locks_exist 3235505 00:05:03.952 20:10:35 -- event/cpu_locks.sh@22 -- # lslocks -p 3235505 00:05:03.952 20:10:35 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:04.211 lslocks: write error 00:05:04.211 20:10:35 -- event/cpu_locks.sh@124 -- # killprocess 3235505 00:05:04.211 20:10:35 -- common/autotest_common.sh@926 -- # '[' -z 3235505 ']' 00:05:04.212 20:10:35 -- common/autotest_common.sh@930 -- # kill -0 3235505 00:05:04.212 20:10:35 -- common/autotest_common.sh@931 -- # uname 00:05:04.212 20:10:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:04.212 20:10:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3235505 00:05:04.212 20:10:36 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:04.212 20:10:36 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:04.212 20:10:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3235505' 00:05:04.212 killing process with pid 3235505 00:05:04.212 20:10:36 -- common/autotest_common.sh@945 -- # kill 3235505 00:05:04.212 20:10:36 -- common/autotest_common.sh@950 -- # wait 3235505 00:05:04.471 00:05:04.471 real 0m1.983s 00:05:04.471 user 0m2.176s 00:05:04.471 sys 0m0.471s 00:05:04.471 20:10:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:04.471 20:10:36 -- common/autotest_common.sh@10 -- # set +x 00:05:04.471 ************************************ 00:05:04.471 END TEST locking_app_on_locked_coremask 00:05:04.471 ************************************ 00:05:04.471 20:10:36 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:04.471 20:10:36 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:04.471 20:10:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:04.471 20:10:36 -- common/autotest_common.sh@10 -- # set +x 00:05:04.471 ************************************ 00:05:04.471 START TEST locking_overlapped_coremask 00:05:04.471 ************************************ 00:05:04.471 20:10:36 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:05:04.471 20:10:36 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3235862 00:05:04.471 20:10:36 -- event/cpu_locks.sh@133 -- # waitforlisten 3235862 /var/tmp/spdk.sock 00:05:04.471 20:10:36 -- common/autotest_common.sh@819 -- # '[' -z 3235862 ']' 00:05:04.471 20:10:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:04.471 20:10:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:04.471 20:10:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:04.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:04.471 20:10:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:04.471 20:10:36 -- common/autotest_common.sh@10 -- # set +x 00:05:04.471 20:10:36 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:04.730 [2024-07-22 20:10:36.434167] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:04.730 [2024-07-22 20:10:36.434218] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3235862 ] 00:05:04.730 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.730 [2024-07-22 20:10:36.489376] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:04.730 [2024-07-22 20:10:36.567450] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:04.730 [2024-07-22 20:10:36.567596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:04.730 [2024-07-22 20:10:36.567617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:04.730 [2024-07-22 20:10:36.567619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.296 20:10:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:05.296 20:10:37 -- common/autotest_common.sh@852 -- # return 0 00:05:05.296 20:10:37 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3236013 00:05:05.296 20:10:37 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3236013 /var/tmp/spdk2.sock 00:05:05.296 20:10:37 -- common/autotest_common.sh@640 -- # local es=0 00:05:05.296 20:10:37 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3236013 /var/tmp/spdk2.sock 00:05:05.296 20:10:37 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:05.296 20:10:37 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:05.296 20:10:37 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:05.296 20:10:37 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:05.296 20:10:37 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:05.296 20:10:37 -- common/autotest_common.sh@643 -- # waitforlisten 3236013 /var/tmp/spdk2.sock 00:05:05.296 20:10:37 -- common/autotest_common.sh@819 -- # '[' -z 3236013 ']' 00:05:05.296 20:10:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:05.297 20:10:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:05.297 20:10:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:05.297 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:05.297 20:10:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:05.297 20:10:37 -- common/autotest_common.sh@10 -- # set +x 00:05:05.555 [2024-07-22 20:10:37.263533] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:05.555 [2024-07-22 20:10:37.263581] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3236013 ] 00:05:05.555 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.555 [2024-07-22 20:10:37.344124] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3235862 has claimed it. 00:05:05.555 [2024-07-22 20:10:37.344160] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:06.123 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3236013) - No such process 00:05:06.123 ERROR: process (pid: 3236013) is no longer running 00:05:06.123 20:10:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:06.123 20:10:37 -- common/autotest_common.sh@852 -- # return 1 00:05:06.123 20:10:37 -- common/autotest_common.sh@643 -- # es=1 00:05:06.123 20:10:37 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:06.123 20:10:37 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:06.123 20:10:37 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:06.123 20:10:37 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:06.123 20:10:37 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:06.123 20:10:37 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:06.123 20:10:37 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:06.123 20:10:37 -- event/cpu_locks.sh@141 -- # killprocess 3235862 00:05:06.123 20:10:37 -- common/autotest_common.sh@926 -- # '[' -z 3235862 ']' 00:05:06.123 20:10:37 -- common/autotest_common.sh@930 -- # kill -0 3235862 00:05:06.123 20:10:37 -- common/autotest_common.sh@931 -- # uname 00:05:06.123 20:10:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:06.123 20:10:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3235862 00:05:06.123 20:10:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:06.123 20:10:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:06.123 20:10:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3235862' 00:05:06.123 killing process with pid 3235862 00:05:06.123 20:10:37 -- common/autotest_common.sh@945 -- # kill 3235862 00:05:06.123 20:10:37 -- common/autotest_common.sh@950 -- # wait 3235862 00:05:06.382 00:05:06.382 real 0m1.888s 00:05:06.382 user 0m5.294s 00:05:06.382 sys 0m0.378s 00:05:06.382 20:10:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:06.382 20:10:38 -- common/autotest_common.sh@10 -- # set +x 00:05:06.382 ************************************ 00:05:06.382 END TEST locking_overlapped_coremask 00:05:06.382 ************************************ 00:05:06.382 20:10:38 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:06.382 20:10:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:06.382 20:10:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:06.382 20:10:38 -- common/autotest_common.sh@10 -- # set +x 00:05:06.382 ************************************ 00:05:06.382 START TEST locking_overlapped_coremask_via_rpc 00:05:06.382 ************************************ 00:05:06.382 20:10:38 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:05:06.382 20:10:38 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3236270 00:05:06.382 20:10:38 -- event/cpu_locks.sh@149 -- # waitforlisten 3236270 /var/tmp/spdk.sock 00:05:06.382 20:10:38 -- common/autotest_common.sh@819 -- # '[' -z 3236270 ']' 00:05:06.383 20:10:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:06.383 20:10:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:06.383 20:10:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:06.383 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:06.383 20:10:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:06.383 20:10:38 -- common/autotest_common.sh@10 -- # set +x 00:05:06.383 20:10:38 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:06.641 [2024-07-22 20:10:38.358598] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:06.641 [2024-07-22 20:10:38.358644] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3236270 ] 00:05:06.641 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.641 [2024-07-22 20:10:38.411628] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:06.641 [2024-07-22 20:10:38.411654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:06.641 [2024-07-22 20:10:38.489882] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:06.641 [2024-07-22 20:10:38.490037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:06.641 [2024-07-22 20:10:38.490061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:06.641 [2024-07-22 20:10:38.490064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.576 20:10:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:07.576 20:10:39 -- common/autotest_common.sh@852 -- # return 0 00:05:07.576 20:10:39 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3236377 00:05:07.576 20:10:39 -- event/cpu_locks.sh@153 -- # waitforlisten 3236377 /var/tmp/spdk2.sock 00:05:07.576 20:10:39 -- common/autotest_common.sh@819 -- # '[' -z 3236377 ']' 00:05:07.576 20:10:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:07.576 20:10:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:07.576 20:10:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:07.576 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:07.576 20:10:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:07.576 20:10:39 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:07.576 20:10:39 -- common/autotest_common.sh@10 -- # set +x 00:05:07.576 [2024-07-22 20:10:39.198463] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:07.576 [2024-07-22 20:10:39.198512] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3236377 ] 00:05:07.576 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.576 [2024-07-22 20:10:39.276479] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:07.576 [2024-07-22 20:10:39.276508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:07.576 [2024-07-22 20:10:39.426172] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:07.576 [2024-07-22 20:10:39.426346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:07.576 [2024-07-22 20:10:39.432111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:07.576 [2024-07-22 20:10:39.432112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:08.143 20:10:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:08.143 20:10:39 -- common/autotest_common.sh@852 -- # return 0 00:05:08.143 20:10:39 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:08.143 20:10:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:08.143 20:10:39 -- common/autotest_common.sh@10 -- # set +x 00:05:08.143 20:10:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:08.143 20:10:40 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:08.143 20:10:40 -- common/autotest_common.sh@640 -- # local es=0 00:05:08.143 20:10:40 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:08.143 20:10:40 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:05:08.143 20:10:40 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:08.143 20:10:40 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:05:08.143 20:10:40 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:08.143 20:10:40 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:08.143 20:10:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:08.143 20:10:40 -- common/autotest_common.sh@10 -- # set +x 00:05:08.143 [2024-07-22 20:10:40.016114] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3236270 has claimed it. 00:05:08.143 request: 00:05:08.143 { 00:05:08.143 "method": "framework_enable_cpumask_locks", 00:05:08.143 "req_id": 1 00:05:08.143 } 00:05:08.143 Got JSON-RPC error response 00:05:08.143 response: 00:05:08.143 { 00:05:08.143 "code": -32603, 00:05:08.143 "message": "Failed to claim CPU core: 2" 00:05:08.143 } 00:05:08.143 20:10:40 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:05:08.143 20:10:40 -- common/autotest_common.sh@643 -- # es=1 00:05:08.143 20:10:40 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:08.143 20:10:40 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:08.143 20:10:40 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:08.143 20:10:40 -- event/cpu_locks.sh@158 -- # waitforlisten 3236270 /var/tmp/spdk.sock 00:05:08.143 20:10:40 -- common/autotest_common.sh@819 -- # '[' -z 3236270 ']' 00:05:08.143 20:10:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:08.143 20:10:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:08.143 20:10:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:08.143 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:08.143 20:10:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:08.143 20:10:40 -- common/autotest_common.sh@10 -- # set +x 00:05:08.402 20:10:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:08.402 20:10:40 -- common/autotest_common.sh@852 -- # return 0 00:05:08.402 20:10:40 -- event/cpu_locks.sh@159 -- # waitforlisten 3236377 /var/tmp/spdk2.sock 00:05:08.402 20:10:40 -- common/autotest_common.sh@819 -- # '[' -z 3236377 ']' 00:05:08.402 20:10:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:08.402 20:10:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:08.402 20:10:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:08.402 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:08.402 20:10:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:08.402 20:10:40 -- common/autotest_common.sh@10 -- # set +x 00:05:08.660 20:10:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:08.660 20:10:40 -- common/autotest_common.sh@852 -- # return 0 00:05:08.660 20:10:40 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:08.660 20:10:40 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:08.660 20:10:40 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:08.660 20:10:40 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:08.660 00:05:08.660 real 0m2.067s 00:05:08.660 user 0m0.836s 00:05:08.660 sys 0m0.162s 00:05:08.660 20:10:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:08.660 20:10:40 -- common/autotest_common.sh@10 -- # set +x 00:05:08.660 ************************************ 00:05:08.660 END TEST locking_overlapped_coremask_via_rpc 00:05:08.660 ************************************ 00:05:08.660 20:10:40 -- event/cpu_locks.sh@174 -- # cleanup 00:05:08.660 20:10:40 -- event/cpu_locks.sh@15 -- # [[ -z 3236270 ]] 00:05:08.660 20:10:40 -- event/cpu_locks.sh@15 -- # killprocess 3236270 00:05:08.660 20:10:40 -- common/autotest_common.sh@926 -- # '[' -z 3236270 ']' 00:05:08.660 20:10:40 -- common/autotest_common.sh@930 -- # kill -0 3236270 00:05:08.660 20:10:40 -- common/autotest_common.sh@931 -- # uname 00:05:08.660 20:10:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:08.660 20:10:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3236270 00:05:08.660 20:10:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:08.660 20:10:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:08.660 20:10:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3236270' 00:05:08.660 killing process with pid 3236270 00:05:08.660 20:10:40 -- common/autotest_common.sh@945 -- # kill 3236270 00:05:08.660 20:10:40 -- common/autotest_common.sh@950 -- # wait 3236270 00:05:08.919 20:10:40 -- event/cpu_locks.sh@16 -- # [[ -z 3236377 ]] 00:05:08.919 20:10:40 -- event/cpu_locks.sh@16 -- # killprocess 3236377 00:05:08.919 20:10:40 -- common/autotest_common.sh@926 -- # '[' -z 3236377 ']' 00:05:08.919 20:10:40 -- common/autotest_common.sh@930 -- # kill -0 3236377 00:05:08.919 20:10:40 -- common/autotest_common.sh@931 -- # uname 00:05:08.919 20:10:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:08.919 20:10:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3236377 00:05:08.919 20:10:40 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:05:08.919 20:10:40 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:05:08.919 20:10:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3236377' 00:05:08.919 killing process with pid 3236377 00:05:08.919 20:10:40 -- common/autotest_common.sh@945 -- # kill 3236377 00:05:08.919 20:10:40 -- common/autotest_common.sh@950 -- # wait 3236377 00:05:09.487 20:10:41 -- event/cpu_locks.sh@18 -- # rm -f 00:05:09.487 20:10:41 -- event/cpu_locks.sh@1 -- # cleanup 00:05:09.487 20:10:41 -- event/cpu_locks.sh@15 -- # [[ -z 3236270 ]] 00:05:09.487 20:10:41 -- event/cpu_locks.sh@15 -- # killprocess 3236270 00:05:09.487 20:10:41 -- common/autotest_common.sh@926 -- # '[' -z 3236270 ']' 00:05:09.487 20:10:41 -- common/autotest_common.sh@930 -- # kill -0 3236270 00:05:09.487 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3236270) - No such process 00:05:09.487 20:10:41 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3236270 is not found' 00:05:09.487 Process with pid 3236270 is not found 00:05:09.487 20:10:41 -- event/cpu_locks.sh@16 -- # [[ -z 3236377 ]] 00:05:09.487 20:10:41 -- event/cpu_locks.sh@16 -- # killprocess 3236377 00:05:09.487 20:10:41 -- common/autotest_common.sh@926 -- # '[' -z 3236377 ']' 00:05:09.487 20:10:41 -- common/autotest_common.sh@930 -- # kill -0 3236377 00:05:09.487 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3236377) - No such process 00:05:09.487 20:10:41 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3236377 is not found' 00:05:09.487 Process with pid 3236377 is not found 00:05:09.487 20:10:41 -- event/cpu_locks.sh@18 -- # rm -f 00:05:09.487 00:05:09.487 real 0m16.719s 00:05:09.487 user 0m29.035s 00:05:09.487 sys 0m4.548s 00:05:09.487 20:10:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:09.487 20:10:41 -- common/autotest_common.sh@10 -- # set +x 00:05:09.487 ************************************ 00:05:09.487 END TEST cpu_locks 00:05:09.487 ************************************ 00:05:09.487 00:05:09.487 real 0m41.733s 00:05:09.487 user 1m20.597s 00:05:09.487 sys 0m7.535s 00:05:09.487 20:10:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:09.487 20:10:41 -- common/autotest_common.sh@10 -- # set +x 00:05:09.487 ************************************ 00:05:09.487 END TEST event 00:05:09.487 ************************************ 00:05:09.487 20:10:41 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:09.487 20:10:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:09.487 20:10:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:09.487 20:10:41 -- common/autotest_common.sh@10 -- # set +x 00:05:09.487 ************************************ 00:05:09.487 START TEST thread 00:05:09.487 ************************************ 00:05:09.487 20:10:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:09.487 * Looking for test storage... 00:05:09.487 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:09.487 20:10:41 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:09.487 20:10:41 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:09.487 20:10:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:09.488 20:10:41 -- common/autotest_common.sh@10 -- # set +x 00:05:09.488 ************************************ 00:05:09.488 START TEST thread_poller_perf 00:05:09.488 ************************************ 00:05:09.488 20:10:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:09.488 [2024-07-22 20:10:41.376056] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:09.488 [2024-07-22 20:10:41.376136] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3236845 ] 00:05:09.488 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.747 [2024-07-22 20:10:41.435327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.747 [2024-07-22 20:10:41.508186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.747 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:10.682 ====================================== 00:05:10.682 busy:2308597382 (cyc) 00:05:10.682 total_run_count: 390000 00:05:10.682 tsc_hz: 2300000000 (cyc) 00:05:10.682 ====================================== 00:05:10.682 poller_cost: 5919 (cyc), 2573 (nsec) 00:05:10.682 00:05:10.682 real 0m1.249s 00:05:10.682 user 0m1.178s 00:05:10.682 sys 0m0.066s 00:05:10.682 20:10:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:10.682 20:10:42 -- common/autotest_common.sh@10 -- # set +x 00:05:10.682 ************************************ 00:05:10.682 END TEST thread_poller_perf 00:05:10.682 ************************************ 00:05:10.941 20:10:42 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:10.941 20:10:42 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:10.941 20:10:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:10.941 20:10:42 -- common/autotest_common.sh@10 -- # set +x 00:05:10.941 ************************************ 00:05:10.941 START TEST thread_poller_perf 00:05:10.941 ************************************ 00:05:10.941 20:10:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:10.941 [2024-07-22 20:10:42.663576] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:10.941 [2024-07-22 20:10:42.663654] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3237101 ] 00:05:10.941 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.941 [2024-07-22 20:10:42.721480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.941 [2024-07-22 20:10:42.788478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.941 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:12.316 ====================================== 00:05:12.316 busy:2302153672 (cyc) 00:05:12.316 total_run_count: 5361000 00:05:12.316 tsc_hz: 2300000000 (cyc) 00:05:12.316 ====================================== 00:05:12.316 poller_cost: 429 (cyc), 186 (nsec) 00:05:12.316 00:05:12.316 real 0m1.241s 00:05:12.316 user 0m1.165s 00:05:12.316 sys 0m0.072s 00:05:12.316 20:10:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:12.316 20:10:43 -- common/autotest_common.sh@10 -- # set +x 00:05:12.316 ************************************ 00:05:12.316 END TEST thread_poller_perf 00:05:12.316 ************************************ 00:05:12.316 20:10:43 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:12.316 00:05:12.316 real 0m2.648s 00:05:12.316 user 0m2.403s 00:05:12.316 sys 0m0.255s 00:05:12.316 20:10:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:12.316 20:10:43 -- common/autotest_common.sh@10 -- # set +x 00:05:12.316 ************************************ 00:05:12.316 END TEST thread 00:05:12.316 ************************************ 00:05:12.316 20:10:43 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:12.316 20:10:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:12.316 20:10:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:12.316 20:10:43 -- common/autotest_common.sh@10 -- # set +x 00:05:12.316 ************************************ 00:05:12.316 START TEST accel 00:05:12.316 ************************************ 00:05:12.316 20:10:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:12.316 * Looking for test storage... 00:05:12.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:12.316 20:10:44 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:12.316 20:10:44 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:12.316 20:10:44 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:12.316 20:10:44 -- accel/accel.sh@59 -- # spdk_tgt_pid=3237389 00:05:12.316 20:10:44 -- accel/accel.sh@60 -- # waitforlisten 3237389 00:05:12.316 20:10:44 -- common/autotest_common.sh@819 -- # '[' -z 3237389 ']' 00:05:12.316 20:10:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.316 20:10:44 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:12.316 20:10:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:12.316 20:10:44 -- accel/accel.sh@58 -- # build_accel_config 00:05:12.316 20:10:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.316 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.316 20:10:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:12.316 20:10:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:12.316 20:10:44 -- common/autotest_common.sh@10 -- # set +x 00:05:12.316 20:10:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:12.316 20:10:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:12.316 20:10:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:12.316 20:10:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:12.316 20:10:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:12.316 20:10:44 -- accel/accel.sh@42 -- # jq -r . 00:05:12.316 [2024-07-22 20:10:44.087414] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:12.316 [2024-07-22 20:10:44.087470] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3237389 ] 00:05:12.316 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.316 [2024-07-22 20:10:44.142731] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.316 [2024-07-22 20:10:44.213948] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.316 [2024-07-22 20:10:44.214073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.250 20:10:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:13.250 20:10:44 -- common/autotest_common.sh@852 -- # return 0 00:05:13.250 20:10:44 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:13.250 20:10:44 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:13.250 20:10:44 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:13.250 20:10:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:13.250 20:10:44 -- common/autotest_common.sh@10 -- # set +x 00:05:13.250 20:10:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.250 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.250 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.250 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.251 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.251 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.251 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.251 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.251 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.251 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.251 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.251 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.251 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.251 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.251 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.251 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.251 20:10:44 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:13.251 20:10:44 -- accel/accel.sh@64 -- # IFS== 00:05:13.251 20:10:44 -- accel/accel.sh@64 -- # read -r opc module 00:05:13.251 20:10:44 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:13.251 20:10:44 -- accel/accel.sh@67 -- # killprocess 3237389 00:05:13.251 20:10:44 -- common/autotest_common.sh@926 -- # '[' -z 3237389 ']' 00:05:13.251 20:10:44 -- common/autotest_common.sh@930 -- # kill -0 3237389 00:05:13.251 20:10:44 -- common/autotest_common.sh@931 -- # uname 00:05:13.251 20:10:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:13.251 20:10:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3237389 00:05:13.251 20:10:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:13.251 20:10:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:13.251 20:10:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3237389' 00:05:13.251 killing process with pid 3237389 00:05:13.251 20:10:44 -- common/autotest_common.sh@945 -- # kill 3237389 00:05:13.251 20:10:44 -- common/autotest_common.sh@950 -- # wait 3237389 00:05:13.510 20:10:45 -- accel/accel.sh@68 -- # trap - ERR 00:05:13.510 20:10:45 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:13.510 20:10:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:05:13.510 20:10:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:13.510 20:10:45 -- common/autotest_common.sh@10 -- # set +x 00:05:13.510 20:10:45 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:05:13.510 20:10:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:13.510 20:10:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:13.510 20:10:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:13.510 20:10:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:13.510 20:10:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:13.510 20:10:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:13.510 20:10:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:13.510 20:10:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:13.510 20:10:45 -- accel/accel.sh@42 -- # jq -r . 00:05:13.510 20:10:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:13.510 20:10:45 -- common/autotest_common.sh@10 -- # set +x 00:05:13.510 20:10:45 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:13.510 20:10:45 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:13.510 20:10:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:13.510 20:10:45 -- common/autotest_common.sh@10 -- # set +x 00:05:13.510 ************************************ 00:05:13.510 START TEST accel_missing_filename 00:05:13.510 ************************************ 00:05:13.510 20:10:45 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:05:13.510 20:10:45 -- common/autotest_common.sh@640 -- # local es=0 00:05:13.510 20:10:45 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:13.510 20:10:45 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:13.510 20:10:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:13.510 20:10:45 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:13.510 20:10:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:13.510 20:10:45 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:05:13.510 20:10:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:13.510 20:10:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:13.510 20:10:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:13.510 20:10:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:13.510 20:10:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:13.510 20:10:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:13.510 20:10:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:13.510 20:10:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:13.510 20:10:45 -- accel/accel.sh@42 -- # jq -r . 00:05:13.510 [2024-07-22 20:10:45.383408] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:13.510 [2024-07-22 20:10:45.383490] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3237656 ] 00:05:13.510 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.510 [2024-07-22 20:10:45.437629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.769 [2024-07-22 20:10:45.508792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.769 [2024-07-22 20:10:45.549372] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:13.769 [2024-07-22 20:10:45.608977] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:13.769 A filename is required. 00:05:13.769 20:10:45 -- common/autotest_common.sh@643 -- # es=234 00:05:13.769 20:10:45 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:13.769 20:10:45 -- common/autotest_common.sh@652 -- # es=106 00:05:13.769 20:10:45 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:13.769 20:10:45 -- common/autotest_common.sh@660 -- # es=1 00:05:13.769 20:10:45 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:13.769 00:05:13.769 real 0m0.347s 00:05:13.769 user 0m0.264s 00:05:13.769 sys 0m0.122s 00:05:13.769 20:10:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:13.769 20:10:45 -- common/autotest_common.sh@10 -- # set +x 00:05:13.769 ************************************ 00:05:13.769 END TEST accel_missing_filename 00:05:13.769 ************************************ 00:05:14.027 20:10:45 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:14.027 20:10:45 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:14.027 20:10:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:14.027 20:10:45 -- common/autotest_common.sh@10 -- # set +x 00:05:14.027 ************************************ 00:05:14.027 START TEST accel_compress_verify 00:05:14.027 ************************************ 00:05:14.027 20:10:45 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:14.027 20:10:45 -- common/autotest_common.sh@640 -- # local es=0 00:05:14.027 20:10:45 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:14.027 20:10:45 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:14.027 20:10:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:14.027 20:10:45 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:14.027 20:10:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:14.027 20:10:45 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:14.027 20:10:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:14.027 20:10:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:14.027 20:10:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:14.027 20:10:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:14.027 20:10:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:14.028 20:10:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:14.028 20:10:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:14.028 20:10:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:14.028 20:10:45 -- accel/accel.sh@42 -- # jq -r . 00:05:14.028 [2024-07-22 20:10:45.760005] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:14.028 [2024-07-22 20:10:45.760079] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3237685 ] 00:05:14.028 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.028 [2024-07-22 20:10:45.813707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.028 [2024-07-22 20:10:45.884200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.028 [2024-07-22 20:10:45.924488] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:14.286 [2024-07-22 20:10:45.984018] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:14.286 00:05:14.286 Compression does not support the verify option, aborting. 00:05:14.286 20:10:46 -- common/autotest_common.sh@643 -- # es=161 00:05:14.286 20:10:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:14.286 20:10:46 -- common/autotest_common.sh@652 -- # es=33 00:05:14.286 20:10:46 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:14.286 20:10:46 -- common/autotest_common.sh@660 -- # es=1 00:05:14.286 20:10:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:14.286 00:05:14.286 real 0m0.343s 00:05:14.286 user 0m0.265s 00:05:14.286 sys 0m0.113s 00:05:14.286 20:10:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:14.286 20:10:46 -- common/autotest_common.sh@10 -- # set +x 00:05:14.286 ************************************ 00:05:14.286 END TEST accel_compress_verify 00:05:14.286 ************************************ 00:05:14.286 20:10:46 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:14.286 20:10:46 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:14.286 20:10:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:14.286 20:10:46 -- common/autotest_common.sh@10 -- # set +x 00:05:14.286 ************************************ 00:05:14.286 START TEST accel_wrong_workload 00:05:14.286 ************************************ 00:05:14.286 20:10:46 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:05:14.286 20:10:46 -- common/autotest_common.sh@640 -- # local es=0 00:05:14.286 20:10:46 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:14.286 20:10:46 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:14.286 20:10:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:14.286 20:10:46 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:14.286 20:10:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:14.286 20:10:46 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:05:14.286 20:10:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:14.286 20:10:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:14.286 20:10:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:14.286 20:10:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:14.286 20:10:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:14.286 20:10:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:14.286 20:10:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:14.286 20:10:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:14.286 20:10:46 -- accel/accel.sh@42 -- # jq -r . 00:05:14.286 Unsupported workload type: foobar 00:05:14.286 [2024-07-22 20:10:46.132646] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:14.286 accel_perf options: 00:05:14.286 [-h help message] 00:05:14.286 [-q queue depth per core] 00:05:14.286 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:14.286 [-T number of threads per core 00:05:14.286 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:14.286 [-t time in seconds] 00:05:14.286 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:14.286 [ dif_verify, , dif_generate, dif_generate_copy 00:05:14.286 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:14.286 [-l for compress/decompress workloads, name of uncompressed input file 00:05:14.286 [-S for crc32c workload, use this seed value (default 0) 00:05:14.286 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:14.286 [-f for fill workload, use this BYTE value (default 255) 00:05:14.286 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:14.286 [-y verify result if this switch is on] 00:05:14.286 [-a tasks to allocate per core (default: same value as -q)] 00:05:14.286 Can be used to spread operations across a wider range of memory. 00:05:14.286 20:10:46 -- common/autotest_common.sh@643 -- # es=1 00:05:14.286 20:10:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:14.286 20:10:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:14.286 20:10:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:14.286 00:05:14.286 real 0m0.027s 00:05:14.286 user 0m0.016s 00:05:14.286 sys 0m0.011s 00:05:14.286 20:10:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:14.286 20:10:46 -- common/autotest_common.sh@10 -- # set +x 00:05:14.286 ************************************ 00:05:14.286 END TEST accel_wrong_workload 00:05:14.286 ************************************ 00:05:14.286 Error: writing output failed: Broken pipe 00:05:14.286 20:10:46 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:14.286 20:10:46 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:14.286 20:10:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:14.286 20:10:46 -- common/autotest_common.sh@10 -- # set +x 00:05:14.286 ************************************ 00:05:14.286 START TEST accel_negative_buffers 00:05:14.286 ************************************ 00:05:14.286 20:10:46 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:14.286 20:10:46 -- common/autotest_common.sh@640 -- # local es=0 00:05:14.286 20:10:46 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:14.286 20:10:46 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:14.286 20:10:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:14.286 20:10:46 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:14.286 20:10:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:14.286 20:10:46 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:05:14.286 20:10:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:14.286 20:10:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:14.286 20:10:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:14.286 20:10:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:14.286 20:10:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:14.286 20:10:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:14.286 20:10:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:14.286 20:10:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:14.286 20:10:46 -- accel/accel.sh@42 -- # jq -r . 00:05:14.286 -x option must be non-negative. 00:05:14.286 [2024-07-22 20:10:46.192669] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:14.286 accel_perf options: 00:05:14.286 [-h help message] 00:05:14.286 [-q queue depth per core] 00:05:14.286 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:14.286 [-T number of threads per core 00:05:14.286 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:14.286 [-t time in seconds] 00:05:14.286 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:14.286 [ dif_verify, , dif_generate, dif_generate_copy 00:05:14.286 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:14.286 [-l for compress/decompress workloads, name of uncompressed input file 00:05:14.286 [-S for crc32c workload, use this seed value (default 0) 00:05:14.286 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:14.286 [-f for fill workload, use this BYTE value (default 255) 00:05:14.286 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:14.286 [-y verify result if this switch is on] 00:05:14.286 [-a tasks to allocate per core (default: same value as -q)] 00:05:14.286 Can be used to spread operations across a wider range of memory. 00:05:14.286 20:10:46 -- common/autotest_common.sh@643 -- # es=1 00:05:14.286 20:10:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:14.286 20:10:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:14.287 20:10:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:14.287 00:05:14.287 real 0m0.028s 00:05:14.287 user 0m0.014s 00:05:14.287 sys 0m0.014s 00:05:14.287 20:10:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:14.287 20:10:46 -- common/autotest_common.sh@10 -- # set +x 00:05:14.287 ************************************ 00:05:14.287 END TEST accel_negative_buffers 00:05:14.287 ************************************ 00:05:14.287 Error: writing output failed: Broken pipe 00:05:14.545 20:10:46 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:14.545 20:10:46 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:14.545 20:10:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:14.545 20:10:46 -- common/autotest_common.sh@10 -- # set +x 00:05:14.545 ************************************ 00:05:14.545 START TEST accel_crc32c 00:05:14.545 ************************************ 00:05:14.545 20:10:46 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:14.545 20:10:46 -- accel/accel.sh@16 -- # local accel_opc 00:05:14.545 20:10:46 -- accel/accel.sh@17 -- # local accel_module 00:05:14.545 20:10:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:14.545 20:10:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:14.545 20:10:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:14.545 20:10:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:14.545 20:10:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:14.545 20:10:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:14.545 20:10:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:14.545 20:10:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:14.545 20:10:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:14.545 20:10:46 -- accel/accel.sh@42 -- # jq -r . 00:05:14.545 [2024-07-22 20:10:46.253763] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:14.545 [2024-07-22 20:10:46.253833] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3237956 ] 00:05:14.545 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.545 [2024-07-22 20:10:46.307037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.545 [2024-07-22 20:10:46.376872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.922 20:10:47 -- accel/accel.sh@18 -- # out=' 00:05:15.922 SPDK Configuration: 00:05:15.922 Core mask: 0x1 00:05:15.922 00:05:15.922 Accel Perf Configuration: 00:05:15.922 Workload Type: crc32c 00:05:15.922 CRC-32C seed: 32 00:05:15.922 Transfer size: 4096 bytes 00:05:15.922 Vector count 1 00:05:15.922 Module: software 00:05:15.922 Queue depth: 32 00:05:15.922 Allocate depth: 32 00:05:15.922 # threads/core: 1 00:05:15.922 Run time: 1 seconds 00:05:15.922 Verify: Yes 00:05:15.922 00:05:15.922 Running for 1 seconds... 00:05:15.922 00:05:15.922 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:15.922 ------------------------------------------------------------------------------------ 00:05:15.922 0,0 573472/s 2240 MiB/s 0 0 00:05:15.922 ==================================================================================== 00:05:15.922 Total 573472/s 2240 MiB/s 0 0' 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.922 20:10:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.922 20:10:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:15.922 20:10:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:15.922 20:10:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:15.922 20:10:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:15.922 20:10:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:15.922 20:10:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:15.922 20:10:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:15.922 20:10:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:15.922 20:10:47 -- accel/accel.sh@42 -- # jq -r . 00:05:15.922 [2024-07-22 20:10:47.586444] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:15.922 [2024-07-22 20:10:47.586492] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3238168 ] 00:05:15.922 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.922 [2024-07-22 20:10:47.638496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.922 [2024-07-22 20:10:47.707445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.922 20:10:47 -- accel/accel.sh@21 -- # val= 00:05:15.922 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.922 20:10:47 -- accel/accel.sh@21 -- # val= 00:05:15.922 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.922 20:10:47 -- accel/accel.sh@21 -- # val=0x1 00:05:15.922 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.922 20:10:47 -- accel/accel.sh@21 -- # val= 00:05:15.922 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.922 20:10:47 -- accel/accel.sh@21 -- # val= 00:05:15.922 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.922 20:10:47 -- accel/accel.sh@21 -- # val=crc32c 00:05:15.922 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.922 20:10:47 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:15.922 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val=32 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val= 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val=software 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@23 -- # accel_module=software 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val=32 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val=32 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val=1 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val=Yes 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val= 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:15.923 20:10:47 -- accel/accel.sh@21 -- # val= 00:05:15.923 20:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # IFS=: 00:05:15.923 20:10:47 -- accel/accel.sh@20 -- # read -r var val 00:05:17.384 20:10:48 -- accel/accel.sh@21 -- # val= 00:05:17.384 20:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:17.384 20:10:48 -- accel/accel.sh@21 -- # val= 00:05:17.384 20:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:17.384 20:10:48 -- accel/accel.sh@21 -- # val= 00:05:17.384 20:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:17.384 20:10:48 -- accel/accel.sh@21 -- # val= 00:05:17.384 20:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:17.384 20:10:48 -- accel/accel.sh@21 -- # val= 00:05:17.384 20:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:17.384 20:10:48 -- accel/accel.sh@21 -- # val= 00:05:17.384 20:10:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # IFS=: 00:05:17.384 20:10:48 -- accel/accel.sh@20 -- # read -r var val 00:05:17.384 20:10:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:17.384 20:10:48 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:17.384 20:10:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:17.384 00:05:17.384 real 0m2.677s 00:05:17.384 user 0m2.459s 00:05:17.384 sys 0m0.217s 00:05:17.384 20:10:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:17.384 20:10:48 -- common/autotest_common.sh@10 -- # set +x 00:05:17.384 ************************************ 00:05:17.384 END TEST accel_crc32c 00:05:17.384 ************************************ 00:05:17.384 20:10:48 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:17.384 20:10:48 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:17.384 20:10:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:17.384 20:10:48 -- common/autotest_common.sh@10 -- # set +x 00:05:17.384 ************************************ 00:05:17.384 START TEST accel_crc32c_C2 00:05:17.384 ************************************ 00:05:17.384 20:10:48 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:17.384 20:10:48 -- accel/accel.sh@16 -- # local accel_opc 00:05:17.384 20:10:48 -- accel/accel.sh@17 -- # local accel_module 00:05:17.384 20:10:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:17.384 20:10:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:17.384 20:10:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:17.384 20:10:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:17.384 20:10:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:17.384 20:10:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:17.384 20:10:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:17.384 20:10:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:17.384 20:10:48 -- accel/accel.sh@41 -- # local IFS=, 00:05:17.384 20:10:48 -- accel/accel.sh@42 -- # jq -r . 00:05:17.384 [2024-07-22 20:10:48.961216] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:17.384 [2024-07-22 20:10:48.961272] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3238413 ] 00:05:17.384 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.384 [2024-07-22 20:10:49.013606] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.384 [2024-07-22 20:10:49.083244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.761 20:10:50 -- accel/accel.sh@18 -- # out=' 00:05:18.761 SPDK Configuration: 00:05:18.761 Core mask: 0x1 00:05:18.761 00:05:18.761 Accel Perf Configuration: 00:05:18.761 Workload Type: crc32c 00:05:18.761 CRC-32C seed: 0 00:05:18.761 Transfer size: 4096 bytes 00:05:18.761 Vector count 2 00:05:18.761 Module: software 00:05:18.761 Queue depth: 32 00:05:18.761 Allocate depth: 32 00:05:18.761 # threads/core: 1 00:05:18.761 Run time: 1 seconds 00:05:18.761 Verify: Yes 00:05:18.761 00:05:18.761 Running for 1 seconds... 00:05:18.761 00:05:18.761 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:18.761 ------------------------------------------------------------------------------------ 00:05:18.761 0,0 449312/s 3510 MiB/s 0 0 00:05:18.761 ==================================================================================== 00:05:18.761 Total 449312/s 1755 MiB/s 0 0' 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:18.761 20:10:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.761 20:10:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.761 20:10:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.761 20:10:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.761 20:10:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.761 20:10:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.761 20:10:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.761 20:10:50 -- accel/accel.sh@42 -- # jq -r . 00:05:18.761 [2024-07-22 20:10:50.294442] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:18.761 [2024-07-22 20:10:50.294489] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3238623 ] 00:05:18.761 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.761 [2024-07-22 20:10:50.346711] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.761 [2024-07-22 20:10:50.417587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val= 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val= 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val=0x1 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val= 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val= 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val=crc32c 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val=0 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val= 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val=software 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@23 -- # accel_module=software 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val=32 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val=32 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val=1 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val=Yes 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val= 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:18.761 20:10:50 -- accel/accel.sh@21 -- # val= 00:05:18.761 20:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # IFS=: 00:05:18.761 20:10:50 -- accel/accel.sh@20 -- # read -r var val 00:05:19.698 20:10:51 -- accel/accel.sh@21 -- # val= 00:05:19.698 20:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:19.698 20:10:51 -- accel/accel.sh@21 -- # val= 00:05:19.698 20:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:19.698 20:10:51 -- accel/accel.sh@21 -- # val= 00:05:19.698 20:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:19.698 20:10:51 -- accel/accel.sh@21 -- # val= 00:05:19.698 20:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:19.698 20:10:51 -- accel/accel.sh@21 -- # val= 00:05:19.698 20:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:19.698 20:10:51 -- accel/accel.sh@21 -- # val= 00:05:19.698 20:10:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # IFS=: 00:05:19.698 20:10:51 -- accel/accel.sh@20 -- # read -r var val 00:05:19.698 20:10:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:19.698 20:10:51 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:19.698 20:10:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:19.698 00:05:19.698 real 0m2.681s 00:05:19.698 user 0m2.472s 00:05:19.698 sys 0m0.208s 00:05:19.698 20:10:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:19.698 20:10:51 -- common/autotest_common.sh@10 -- # set +x 00:05:19.698 ************************************ 00:05:19.698 END TEST accel_crc32c_C2 00:05:19.698 ************************************ 00:05:19.956 20:10:51 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:19.956 20:10:51 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:19.956 20:10:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:19.956 20:10:51 -- common/autotest_common.sh@10 -- # set +x 00:05:19.956 ************************************ 00:05:19.956 START TEST accel_copy 00:05:19.956 ************************************ 00:05:19.956 20:10:51 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:05:19.956 20:10:51 -- accel/accel.sh@16 -- # local accel_opc 00:05:19.956 20:10:51 -- accel/accel.sh@17 -- # local accel_module 00:05:19.956 20:10:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:19.956 20:10:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:19.956 20:10:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:19.956 20:10:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.956 20:10:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.956 20:10:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.956 20:10:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.956 20:10:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.956 20:10:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.956 20:10:51 -- accel/accel.sh@42 -- # jq -r . 00:05:19.956 [2024-07-22 20:10:51.675630] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:19.957 [2024-07-22 20:10:51.675684] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3238870 ] 00:05:19.957 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.957 [2024-07-22 20:10:51.729075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.957 [2024-07-22 20:10:51.799244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.332 20:10:52 -- accel/accel.sh@18 -- # out=' 00:05:21.332 SPDK Configuration: 00:05:21.332 Core mask: 0x1 00:05:21.332 00:05:21.332 Accel Perf Configuration: 00:05:21.332 Workload Type: copy 00:05:21.332 Transfer size: 4096 bytes 00:05:21.332 Vector count 1 00:05:21.332 Module: software 00:05:21.332 Queue depth: 32 00:05:21.332 Allocate depth: 32 00:05:21.332 # threads/core: 1 00:05:21.332 Run time: 1 seconds 00:05:21.332 Verify: Yes 00:05:21.332 00:05:21.332 Running for 1 seconds... 00:05:21.332 00:05:21.332 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:21.332 ------------------------------------------------------------------------------------ 00:05:21.332 0,0 425248/s 1661 MiB/s 0 0 00:05:21.332 ==================================================================================== 00:05:21.332 Total 425248/s 1661 MiB/s 0 0' 00:05:21.332 20:10:52 -- accel/accel.sh@20 -- # IFS=: 00:05:21.332 20:10:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:21.332 20:10:52 -- accel/accel.sh@20 -- # read -r var val 00:05:21.332 20:10:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:21.332 20:10:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.332 20:10:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.332 20:10:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.332 20:10:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.332 20:10:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.332 20:10:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.332 20:10:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.332 20:10:52 -- accel/accel.sh@42 -- # jq -r . 00:05:21.332 [2024-07-22 20:10:53.008304] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:21.332 [2024-07-22 20:10:53.008356] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3239089 ] 00:05:21.332 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.333 [2024-07-22 20:10:53.060548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.333 [2024-07-22 20:10:53.130820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val= 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val= 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val=0x1 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val= 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val= 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val=copy 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val= 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val=software 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@23 -- # accel_module=software 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val=32 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val=32 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val=1 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val=Yes 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val= 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:21.333 20:10:53 -- accel/accel.sh@21 -- # val= 00:05:21.333 20:10:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # IFS=: 00:05:21.333 20:10:53 -- accel/accel.sh@20 -- # read -r var val 00:05:22.709 20:10:54 -- accel/accel.sh@21 -- # val= 00:05:22.709 20:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:22.709 20:10:54 -- accel/accel.sh@21 -- # val= 00:05:22.709 20:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:22.709 20:10:54 -- accel/accel.sh@21 -- # val= 00:05:22.709 20:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:22.709 20:10:54 -- accel/accel.sh@21 -- # val= 00:05:22.709 20:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:22.709 20:10:54 -- accel/accel.sh@21 -- # val= 00:05:22.709 20:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:22.709 20:10:54 -- accel/accel.sh@21 -- # val= 00:05:22.709 20:10:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # IFS=: 00:05:22.709 20:10:54 -- accel/accel.sh@20 -- # read -r var val 00:05:22.709 20:10:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:22.709 20:10:54 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:22.709 20:10:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:22.709 00:05:22.709 real 0m2.679s 00:05:22.709 user 0m2.471s 00:05:22.709 sys 0m0.207s 00:05:22.709 20:10:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.709 20:10:54 -- common/autotest_common.sh@10 -- # set +x 00:05:22.709 ************************************ 00:05:22.709 END TEST accel_copy 00:05:22.709 ************************************ 00:05:22.709 20:10:54 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:22.709 20:10:54 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:05:22.709 20:10:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.709 20:10:54 -- common/autotest_common.sh@10 -- # set +x 00:05:22.709 ************************************ 00:05:22.709 START TEST accel_fill 00:05:22.709 ************************************ 00:05:22.709 20:10:54 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:22.709 20:10:54 -- accel/accel.sh@16 -- # local accel_opc 00:05:22.709 20:10:54 -- accel/accel.sh@17 -- # local accel_module 00:05:22.709 20:10:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:22.709 20:10:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:22.709 20:10:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.709 20:10:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.709 20:10:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.709 20:10:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.709 20:10:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.709 20:10:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.709 20:10:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.709 20:10:54 -- accel/accel.sh@42 -- # jq -r . 00:05:22.709 [2024-07-22 20:10:54.388764] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:22.709 [2024-07-22 20:10:54.388840] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3239332 ] 00:05:22.709 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.709 [2024-07-22 20:10:54.443628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.709 [2024-07-22 20:10:54.515851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.084 20:10:55 -- accel/accel.sh@18 -- # out=' 00:05:24.084 SPDK Configuration: 00:05:24.084 Core mask: 0x1 00:05:24.084 00:05:24.084 Accel Perf Configuration: 00:05:24.084 Workload Type: fill 00:05:24.084 Fill pattern: 0x80 00:05:24.084 Transfer size: 4096 bytes 00:05:24.084 Vector count 1 00:05:24.084 Module: software 00:05:24.084 Queue depth: 64 00:05:24.084 Allocate depth: 64 00:05:24.084 # threads/core: 1 00:05:24.084 Run time: 1 seconds 00:05:24.084 Verify: Yes 00:05:24.084 00:05:24.084 Running for 1 seconds... 00:05:24.084 00:05:24.084 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:24.084 ------------------------------------------------------------------------------------ 00:05:24.084 0,0 659520/s 2576 MiB/s 0 0 00:05:24.084 ==================================================================================== 00:05:24.084 Total 659520/s 2576 MiB/s 0 0' 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:24.084 20:10:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:24.084 20:10:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.084 20:10:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.084 20:10:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.084 20:10:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.084 20:10:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.084 20:10:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.084 20:10:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.084 20:10:55 -- accel/accel.sh@42 -- # jq -r . 00:05:24.084 [2024-07-22 20:10:55.728007] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:24.084 [2024-07-22 20:10:55.728070] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3239557 ] 00:05:24.084 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.084 [2024-07-22 20:10:55.781099] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.084 [2024-07-22 20:10:55.851239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val= 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val= 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val=0x1 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val= 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val= 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val=fill 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val=0x80 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val= 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val=software 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@23 -- # accel_module=software 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val=64 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val=64 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val=1 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val=Yes 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val= 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:24.084 20:10:55 -- accel/accel.sh@21 -- # val= 00:05:24.084 20:10:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # IFS=: 00:05:24.084 20:10:55 -- accel/accel.sh@20 -- # read -r var val 00:05:25.461 20:10:57 -- accel/accel.sh@21 -- # val= 00:05:25.461 20:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:25.461 20:10:57 -- accel/accel.sh@21 -- # val= 00:05:25.461 20:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:25.461 20:10:57 -- accel/accel.sh@21 -- # val= 00:05:25.461 20:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:25.461 20:10:57 -- accel/accel.sh@21 -- # val= 00:05:25.461 20:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:25.461 20:10:57 -- accel/accel.sh@21 -- # val= 00:05:25.461 20:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:25.461 20:10:57 -- accel/accel.sh@21 -- # val= 00:05:25.461 20:10:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # IFS=: 00:05:25.461 20:10:57 -- accel/accel.sh@20 -- # read -r var val 00:05:25.461 20:10:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:25.461 20:10:57 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:25.461 20:10:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:25.461 00:05:25.461 real 0m2.691s 00:05:25.461 user 0m2.481s 00:05:25.461 sys 0m0.210s 00:05:25.461 20:10:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:25.461 20:10:57 -- common/autotest_common.sh@10 -- # set +x 00:05:25.461 ************************************ 00:05:25.461 END TEST accel_fill 00:05:25.461 ************************************ 00:05:25.461 20:10:57 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:25.461 20:10:57 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:25.461 20:10:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:25.461 20:10:57 -- common/autotest_common.sh@10 -- # set +x 00:05:25.461 ************************************ 00:05:25.462 START TEST accel_copy_crc32c 00:05:25.462 ************************************ 00:05:25.462 20:10:57 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:05:25.462 20:10:57 -- accel/accel.sh@16 -- # local accel_opc 00:05:25.462 20:10:57 -- accel/accel.sh@17 -- # local accel_module 00:05:25.462 20:10:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:25.462 20:10:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:25.462 20:10:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.462 20:10:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.462 20:10:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.462 20:10:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.462 20:10:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.462 20:10:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.462 20:10:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.462 20:10:57 -- accel/accel.sh@42 -- # jq -r . 00:05:25.462 [2024-07-22 20:10:57.103096] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:25.462 [2024-07-22 20:10:57.103153] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3239812 ] 00:05:25.462 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.462 [2024-07-22 20:10:57.157746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.462 [2024-07-22 20:10:57.228900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.838 20:10:58 -- accel/accel.sh@18 -- # out=' 00:05:26.838 SPDK Configuration: 00:05:26.838 Core mask: 0x1 00:05:26.838 00:05:26.838 Accel Perf Configuration: 00:05:26.838 Workload Type: copy_crc32c 00:05:26.838 CRC-32C seed: 0 00:05:26.838 Vector size: 4096 bytes 00:05:26.838 Transfer size: 4096 bytes 00:05:26.838 Vector count 1 00:05:26.838 Module: software 00:05:26.838 Queue depth: 32 00:05:26.838 Allocate depth: 32 00:05:26.838 # threads/core: 1 00:05:26.838 Run time: 1 seconds 00:05:26.838 Verify: Yes 00:05:26.838 00:05:26.838 Running for 1 seconds... 00:05:26.838 00:05:26.838 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:26.838 ------------------------------------------------------------------------------------ 00:05:26.838 0,0 325440/s 1271 MiB/s 0 0 00:05:26.838 ==================================================================================== 00:05:26.838 Total 325440/s 1271 MiB/s 0 0' 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:26.838 20:10:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:26.838 20:10:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.838 20:10:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.838 20:10:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.838 20:10:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.838 20:10:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.838 20:10:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.838 20:10:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.838 20:10:58 -- accel/accel.sh@42 -- # jq -r . 00:05:26.838 [2024-07-22 20:10:58.453004] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:26.838 [2024-07-22 20:10:58.453068] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3240017 ] 00:05:26.838 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.838 [2024-07-22 20:10:58.507095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.838 [2024-07-22 20:10:58.579117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val= 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val= 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val=0x1 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val= 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val= 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val=0 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val= 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val=software 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@23 -- # accel_module=software 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val=32 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val=32 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val=1 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val=Yes 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val= 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:26.838 20:10:58 -- accel/accel.sh@21 -- # val= 00:05:26.838 20:10:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # IFS=: 00:05:26.838 20:10:58 -- accel/accel.sh@20 -- # read -r var val 00:05:28.215 20:10:59 -- accel/accel.sh@21 -- # val= 00:05:28.215 20:10:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # IFS=: 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # read -r var val 00:05:28.215 20:10:59 -- accel/accel.sh@21 -- # val= 00:05:28.215 20:10:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # IFS=: 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # read -r var val 00:05:28.215 20:10:59 -- accel/accel.sh@21 -- # val= 00:05:28.215 20:10:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # IFS=: 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # read -r var val 00:05:28.215 20:10:59 -- accel/accel.sh@21 -- # val= 00:05:28.215 20:10:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # IFS=: 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # read -r var val 00:05:28.215 20:10:59 -- accel/accel.sh@21 -- # val= 00:05:28.215 20:10:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # IFS=: 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # read -r var val 00:05:28.215 20:10:59 -- accel/accel.sh@21 -- # val= 00:05:28.215 20:10:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # IFS=: 00:05:28.215 20:10:59 -- accel/accel.sh@20 -- # read -r var val 00:05:28.215 20:10:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:28.215 20:10:59 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:28.215 20:10:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:28.215 00:05:28.215 real 0m2.692s 00:05:28.215 user 0m2.482s 00:05:28.215 sys 0m0.211s 00:05:28.215 20:10:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:28.215 20:10:59 -- common/autotest_common.sh@10 -- # set +x 00:05:28.215 ************************************ 00:05:28.215 END TEST accel_copy_crc32c 00:05:28.215 ************************************ 00:05:28.215 20:10:59 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:28.215 20:10:59 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:28.215 20:10:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:28.215 20:10:59 -- common/autotest_common.sh@10 -- # set +x 00:05:28.215 ************************************ 00:05:28.215 START TEST accel_copy_crc32c_C2 00:05:28.215 ************************************ 00:05:28.215 20:10:59 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:28.215 20:10:59 -- accel/accel.sh@16 -- # local accel_opc 00:05:28.215 20:10:59 -- accel/accel.sh@17 -- # local accel_module 00:05:28.215 20:10:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:28.215 20:10:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:28.215 20:10:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.215 20:10:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.215 20:10:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.215 20:10:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.215 20:10:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.215 20:10:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.215 20:10:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.215 20:10:59 -- accel/accel.sh@42 -- # jq -r . 00:05:28.215 [2024-07-22 20:10:59.839145] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:28.215 [2024-07-22 20:10:59.839209] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3240266 ] 00:05:28.215 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.215 [2024-07-22 20:10:59.894813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.215 [2024-07-22 20:10:59.965576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.595 20:11:01 -- accel/accel.sh@18 -- # out=' 00:05:29.595 SPDK Configuration: 00:05:29.595 Core mask: 0x1 00:05:29.595 00:05:29.595 Accel Perf Configuration: 00:05:29.595 Workload Type: copy_crc32c 00:05:29.595 CRC-32C seed: 0 00:05:29.595 Vector size: 4096 bytes 00:05:29.595 Transfer size: 8192 bytes 00:05:29.595 Vector count 2 00:05:29.595 Module: software 00:05:29.595 Queue depth: 32 00:05:29.595 Allocate depth: 32 00:05:29.595 # threads/core: 1 00:05:29.595 Run time: 1 seconds 00:05:29.595 Verify: Yes 00:05:29.595 00:05:29.595 Running for 1 seconds... 00:05:29.595 00:05:29.595 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:29.595 ------------------------------------------------------------------------------------ 00:05:29.595 0,0 236256/s 1845 MiB/s 0 0 00:05:29.595 ==================================================================================== 00:05:29.595 Total 236256/s 922 MiB/s 0 0' 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:29.595 20:11:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:29.595 20:11:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.595 20:11:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.595 20:11:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.595 20:11:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.595 20:11:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.595 20:11:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.595 20:11:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.595 20:11:01 -- accel/accel.sh@42 -- # jq -r . 00:05:29.595 [2024-07-22 20:11:01.190189] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:29.595 [2024-07-22 20:11:01.190249] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3240488 ] 00:05:29.595 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.595 [2024-07-22 20:11:01.243842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.595 [2024-07-22 20:11:01.313710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val= 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val= 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val=0x1 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val= 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val= 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val=0 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val= 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val=software 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@23 -- # accel_module=software 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val=32 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val=32 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val=1 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val=Yes 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val= 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:29.595 20:11:01 -- accel/accel.sh@21 -- # val= 00:05:29.595 20:11:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # IFS=: 00:05:29.595 20:11:01 -- accel/accel.sh@20 -- # read -r var val 00:05:30.975 20:11:02 -- accel/accel.sh@21 -- # val= 00:05:30.975 20:11:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # IFS=: 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # read -r var val 00:05:30.975 20:11:02 -- accel/accel.sh@21 -- # val= 00:05:30.975 20:11:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # IFS=: 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # read -r var val 00:05:30.975 20:11:02 -- accel/accel.sh@21 -- # val= 00:05:30.975 20:11:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # IFS=: 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # read -r var val 00:05:30.975 20:11:02 -- accel/accel.sh@21 -- # val= 00:05:30.975 20:11:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # IFS=: 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # read -r var val 00:05:30.975 20:11:02 -- accel/accel.sh@21 -- # val= 00:05:30.975 20:11:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # IFS=: 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # read -r var val 00:05:30.975 20:11:02 -- accel/accel.sh@21 -- # val= 00:05:30.975 20:11:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # IFS=: 00:05:30.975 20:11:02 -- accel/accel.sh@20 -- # read -r var val 00:05:30.975 20:11:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:30.975 20:11:02 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:30.975 20:11:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:30.975 00:05:30.975 real 0m2.700s 00:05:30.975 user 0m2.479s 00:05:30.975 sys 0m0.220s 00:05:30.975 20:11:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:30.975 20:11:02 -- common/autotest_common.sh@10 -- # set +x 00:05:30.975 ************************************ 00:05:30.975 END TEST accel_copy_crc32c_C2 00:05:30.975 ************************************ 00:05:30.975 20:11:02 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:30.975 20:11:02 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:30.975 20:11:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:30.975 20:11:02 -- common/autotest_common.sh@10 -- # set +x 00:05:30.975 ************************************ 00:05:30.975 START TEST accel_dualcast 00:05:30.975 ************************************ 00:05:30.975 20:11:02 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:05:30.975 20:11:02 -- accel/accel.sh@16 -- # local accel_opc 00:05:30.975 20:11:02 -- accel/accel.sh@17 -- # local accel_module 00:05:30.975 20:11:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:30.975 20:11:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:30.975 20:11:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.975 20:11:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.975 20:11:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.975 20:11:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.975 20:11:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.975 20:11:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.975 20:11:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.975 20:11:02 -- accel/accel.sh@42 -- # jq -r . 00:05:30.975 [2024-07-22 20:11:02.574739] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:30.975 [2024-07-22 20:11:02.574794] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3240753 ] 00:05:30.975 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.975 [2024-07-22 20:11:02.628623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.975 [2024-07-22 20:11:02.699274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.369 20:11:03 -- accel/accel.sh@18 -- # out=' 00:05:32.369 SPDK Configuration: 00:05:32.369 Core mask: 0x1 00:05:32.369 00:05:32.369 Accel Perf Configuration: 00:05:32.369 Workload Type: dualcast 00:05:32.369 Transfer size: 4096 bytes 00:05:32.369 Vector count 1 00:05:32.369 Module: software 00:05:32.369 Queue depth: 32 00:05:32.369 Allocate depth: 32 00:05:32.369 # threads/core: 1 00:05:32.369 Run time: 1 seconds 00:05:32.369 Verify: Yes 00:05:32.369 00:05:32.369 Running for 1 seconds... 00:05:32.369 00:05:32.369 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:32.369 ------------------------------------------------------------------------------------ 00:05:32.369 0,0 505728/s 1975 MiB/s 0 0 00:05:32.370 ==================================================================================== 00:05:32.370 Total 505728/s 1975 MiB/s 0 0' 00:05:32.370 20:11:03 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:03 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:32.370 20:11:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:32.370 20:11:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.370 20:11:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.370 20:11:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.370 20:11:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.370 20:11:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.370 20:11:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.370 20:11:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.370 20:11:03 -- accel/accel.sh@42 -- # jq -r . 00:05:32.370 [2024-07-22 20:11:03.909626] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:32.370 [2024-07-22 20:11:03.909676] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3240966 ] 00:05:32.370 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.370 [2024-07-22 20:11:03.961871] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.370 [2024-07-22 20:11:04.032063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val= 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val= 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val=0x1 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val= 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val= 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val=dualcast 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val= 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val=software 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val=32 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val=32 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val=1 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val=Yes 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val= 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:32.370 20:11:04 -- accel/accel.sh@21 -- # val= 00:05:32.370 20:11:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # IFS=: 00:05:32.370 20:11:04 -- accel/accel.sh@20 -- # read -r var val 00:05:33.307 20:11:05 -- accel/accel.sh@21 -- # val= 00:05:33.307 20:11:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # IFS=: 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # read -r var val 00:05:33.307 20:11:05 -- accel/accel.sh@21 -- # val= 00:05:33.307 20:11:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # IFS=: 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # read -r var val 00:05:33.307 20:11:05 -- accel/accel.sh@21 -- # val= 00:05:33.307 20:11:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # IFS=: 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # read -r var val 00:05:33.307 20:11:05 -- accel/accel.sh@21 -- # val= 00:05:33.307 20:11:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # IFS=: 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # read -r var val 00:05:33.307 20:11:05 -- accel/accel.sh@21 -- # val= 00:05:33.307 20:11:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # IFS=: 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # read -r var val 00:05:33.307 20:11:05 -- accel/accel.sh@21 -- # val= 00:05:33.307 20:11:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # IFS=: 00:05:33.307 20:11:05 -- accel/accel.sh@20 -- # read -r var val 00:05:33.307 20:11:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:33.307 20:11:05 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:33.307 20:11:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:33.307 00:05:33.307 real 0m2.683s 00:05:33.307 user 0m2.479s 00:05:33.307 sys 0m0.204s 00:05:33.307 20:11:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:33.307 20:11:05 -- common/autotest_common.sh@10 -- # set +x 00:05:33.307 ************************************ 00:05:33.307 END TEST accel_dualcast 00:05:33.307 ************************************ 00:05:33.566 20:11:05 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:33.566 20:11:05 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:33.566 20:11:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:33.566 20:11:05 -- common/autotest_common.sh@10 -- # set +x 00:05:33.566 ************************************ 00:05:33.566 START TEST accel_compare 00:05:33.566 ************************************ 00:05:33.566 20:11:05 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:05:33.566 20:11:05 -- accel/accel.sh@16 -- # local accel_opc 00:05:33.566 20:11:05 -- accel/accel.sh@17 -- # local accel_module 00:05:33.566 20:11:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:33.566 20:11:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:33.566 20:11:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.566 20:11:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.566 20:11:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.566 20:11:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.566 20:11:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.566 20:11:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.566 20:11:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.566 20:11:05 -- accel/accel.sh@42 -- # jq -r . 00:05:33.566 [2024-07-22 20:11:05.291736] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:33.566 [2024-07-22 20:11:05.291798] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3241223 ] 00:05:33.566 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.566 [2024-07-22 20:11:05.345556] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.566 [2024-07-22 20:11:05.416327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.943 20:11:06 -- accel/accel.sh@18 -- # out=' 00:05:34.943 SPDK Configuration: 00:05:34.943 Core mask: 0x1 00:05:34.943 00:05:34.943 Accel Perf Configuration: 00:05:34.943 Workload Type: compare 00:05:34.943 Transfer size: 4096 bytes 00:05:34.943 Vector count 1 00:05:34.943 Module: software 00:05:34.943 Queue depth: 32 00:05:34.943 Allocate depth: 32 00:05:34.943 # threads/core: 1 00:05:34.943 Run time: 1 seconds 00:05:34.943 Verify: Yes 00:05:34.943 00:05:34.943 Running for 1 seconds... 00:05:34.943 00:05:34.943 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:34.943 ------------------------------------------------------------------------------------ 00:05:34.943 0,0 613760/s 2397 MiB/s 0 0 00:05:34.943 ==================================================================================== 00:05:34.943 Total 613760/s 2397 MiB/s 0 0' 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:34.943 20:11:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:34.943 20:11:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.943 20:11:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.943 20:11:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.943 20:11:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.943 20:11:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.943 20:11:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.943 20:11:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.943 20:11:06 -- accel/accel.sh@42 -- # jq -r . 00:05:34.943 [2024-07-22 20:11:06.625856] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:34.943 [2024-07-22 20:11:06.625905] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3241444 ] 00:05:34.943 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.943 [2024-07-22 20:11:06.678640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.943 [2024-07-22 20:11:06.749600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val= 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val= 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val=0x1 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val= 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val= 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val=compare 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val= 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val=software 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@23 -- # accel_module=software 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val=32 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 20:11:06 -- accel/accel.sh@21 -- # val=32 00:05:34.943 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.943 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.944 20:11:06 -- accel/accel.sh@21 -- # val=1 00:05:34.944 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.944 20:11:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:34.944 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.944 20:11:06 -- accel/accel.sh@21 -- # val=Yes 00:05:34.944 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.944 20:11:06 -- accel/accel.sh@21 -- # val= 00:05:34.944 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:34.944 20:11:06 -- accel/accel.sh@21 -- # val= 00:05:34.944 20:11:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # IFS=: 00:05:34.944 20:11:06 -- accel/accel.sh@20 -- # read -r var val 00:05:36.321 20:11:07 -- accel/accel.sh@21 -- # val= 00:05:36.321 20:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # IFS=: 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # read -r var val 00:05:36.321 20:11:07 -- accel/accel.sh@21 -- # val= 00:05:36.321 20:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # IFS=: 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # read -r var val 00:05:36.321 20:11:07 -- accel/accel.sh@21 -- # val= 00:05:36.321 20:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # IFS=: 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # read -r var val 00:05:36.321 20:11:07 -- accel/accel.sh@21 -- # val= 00:05:36.321 20:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # IFS=: 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # read -r var val 00:05:36.321 20:11:07 -- accel/accel.sh@21 -- # val= 00:05:36.321 20:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # IFS=: 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # read -r var val 00:05:36.321 20:11:07 -- accel/accel.sh@21 -- # val= 00:05:36.321 20:11:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # IFS=: 00:05:36.321 20:11:07 -- accel/accel.sh@20 -- # read -r var val 00:05:36.321 20:11:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:36.321 20:11:07 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:36.321 20:11:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:36.321 00:05:36.321 real 0m2.684s 00:05:36.321 user 0m2.477s 00:05:36.321 sys 0m0.207s 00:05:36.321 20:11:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.321 20:11:07 -- common/autotest_common.sh@10 -- # set +x 00:05:36.321 ************************************ 00:05:36.321 END TEST accel_compare 00:05:36.321 ************************************ 00:05:36.321 20:11:07 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:36.321 20:11:07 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:36.321 20:11:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.321 20:11:07 -- common/autotest_common.sh@10 -- # set +x 00:05:36.321 ************************************ 00:05:36.321 START TEST accel_xor 00:05:36.321 ************************************ 00:05:36.321 20:11:07 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:05:36.321 20:11:07 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.321 20:11:07 -- accel/accel.sh@17 -- # local accel_module 00:05:36.321 20:11:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:36.321 20:11:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:36.321 20:11:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.321 20:11:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.321 20:11:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.321 20:11:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.321 20:11:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.321 20:11:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.321 20:11:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.321 20:11:07 -- accel/accel.sh@42 -- # jq -r . 00:05:36.322 [2024-07-22 20:11:08.010321] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:36.322 [2024-07-22 20:11:08.010384] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3241692 ] 00:05:36.322 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.322 [2024-07-22 20:11:08.064476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.322 [2024-07-22 20:11:08.135866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.698 20:11:09 -- accel/accel.sh@18 -- # out=' 00:05:37.698 SPDK Configuration: 00:05:37.698 Core mask: 0x1 00:05:37.698 00:05:37.698 Accel Perf Configuration: 00:05:37.698 Workload Type: xor 00:05:37.698 Source buffers: 2 00:05:37.698 Transfer size: 4096 bytes 00:05:37.698 Vector count 1 00:05:37.698 Module: software 00:05:37.698 Queue depth: 32 00:05:37.698 Allocate depth: 32 00:05:37.698 # threads/core: 1 00:05:37.698 Run time: 1 seconds 00:05:37.698 Verify: Yes 00:05:37.698 00:05:37.698 Running for 1 seconds... 00:05:37.698 00:05:37.698 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:37.698 ------------------------------------------------------------------------------------ 00:05:37.698 0,0 485376/s 1896 MiB/s 0 0 00:05:37.698 ==================================================================================== 00:05:37.698 Total 485376/s 1896 MiB/s 0 0' 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:37.698 20:11:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:37.698 20:11:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.698 20:11:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.698 20:11:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.698 20:11:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.698 20:11:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.698 20:11:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.698 20:11:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.698 20:11:09 -- accel/accel.sh@42 -- # jq -r . 00:05:37.698 [2024-07-22 20:11:09.361538] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:37.698 [2024-07-22 20:11:09.361611] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3241917 ] 00:05:37.698 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.698 [2024-07-22 20:11:09.416820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.698 [2024-07-22 20:11:09.486638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val= 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val= 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val=0x1 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val= 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val= 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val=xor 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val=2 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val= 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val=software 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@23 -- # accel_module=software 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val=32 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val=32 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val=1 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val=Yes 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val= 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:37.698 20:11:09 -- accel/accel.sh@21 -- # val= 00:05:37.698 20:11:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # IFS=: 00:05:37.698 20:11:09 -- accel/accel.sh@20 -- # read -r var val 00:05:39.076 20:11:10 -- accel/accel.sh@21 -- # val= 00:05:39.076 20:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # IFS=: 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # read -r var val 00:05:39.076 20:11:10 -- accel/accel.sh@21 -- # val= 00:05:39.076 20:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # IFS=: 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # read -r var val 00:05:39.076 20:11:10 -- accel/accel.sh@21 -- # val= 00:05:39.076 20:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # IFS=: 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # read -r var val 00:05:39.076 20:11:10 -- accel/accel.sh@21 -- # val= 00:05:39.076 20:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # IFS=: 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # read -r var val 00:05:39.076 20:11:10 -- accel/accel.sh@21 -- # val= 00:05:39.076 20:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # IFS=: 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # read -r var val 00:05:39.076 20:11:10 -- accel/accel.sh@21 -- # val= 00:05:39.076 20:11:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # IFS=: 00:05:39.076 20:11:10 -- accel/accel.sh@20 -- # read -r var val 00:05:39.076 20:11:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.076 20:11:10 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:39.076 20:11:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.076 00:05:39.076 real 0m2.703s 00:05:39.076 user 0m2.494s 00:05:39.076 sys 0m0.218s 00:05:39.076 20:11:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:39.076 20:11:10 -- common/autotest_common.sh@10 -- # set +x 00:05:39.076 ************************************ 00:05:39.076 END TEST accel_xor 00:05:39.076 ************************************ 00:05:39.076 20:11:10 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:39.076 20:11:10 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:39.076 20:11:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:39.076 20:11:10 -- common/autotest_common.sh@10 -- # set +x 00:05:39.076 ************************************ 00:05:39.076 START TEST accel_xor 00:05:39.076 ************************************ 00:05:39.076 20:11:10 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:05:39.076 20:11:10 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.076 20:11:10 -- accel/accel.sh@17 -- # local accel_module 00:05:39.076 20:11:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:39.076 20:11:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:39.076 20:11:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.076 20:11:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.076 20:11:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.076 20:11:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.076 20:11:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.076 20:11:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.076 20:11:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.076 20:11:10 -- accel/accel.sh@42 -- # jq -r . 00:05:39.076 [2024-07-22 20:11:10.743677] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:39.076 [2024-07-22 20:11:10.743729] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3242166 ] 00:05:39.076 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.076 [2024-07-22 20:11:10.793360] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.076 [2024-07-22 20:11:10.866290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.504 20:11:12 -- accel/accel.sh@18 -- # out=' 00:05:40.504 SPDK Configuration: 00:05:40.504 Core mask: 0x1 00:05:40.504 00:05:40.504 Accel Perf Configuration: 00:05:40.504 Workload Type: xor 00:05:40.504 Source buffers: 3 00:05:40.504 Transfer size: 4096 bytes 00:05:40.504 Vector count 1 00:05:40.504 Module: software 00:05:40.504 Queue depth: 32 00:05:40.504 Allocate depth: 32 00:05:40.504 # threads/core: 1 00:05:40.504 Run time: 1 seconds 00:05:40.504 Verify: Yes 00:05:40.504 00:05:40.504 Running for 1 seconds... 00:05:40.504 00:05:40.504 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:40.504 ------------------------------------------------------------------------------------ 00:05:40.504 0,0 446912/s 1745 MiB/s 0 0 00:05:40.504 ==================================================================================== 00:05:40.504 Total 446912/s 1745 MiB/s 0 0' 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:40.504 20:11:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:40.504 20:11:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.504 20:11:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.504 20:11:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.504 20:11:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.504 20:11:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.504 20:11:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.504 20:11:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.504 20:11:12 -- accel/accel.sh@42 -- # jq -r . 00:05:40.504 [2024-07-22 20:11:12.090797] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:40.504 [2024-07-22 20:11:12.090866] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3242388 ] 00:05:40.504 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.504 [2024-07-22 20:11:12.148150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.504 [2024-07-22 20:11:12.224287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val= 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val= 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val=0x1 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val= 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val= 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val=xor 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val=3 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val= 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val=software 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@23 -- # accel_module=software 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val=32 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val=32 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val=1 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val=Yes 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val= 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:40.504 20:11:12 -- accel/accel.sh@21 -- # val= 00:05:40.504 20:11:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # IFS=: 00:05:40.504 20:11:12 -- accel/accel.sh@20 -- # read -r var val 00:05:41.909 20:11:13 -- accel/accel.sh@21 -- # val= 00:05:41.909 20:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # IFS=: 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # read -r var val 00:05:41.909 20:11:13 -- accel/accel.sh@21 -- # val= 00:05:41.909 20:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # IFS=: 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # read -r var val 00:05:41.909 20:11:13 -- accel/accel.sh@21 -- # val= 00:05:41.909 20:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # IFS=: 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # read -r var val 00:05:41.909 20:11:13 -- accel/accel.sh@21 -- # val= 00:05:41.909 20:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # IFS=: 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # read -r var val 00:05:41.909 20:11:13 -- accel/accel.sh@21 -- # val= 00:05:41.909 20:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # IFS=: 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # read -r var val 00:05:41.909 20:11:13 -- accel/accel.sh@21 -- # val= 00:05:41.909 20:11:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # IFS=: 00:05:41.909 20:11:13 -- accel/accel.sh@20 -- # read -r var val 00:05:41.909 20:11:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:41.909 20:11:13 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:41.909 20:11:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:41.909 00:05:41.909 real 0m2.701s 00:05:41.909 user 0m2.488s 00:05:41.909 sys 0m0.221s 00:05:41.909 20:11:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:41.909 20:11:13 -- common/autotest_common.sh@10 -- # set +x 00:05:41.909 ************************************ 00:05:41.909 END TEST accel_xor 00:05:41.909 ************************************ 00:05:41.909 20:11:13 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:41.909 20:11:13 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:41.909 20:11:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:41.909 20:11:13 -- common/autotest_common.sh@10 -- # set +x 00:05:41.909 ************************************ 00:05:41.909 START TEST accel_dif_verify 00:05:41.909 ************************************ 00:05:41.909 20:11:13 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:05:41.909 20:11:13 -- accel/accel.sh@16 -- # local accel_opc 00:05:41.909 20:11:13 -- accel/accel.sh@17 -- # local accel_module 00:05:41.909 20:11:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:41.910 20:11:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:41.910 20:11:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.910 20:11:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.910 20:11:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.910 20:11:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.910 20:11:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.910 20:11:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.910 20:11:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.910 20:11:13 -- accel/accel.sh@42 -- # jq -r . 00:05:41.910 [2024-07-22 20:11:13.492134] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:41.910 [2024-07-22 20:11:13.492192] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3242655 ] 00:05:41.910 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.910 [2024-07-22 20:11:13.546261] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.910 [2024-07-22 20:11:13.617599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.290 20:11:14 -- accel/accel.sh@18 -- # out=' 00:05:43.290 SPDK Configuration: 00:05:43.290 Core mask: 0x1 00:05:43.290 00:05:43.290 Accel Perf Configuration: 00:05:43.290 Workload Type: dif_verify 00:05:43.290 Vector size: 4096 bytes 00:05:43.290 Transfer size: 4096 bytes 00:05:43.290 Block size: 512 bytes 00:05:43.290 Metadata size: 8 bytes 00:05:43.290 Vector count 1 00:05:43.290 Module: software 00:05:43.290 Queue depth: 32 00:05:43.290 Allocate depth: 32 00:05:43.290 # threads/core: 1 00:05:43.290 Run time: 1 seconds 00:05:43.290 Verify: No 00:05:43.290 00:05:43.290 Running for 1 seconds... 00:05:43.290 00:05:43.290 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:43.290 ------------------------------------------------------------------------------------ 00:05:43.290 0,0 129184/s 512 MiB/s 0 0 00:05:43.290 ==================================================================================== 00:05:43.290 Total 129184/s 504 MiB/s 0 0' 00:05:43.290 20:11:14 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:14 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:43.290 20:11:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:43.290 20:11:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.290 20:11:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.290 20:11:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.290 20:11:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.290 20:11:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.290 20:11:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.290 20:11:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.290 20:11:14 -- accel/accel.sh@42 -- # jq -r . 00:05:43.290 [2024-07-22 20:11:14.843876] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:43.290 [2024-07-22 20:11:14.843952] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3242876 ] 00:05:43.290 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.290 [2024-07-22 20:11:14.899976] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.290 [2024-07-22 20:11:14.969938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val= 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val= 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val=0x1 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val= 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val= 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val=dif_verify 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val= 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val=software 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@23 -- # accel_module=software 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val=32 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val=32 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val=1 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val=No 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val= 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:43.290 20:11:15 -- accel/accel.sh@21 -- # val= 00:05:43.290 20:11:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # IFS=: 00:05:43.290 20:11:15 -- accel/accel.sh@20 -- # read -r var val 00:05:44.229 20:11:16 -- accel/accel.sh@21 -- # val= 00:05:44.490 20:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.490 20:11:16 -- accel/accel.sh@20 -- # IFS=: 00:05:44.490 20:11:16 -- accel/accel.sh@20 -- # read -r var val 00:05:44.490 20:11:16 -- accel/accel.sh@21 -- # val= 00:05:44.490 20:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.490 20:11:16 -- accel/accel.sh@20 -- # IFS=: 00:05:44.490 20:11:16 -- accel/accel.sh@20 -- # read -r var val 00:05:44.490 20:11:16 -- accel/accel.sh@21 -- # val= 00:05:44.490 20:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.490 20:11:16 -- accel/accel.sh@20 -- # IFS=: 00:05:44.490 20:11:16 -- accel/accel.sh@20 -- # read -r var val 00:05:44.490 20:11:16 -- accel/accel.sh@21 -- # val= 00:05:44.490 20:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.490 20:11:16 -- accel/accel.sh@20 -- # IFS=: 00:05:44.490 20:11:16 -- accel/accel.sh@20 -- # read -r var val 00:05:44.490 20:11:16 -- accel/accel.sh@21 -- # val= 00:05:44.490 20:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.491 20:11:16 -- accel/accel.sh@20 -- # IFS=: 00:05:44.491 20:11:16 -- accel/accel.sh@20 -- # read -r var val 00:05:44.491 20:11:16 -- accel/accel.sh@21 -- # val= 00:05:44.491 20:11:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.491 20:11:16 -- accel/accel.sh@20 -- # IFS=: 00:05:44.491 20:11:16 -- accel/accel.sh@20 -- # read -r var val 00:05:44.491 20:11:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:44.491 20:11:16 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:44.491 20:11:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:44.491 00:05:44.491 real 0m2.707s 00:05:44.491 user 0m2.494s 00:05:44.491 sys 0m0.224s 00:05:44.491 20:11:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:44.491 20:11:16 -- common/autotest_common.sh@10 -- # set +x 00:05:44.491 ************************************ 00:05:44.491 END TEST accel_dif_verify 00:05:44.491 ************************************ 00:05:44.491 20:11:16 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:44.491 20:11:16 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:44.491 20:11:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:44.491 20:11:16 -- common/autotest_common.sh@10 -- # set +x 00:05:44.491 ************************************ 00:05:44.491 START TEST accel_dif_generate 00:05:44.491 ************************************ 00:05:44.491 20:11:16 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:05:44.491 20:11:16 -- accel/accel.sh@16 -- # local accel_opc 00:05:44.491 20:11:16 -- accel/accel.sh@17 -- # local accel_module 00:05:44.491 20:11:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:44.491 20:11:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:44.491 20:11:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.491 20:11:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.491 20:11:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.491 20:11:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.491 20:11:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.491 20:11:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.491 20:11:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.491 20:11:16 -- accel/accel.sh@42 -- # jq -r . 00:05:44.491 [2024-07-22 20:11:16.239784] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:44.491 [2024-07-22 20:11:16.239865] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3243139 ] 00:05:44.491 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.491 [2024-07-22 20:11:16.296022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.491 [2024-07-22 20:11:16.366707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.872 20:11:17 -- accel/accel.sh@18 -- # out=' 00:05:45.872 SPDK Configuration: 00:05:45.872 Core mask: 0x1 00:05:45.872 00:05:45.872 Accel Perf Configuration: 00:05:45.872 Workload Type: dif_generate 00:05:45.872 Vector size: 4096 bytes 00:05:45.872 Transfer size: 4096 bytes 00:05:45.872 Block size: 512 bytes 00:05:45.872 Metadata size: 8 bytes 00:05:45.872 Vector count 1 00:05:45.872 Module: software 00:05:45.872 Queue depth: 32 00:05:45.872 Allocate depth: 32 00:05:45.872 # threads/core: 1 00:05:45.872 Run time: 1 seconds 00:05:45.872 Verify: No 00:05:45.872 00:05:45.872 Running for 1 seconds... 00:05:45.872 00:05:45.872 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.872 ------------------------------------------------------------------------------------ 00:05:45.872 0,0 157952/s 626 MiB/s 0 0 00:05:45.872 ==================================================================================== 00:05:45.872 Total 157952/s 617 MiB/s 0 0' 00:05:45.872 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.872 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.872 20:11:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:45.872 20:11:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:45.872 20:11:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.872 20:11:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.872 20:11:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.872 20:11:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.872 20:11:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.872 20:11:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.873 20:11:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.873 20:11:17 -- accel/accel.sh@42 -- # jq -r . 00:05:45.873 [2024-07-22 20:11:17.589553] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:45.873 [2024-07-22 20:11:17.589611] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3243365 ] 00:05:45.873 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.873 [2024-07-22 20:11:17.644078] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.873 [2024-07-22 20:11:17.715571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val= 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val= 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val=0x1 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val= 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val= 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val=dif_generate 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val= 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val=software 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val=32 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val=32 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val=1 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val=No 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val= 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:45.873 20:11:17 -- accel/accel.sh@21 -- # val= 00:05:45.873 20:11:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # IFS=: 00:05:45.873 20:11:17 -- accel/accel.sh@20 -- # read -r var val 00:05:47.253 20:11:18 -- accel/accel.sh@21 -- # val= 00:05:47.253 20:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # IFS=: 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # read -r var val 00:05:47.253 20:11:18 -- accel/accel.sh@21 -- # val= 00:05:47.253 20:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # IFS=: 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # read -r var val 00:05:47.253 20:11:18 -- accel/accel.sh@21 -- # val= 00:05:47.253 20:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # IFS=: 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # read -r var val 00:05:47.253 20:11:18 -- accel/accel.sh@21 -- # val= 00:05:47.253 20:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # IFS=: 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # read -r var val 00:05:47.253 20:11:18 -- accel/accel.sh@21 -- # val= 00:05:47.253 20:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # IFS=: 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # read -r var val 00:05:47.253 20:11:18 -- accel/accel.sh@21 -- # val= 00:05:47.253 20:11:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # IFS=: 00:05:47.253 20:11:18 -- accel/accel.sh@20 -- # read -r var val 00:05:47.253 20:11:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:47.253 20:11:18 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:47.253 20:11:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:47.253 00:05:47.253 real 0m2.706s 00:05:47.253 user 0m2.495s 00:05:47.253 sys 0m0.222s 00:05:47.253 20:11:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:47.253 20:11:18 -- common/autotest_common.sh@10 -- # set +x 00:05:47.253 ************************************ 00:05:47.253 END TEST accel_dif_generate 00:05:47.253 ************************************ 00:05:47.253 20:11:18 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:47.253 20:11:18 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:47.253 20:11:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:47.253 20:11:18 -- common/autotest_common.sh@10 -- # set +x 00:05:47.253 ************************************ 00:05:47.253 START TEST accel_dif_generate_copy 00:05:47.253 ************************************ 00:05:47.253 20:11:18 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:05:47.253 20:11:18 -- accel/accel.sh@16 -- # local accel_opc 00:05:47.253 20:11:18 -- accel/accel.sh@17 -- # local accel_module 00:05:47.253 20:11:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:47.253 20:11:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:47.253 20:11:18 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.253 20:11:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.253 20:11:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.253 20:11:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.253 20:11:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.253 20:11:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.253 20:11:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.253 20:11:18 -- accel/accel.sh@42 -- # jq -r . 00:05:47.253 [2024-07-22 20:11:18.982075] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:47.253 [2024-07-22 20:11:18.982137] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3243626 ] 00:05:47.253 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.253 [2024-07-22 20:11:19.039170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.253 [2024-07-22 20:11:19.112488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.631 20:11:20 -- accel/accel.sh@18 -- # out=' 00:05:48.631 SPDK Configuration: 00:05:48.631 Core mask: 0x1 00:05:48.631 00:05:48.631 Accel Perf Configuration: 00:05:48.631 Workload Type: dif_generate_copy 00:05:48.631 Vector size: 4096 bytes 00:05:48.631 Transfer size: 4096 bytes 00:05:48.631 Vector count 1 00:05:48.631 Module: software 00:05:48.631 Queue depth: 32 00:05:48.631 Allocate depth: 32 00:05:48.631 # threads/core: 1 00:05:48.631 Run time: 1 seconds 00:05:48.631 Verify: No 00:05:48.631 00:05:48.631 Running for 1 seconds... 00:05:48.631 00:05:48.631 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.631 ------------------------------------------------------------------------------------ 00:05:48.631 0,0 121024/s 480 MiB/s 0 0 00:05:48.631 ==================================================================================== 00:05:48.631 Total 121024/s 472 MiB/s 0 0' 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.631 20:11:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:48.631 20:11:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:48.631 20:11:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.631 20:11:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.631 20:11:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.631 20:11:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.631 20:11:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.631 20:11:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.631 20:11:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.631 20:11:20 -- accel/accel.sh@42 -- # jq -r . 00:05:48.631 [2024-07-22 20:11:20.338189] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:48.631 [2024-07-22 20:11:20.338262] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3243857 ] 00:05:48.631 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.631 [2024-07-22 20:11:20.394522] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.631 [2024-07-22 20:11:20.464463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.631 20:11:20 -- accel/accel.sh@21 -- # val= 00:05:48.631 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.631 20:11:20 -- accel/accel.sh@21 -- # val= 00:05:48.631 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.631 20:11:20 -- accel/accel.sh@21 -- # val=0x1 00:05:48.631 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.631 20:11:20 -- accel/accel.sh@21 -- # val= 00:05:48.631 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.631 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.631 20:11:20 -- accel/accel.sh@21 -- # val= 00:05:48.631 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val= 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val=software 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val=32 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val=32 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val=1 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val=No 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val= 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:48.632 20:11:20 -- accel/accel.sh@21 -- # val= 00:05:48.632 20:11:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # IFS=: 00:05:48.632 20:11:20 -- accel/accel.sh@20 -- # read -r var val 00:05:50.010 20:11:21 -- accel/accel.sh@21 -- # val= 00:05:50.010 20:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # IFS=: 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # read -r var val 00:05:50.010 20:11:21 -- accel/accel.sh@21 -- # val= 00:05:50.010 20:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # IFS=: 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # read -r var val 00:05:50.010 20:11:21 -- accel/accel.sh@21 -- # val= 00:05:50.010 20:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # IFS=: 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # read -r var val 00:05:50.010 20:11:21 -- accel/accel.sh@21 -- # val= 00:05:50.010 20:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # IFS=: 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # read -r var val 00:05:50.010 20:11:21 -- accel/accel.sh@21 -- # val= 00:05:50.010 20:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # IFS=: 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # read -r var val 00:05:50.010 20:11:21 -- accel/accel.sh@21 -- # val= 00:05:50.010 20:11:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # IFS=: 00:05:50.010 20:11:21 -- accel/accel.sh@20 -- # read -r var val 00:05:50.010 20:11:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:50.010 20:11:21 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:05:50.010 20:11:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:50.010 00:05:50.010 real 0m2.709s 00:05:50.010 user 0m2.488s 00:05:50.010 sys 0m0.230s 00:05:50.010 20:11:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:50.010 20:11:21 -- common/autotest_common.sh@10 -- # set +x 00:05:50.010 ************************************ 00:05:50.010 END TEST accel_dif_generate_copy 00:05:50.010 ************************************ 00:05:50.010 20:11:21 -- accel/accel.sh@107 -- # [[ y == y ]] 00:05:50.010 20:11:21 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:50.010 20:11:21 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:50.010 20:11:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:50.010 20:11:21 -- common/autotest_common.sh@10 -- # set +x 00:05:50.010 ************************************ 00:05:50.010 START TEST accel_comp 00:05:50.010 ************************************ 00:05:50.010 20:11:21 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:50.010 20:11:21 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.010 20:11:21 -- accel/accel.sh@17 -- # local accel_module 00:05:50.010 20:11:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:50.010 20:11:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:50.010 20:11:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.010 20:11:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.010 20:11:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.010 20:11:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.010 20:11:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.010 20:11:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.010 20:11:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.010 20:11:21 -- accel/accel.sh@42 -- # jq -r . 00:05:50.010 [2024-07-22 20:11:21.728691] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:50.010 [2024-07-22 20:11:21.728753] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3244111 ] 00:05:50.010 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.010 [2024-07-22 20:11:21.782541] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.010 [2024-07-22 20:11:21.853815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.389 20:11:23 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:51.389 00:05:51.389 SPDK Configuration: 00:05:51.389 Core mask: 0x1 00:05:51.389 00:05:51.389 Accel Perf Configuration: 00:05:51.389 Workload Type: compress 00:05:51.389 Transfer size: 4096 bytes 00:05:51.389 Vector count 1 00:05:51.389 Module: software 00:05:51.389 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.389 Queue depth: 32 00:05:51.389 Allocate depth: 32 00:05:51.389 # threads/core: 1 00:05:51.389 Run time: 1 seconds 00:05:51.389 Verify: No 00:05:51.389 00:05:51.389 Running for 1 seconds... 00:05:51.389 00:05:51.389 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.389 ------------------------------------------------------------------------------------ 00:05:51.389 0,0 62560/s 260 MiB/s 0 0 00:05:51.389 ==================================================================================== 00:05:51.389 Total 62560/s 244 MiB/s 0 0' 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.389 20:11:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.389 20:11:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.389 20:11:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.389 20:11:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.389 20:11:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.389 20:11:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.389 20:11:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.389 20:11:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.389 20:11:23 -- accel/accel.sh@42 -- # jq -r . 00:05:51.389 [2024-07-22 20:11:23.081487] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:51.389 [2024-07-22 20:11:23.081570] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3244336 ] 00:05:51.389 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.389 [2024-07-22 20:11:23.136634] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.389 [2024-07-22 20:11:23.207118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val= 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val= 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val= 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val=0x1 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val= 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val= 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val=compress 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@24 -- # accel_opc=compress 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val= 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val=software 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val=32 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val=32 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val=1 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val=No 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val= 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:51.389 20:11:23 -- accel/accel.sh@21 -- # val= 00:05:51.389 20:11:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # IFS=: 00:05:51.389 20:11:23 -- accel/accel.sh@20 -- # read -r var val 00:05:52.770 20:11:24 -- accel/accel.sh@21 -- # val= 00:05:52.770 20:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # IFS=: 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # read -r var val 00:05:52.770 20:11:24 -- accel/accel.sh@21 -- # val= 00:05:52.770 20:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # IFS=: 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # read -r var val 00:05:52.770 20:11:24 -- accel/accel.sh@21 -- # val= 00:05:52.770 20:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # IFS=: 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # read -r var val 00:05:52.770 20:11:24 -- accel/accel.sh@21 -- # val= 00:05:52.770 20:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # IFS=: 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # read -r var val 00:05:52.770 20:11:24 -- accel/accel.sh@21 -- # val= 00:05:52.770 20:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # IFS=: 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # read -r var val 00:05:52.770 20:11:24 -- accel/accel.sh@21 -- # val= 00:05:52.770 20:11:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # IFS=: 00:05:52.770 20:11:24 -- accel/accel.sh@20 -- # read -r var val 00:05:52.770 20:11:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.770 20:11:24 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:05:52.770 20:11:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.770 00:05:52.770 real 0m2.709s 00:05:52.770 user 0m2.493s 00:05:52.770 sys 0m0.224s 00:05:52.770 20:11:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:52.770 20:11:24 -- common/autotest_common.sh@10 -- # set +x 00:05:52.770 ************************************ 00:05:52.770 END TEST accel_comp 00:05:52.770 ************************************ 00:05:52.770 20:11:24 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:52.770 20:11:24 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:52.770 20:11:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:52.770 20:11:24 -- common/autotest_common.sh@10 -- # set +x 00:05:52.770 ************************************ 00:05:52.770 START TEST accel_decomp 00:05:52.770 ************************************ 00:05:52.770 20:11:24 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:52.770 20:11:24 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.770 20:11:24 -- accel/accel.sh@17 -- # local accel_module 00:05:52.770 20:11:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:52.770 20:11:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:52.770 20:11:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.770 20:11:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.770 20:11:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.770 20:11:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.770 20:11:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.770 20:11:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.770 20:11:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.770 20:11:24 -- accel/accel.sh@42 -- # jq -r . 00:05:52.770 [2024-07-22 20:11:24.475354] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:52.770 [2024-07-22 20:11:24.475429] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3244596 ] 00:05:52.770 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.770 [2024-07-22 20:11:24.531065] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.770 [2024-07-22 20:11:24.602319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.149 20:11:25 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:54.149 00:05:54.149 SPDK Configuration: 00:05:54.149 Core mask: 0x1 00:05:54.149 00:05:54.149 Accel Perf Configuration: 00:05:54.149 Workload Type: decompress 00:05:54.149 Transfer size: 4096 bytes 00:05:54.149 Vector count 1 00:05:54.149 Module: software 00:05:54.149 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:54.149 Queue depth: 32 00:05:54.149 Allocate depth: 32 00:05:54.149 # threads/core: 1 00:05:54.149 Run time: 1 seconds 00:05:54.149 Verify: Yes 00:05:54.149 00:05:54.149 Running for 1 seconds... 00:05:54.149 00:05:54.149 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.149 ------------------------------------------------------------------------------------ 00:05:54.149 0,0 73440/s 135 MiB/s 0 0 00:05:54.149 ==================================================================================== 00:05:54.149 Total 73440/s 286 MiB/s 0 0' 00:05:54.149 20:11:25 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:25 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:54.149 20:11:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:54.149 20:11:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.149 20:11:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.149 20:11:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.149 20:11:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.149 20:11:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.149 20:11:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.149 20:11:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.149 20:11:25 -- accel/accel.sh@42 -- # jq -r . 00:05:54.149 [2024-07-22 20:11:25.828539] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:54.149 [2024-07-22 20:11:25.828611] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3244823 ] 00:05:54.149 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.149 [2024-07-22 20:11:25.885430] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.149 [2024-07-22 20:11:25.955327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.149 20:11:25 -- accel/accel.sh@21 -- # val= 00:05:54.149 20:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:25 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:25 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:25 -- accel/accel.sh@21 -- # val= 00:05:54.149 20:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:25 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:25 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:25 -- accel/accel.sh@21 -- # val= 00:05:54.149 20:11:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:25 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val=0x1 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val= 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val= 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val=decompress 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val= 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val=software 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val=32 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val=32 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val=1 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val=Yes 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val= 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:54.149 20:11:26 -- accel/accel.sh@21 -- # val= 00:05:54.149 20:11:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # IFS=: 00:05:54.149 20:11:26 -- accel/accel.sh@20 -- # read -r var val 00:05:55.528 20:11:27 -- accel/accel.sh@21 -- # val= 00:05:55.528 20:11:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.528 20:11:27 -- accel/accel.sh@20 -- # IFS=: 00:05:55.528 20:11:27 -- accel/accel.sh@20 -- # read -r var val 00:05:55.528 20:11:27 -- accel/accel.sh@21 -- # val= 00:05:55.529 20:11:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # IFS=: 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # read -r var val 00:05:55.529 20:11:27 -- accel/accel.sh@21 -- # val= 00:05:55.529 20:11:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # IFS=: 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # read -r var val 00:05:55.529 20:11:27 -- accel/accel.sh@21 -- # val= 00:05:55.529 20:11:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # IFS=: 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # read -r var val 00:05:55.529 20:11:27 -- accel/accel.sh@21 -- # val= 00:05:55.529 20:11:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # IFS=: 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # read -r var val 00:05:55.529 20:11:27 -- accel/accel.sh@21 -- # val= 00:05:55.529 20:11:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # IFS=: 00:05:55.529 20:11:27 -- accel/accel.sh@20 -- # read -r var val 00:05:55.529 20:11:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.529 20:11:27 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:55.529 20:11:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.529 00:05:55.529 real 0m2.712s 00:05:55.529 user 0m2.495s 00:05:55.529 sys 0m0.227s 00:05:55.529 20:11:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:55.529 20:11:27 -- common/autotest_common.sh@10 -- # set +x 00:05:55.529 ************************************ 00:05:55.529 END TEST accel_decomp 00:05:55.529 ************************************ 00:05:55.529 20:11:27 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:55.529 20:11:27 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:05:55.529 20:11:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:55.529 20:11:27 -- common/autotest_common.sh@10 -- # set +x 00:05:55.529 ************************************ 00:05:55.529 START TEST accel_decmop_full 00:05:55.529 ************************************ 00:05:55.529 20:11:27 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:55.529 20:11:27 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.529 20:11:27 -- accel/accel.sh@17 -- # local accel_module 00:05:55.529 20:11:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:55.529 20:11:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.529 20:11:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:55.529 20:11:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.529 20:11:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.529 20:11:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.529 20:11:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.529 20:11:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.529 20:11:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.529 20:11:27 -- accel/accel.sh@42 -- # jq -r . 00:05:55.529 [2024-07-22 20:11:27.226985] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:55.529 [2024-07-22 20:11:27.227070] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3245076 ] 00:05:55.529 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.529 [2024-07-22 20:11:27.282106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.529 [2024-07-22 20:11:27.353266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.908 20:11:28 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:56.908 00:05:56.908 SPDK Configuration: 00:05:56.908 Core mask: 0x1 00:05:56.908 00:05:56.908 Accel Perf Configuration: 00:05:56.908 Workload Type: decompress 00:05:56.908 Transfer size: 111250 bytes 00:05:56.908 Vector count 1 00:05:56.908 Module: software 00:05:56.908 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:56.908 Queue depth: 32 00:05:56.908 Allocate depth: 32 00:05:56.908 # threads/core: 1 00:05:56.908 Run time: 1 seconds 00:05:56.908 Verify: Yes 00:05:56.908 00:05:56.908 Running for 1 seconds... 00:05:56.908 00:05:56.908 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.908 ------------------------------------------------------------------------------------ 00:05:56.908 0,0 4896/s 202 MiB/s 0 0 00:05:56.908 ==================================================================================== 00:05:56.908 Total 4896/s 519 MiB/s 0 0' 00:05:56.908 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.908 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.908 20:11:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:56.908 20:11:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:56.908 20:11:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.909 20:11:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.909 20:11:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.909 20:11:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.909 20:11:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.909 20:11:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.909 20:11:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.909 20:11:28 -- accel/accel.sh@42 -- # jq -r . 00:05:56.909 [2024-07-22 20:11:28.591840] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:56.909 [2024-07-22 20:11:28.591915] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3245313 ] 00:05:56.909 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.909 [2024-07-22 20:11:28.648119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.909 [2024-07-22 20:11:28.717402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val= 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val= 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val= 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val=0x1 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val= 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val= 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val=decompress 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val= 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val=software 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val=32 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val=32 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val=1 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val=Yes 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val= 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:56.909 20:11:28 -- accel/accel.sh@21 -- # val= 00:05:56.909 20:11:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # IFS=: 00:05:56.909 20:11:28 -- accel/accel.sh@20 -- # read -r var val 00:05:58.288 20:11:29 -- accel/accel.sh@21 -- # val= 00:05:58.288 20:11:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # IFS=: 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # read -r var val 00:05:58.288 20:11:29 -- accel/accel.sh@21 -- # val= 00:05:58.288 20:11:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # IFS=: 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # read -r var val 00:05:58.288 20:11:29 -- accel/accel.sh@21 -- # val= 00:05:58.288 20:11:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # IFS=: 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # read -r var val 00:05:58.288 20:11:29 -- accel/accel.sh@21 -- # val= 00:05:58.288 20:11:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # IFS=: 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # read -r var val 00:05:58.288 20:11:29 -- accel/accel.sh@21 -- # val= 00:05:58.288 20:11:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # IFS=: 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # read -r var val 00:05:58.288 20:11:29 -- accel/accel.sh@21 -- # val= 00:05:58.288 20:11:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # IFS=: 00:05:58.288 20:11:29 -- accel/accel.sh@20 -- # read -r var val 00:05:58.288 20:11:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.288 20:11:29 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:58.288 20:11:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.288 00:05:58.288 real 0m2.733s 00:05:58.288 user 0m2.525s 00:05:58.288 sys 0m0.216s 00:05:58.288 20:11:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:58.288 20:11:29 -- common/autotest_common.sh@10 -- # set +x 00:05:58.288 ************************************ 00:05:58.288 END TEST accel_decmop_full 00:05:58.288 ************************************ 00:05:58.288 20:11:29 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:58.288 20:11:29 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:05:58.288 20:11:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:58.288 20:11:29 -- common/autotest_common.sh@10 -- # set +x 00:05:58.288 ************************************ 00:05:58.288 START TEST accel_decomp_mcore 00:05:58.288 ************************************ 00:05:58.288 20:11:29 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:58.288 20:11:29 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.288 20:11:29 -- accel/accel.sh@17 -- # local accel_module 00:05:58.289 20:11:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:58.289 20:11:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:58.289 20:11:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.289 20:11:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.289 20:11:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.289 20:11:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.289 20:11:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.289 20:11:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.289 20:11:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.289 20:11:29 -- accel/accel.sh@42 -- # jq -r . 00:05:58.289 [2024-07-22 20:11:29.999662] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:58.289 [2024-07-22 20:11:29.999741] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3245571 ] 00:05:58.289 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.289 [2024-07-22 20:11:30.058503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:58.289 [2024-07-22 20:11:30.135484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:58.289 [2024-07-22 20:11:30.135586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:58.289 [2024-07-22 20:11:30.135649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:58.289 [2024-07-22 20:11:30.135650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.690 20:11:31 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:59.690 00:05:59.690 SPDK Configuration: 00:05:59.690 Core mask: 0xf 00:05:59.690 00:05:59.690 Accel Perf Configuration: 00:05:59.690 Workload Type: decompress 00:05:59.690 Transfer size: 4096 bytes 00:05:59.690 Vector count 1 00:05:59.690 Module: software 00:05:59.690 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.690 Queue depth: 32 00:05:59.690 Allocate depth: 32 00:05:59.690 # threads/core: 1 00:05:59.690 Run time: 1 seconds 00:05:59.690 Verify: Yes 00:05:59.690 00:05:59.690 Running for 1 seconds... 00:05:59.690 00:05:59.690 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.690 ------------------------------------------------------------------------------------ 00:05:59.690 0,0 59840/s 110 MiB/s 0 0 00:05:59.690 3,0 61728/s 113 MiB/s 0 0 00:05:59.690 2,0 61792/s 113 MiB/s 0 0 00:05:59.690 1,0 61472/s 113 MiB/s 0 0 00:05:59.690 ==================================================================================== 00:05:59.690 Total 244832/s 956 MiB/s 0 0' 00:05:59.690 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.690 20:11:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:59.690 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.690 20:11:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:59.690 20:11:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.690 20:11:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.690 20:11:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.690 20:11:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.690 20:11:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.690 20:11:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.690 20:11:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.690 20:11:31 -- accel/accel.sh@42 -- # jq -r . 00:05:59.690 [2024-07-22 20:11:31.366192] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:05:59.690 [2024-07-22 20:11:31.366249] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3245808 ] 00:05:59.690 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.690 [2024-07-22 20:11:31.420433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:59.690 [2024-07-22 20:11:31.498867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:59.690 [2024-07-22 20:11:31.498982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:59.690 [2024-07-22 20:11:31.498996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:59.690 [2024-07-22 20:11:31.498998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.690 20:11:31 -- accel/accel.sh@21 -- # val= 00:05:59.690 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.690 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.690 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.690 20:11:31 -- accel/accel.sh@21 -- # val= 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val= 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val=0xf 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val= 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val= 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val=decompress 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val= 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val=software 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@23 -- # accel_module=software 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val=32 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val=32 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val=1 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val=Yes 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val= 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:05:59.691 20:11:31 -- accel/accel.sh@21 -- # val= 00:05:59.691 20:11:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # IFS=: 00:05:59.691 20:11:31 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:11:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:11:32 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:11:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.066 20:11:32 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:01.066 20:11:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.066 00:06:01.066 real 0m2.741s 00:06:01.066 user 0m9.169s 00:06:01.066 sys 0m0.236s 00:06:01.066 20:11:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:01.066 20:11:32 -- common/autotest_common.sh@10 -- # set +x 00:06:01.066 ************************************ 00:06:01.066 END TEST accel_decomp_mcore 00:06:01.066 ************************************ 00:06:01.066 20:11:32 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:01.066 20:11:32 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:01.066 20:11:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:01.066 20:11:32 -- common/autotest_common.sh@10 -- # set +x 00:06:01.066 ************************************ 00:06:01.066 START TEST accel_decomp_full_mcore 00:06:01.066 ************************************ 00:06:01.066 20:11:32 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:01.066 20:11:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.066 20:11:32 -- accel/accel.sh@17 -- # local accel_module 00:06:01.066 20:11:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:01.066 20:11:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:01.066 20:11:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.066 20:11:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.066 20:11:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.066 20:11:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.066 20:11:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.066 20:11:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.066 20:11:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.066 20:11:32 -- accel/accel.sh@42 -- # jq -r . 00:06:01.066 [2024-07-22 20:11:32.778768] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:01.066 [2024-07-22 20:11:32.778845] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3246077 ] 00:06:01.066 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.066 [2024-07-22 20:11:32.833884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:01.066 [2024-07-22 20:11:32.907179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:01.066 [2024-07-22 20:11:32.907278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:01.066 [2024-07-22 20:11:32.907353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:01.066 [2024-07-22 20:11:32.907355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.447 20:11:34 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:02.447 00:06:02.447 SPDK Configuration: 00:06:02.447 Core mask: 0xf 00:06:02.447 00:06:02.447 Accel Perf Configuration: 00:06:02.447 Workload Type: decompress 00:06:02.447 Transfer size: 111250 bytes 00:06:02.447 Vector count 1 00:06:02.447 Module: software 00:06:02.447 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.447 Queue depth: 32 00:06:02.447 Allocate depth: 32 00:06:02.447 # threads/core: 1 00:06:02.447 Run time: 1 seconds 00:06:02.447 Verify: Yes 00:06:02.447 00:06:02.447 Running for 1 seconds... 00:06:02.447 00:06:02.447 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.447 ------------------------------------------------------------------------------------ 00:06:02.447 0,0 4512/s 186 MiB/s 0 0 00:06:02.447 3,0 4672/s 192 MiB/s 0 0 00:06:02.447 2,0 4672/s 192 MiB/s 0 0 00:06:02.447 1,0 4672/s 192 MiB/s 0 0 00:06:02.447 ==================================================================================== 00:06:02.447 Total 18528/s 1965 MiB/s 0 0' 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:02.447 20:11:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:02.447 20:11:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.447 20:11:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.447 20:11:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.447 20:11:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.447 20:11:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.447 20:11:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.447 20:11:34 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.447 20:11:34 -- accel/accel.sh@42 -- # jq -r . 00:06:02.447 [2024-07-22 20:11:34.152770] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:02.447 [2024-07-22 20:11:34.152854] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3246318 ] 00:06:02.447 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.447 [2024-07-22 20:11:34.206550] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:02.447 [2024-07-22 20:11:34.279923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:02.447 [2024-07-22 20:11:34.280023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:02.447 [2024-07-22 20:11:34.280134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:02.447 [2024-07-22 20:11:34.280136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val= 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val= 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val= 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val=0xf 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val= 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val= 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val=decompress 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val= 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val=software 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val=32 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val=32 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val=1 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val=Yes 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val= 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:02.447 20:11:34 -- accel/accel.sh@21 -- # val= 00:06:02.447 20:11:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # IFS=: 00:06:02.447 20:11:34 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@21 -- # val= 00:06:03.823 20:11:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # IFS=: 00:06:03.823 20:11:35 -- accel/accel.sh@20 -- # read -r var val 00:06:03.823 20:11:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:03.823 20:11:35 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:03.823 20:11:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.823 00:06:03.823 real 0m2.753s 00:06:03.823 user 0m9.262s 00:06:03.823 sys 0m0.223s 00:06:03.823 20:11:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:03.823 20:11:35 -- common/autotest_common.sh@10 -- # set +x 00:06:03.823 ************************************ 00:06:03.823 END TEST accel_decomp_full_mcore 00:06:03.823 ************************************ 00:06:03.823 20:11:35 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:03.823 20:11:35 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:03.823 20:11:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:03.823 20:11:35 -- common/autotest_common.sh@10 -- # set +x 00:06:03.823 ************************************ 00:06:03.823 START TEST accel_decomp_mthread 00:06:03.823 ************************************ 00:06:03.823 20:11:35 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:03.823 20:11:35 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.823 20:11:35 -- accel/accel.sh@17 -- # local accel_module 00:06:03.823 20:11:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:03.823 20:11:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:03.823 20:11:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.823 20:11:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.823 20:11:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.823 20:11:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.823 20:11:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.823 20:11:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.823 20:11:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.823 20:11:35 -- accel/accel.sh@42 -- # jq -r . 00:06:03.823 [2024-07-22 20:11:35.569650] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:03.823 [2024-07-22 20:11:35.569707] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3246587 ] 00:06:03.823 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.823 [2024-07-22 20:11:35.623125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.823 [2024-07-22 20:11:35.694065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.320 20:11:36 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:05.320 00:06:05.320 SPDK Configuration: 00:06:05.320 Core mask: 0x1 00:06:05.320 00:06:05.320 Accel Perf Configuration: 00:06:05.320 Workload Type: decompress 00:06:05.320 Transfer size: 4096 bytes 00:06:05.320 Vector count 1 00:06:05.320 Module: software 00:06:05.320 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:05.320 Queue depth: 32 00:06:05.320 Allocate depth: 32 00:06:05.320 # threads/core: 2 00:06:05.320 Run time: 1 seconds 00:06:05.320 Verify: Yes 00:06:05.320 00:06:05.320 Running for 1 seconds... 00:06:05.320 00:06:05.320 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:05.320 ------------------------------------------------------------------------------------ 00:06:05.320 0,1 37056/s 68 MiB/s 0 0 00:06:05.320 0,0 36928/s 68 MiB/s 0 0 00:06:05.320 ==================================================================================== 00:06:05.320 Total 73984/s 289 MiB/s 0 0' 00:06:05.320 20:11:36 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:36 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:05.320 20:11:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:05.320 20:11:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.320 20:11:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.320 20:11:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.320 20:11:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.320 20:11:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.320 20:11:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.320 20:11:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.320 20:11:36 -- accel/accel.sh@42 -- # jq -r . 00:06:05.320 [2024-07-22 20:11:36.923761] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:05.320 [2024-07-22 20:11:36.923818] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3246810 ] 00:06:05.320 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.320 [2024-07-22 20:11:36.978955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.320 [2024-07-22 20:11:37.049210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val= 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val= 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val= 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val=0x1 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val= 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val= 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val=decompress 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val= 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val=software 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val=32 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val=32 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val=2 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val=Yes 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val= 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:05.320 20:11:37 -- accel/accel.sh@21 -- # val= 00:06:05.320 20:11:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.320 20:11:37 -- accel/accel.sh@20 -- # IFS=: 00:06:05.321 20:11:37 -- accel/accel.sh@20 -- # read -r var val 00:06:06.699 20:11:38 -- accel/accel.sh@21 -- # val= 00:06:06.699 20:11:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.699 20:11:38 -- accel/accel.sh@20 -- # IFS=: 00:06:06.699 20:11:38 -- accel/accel.sh@20 -- # read -r var val 00:06:06.699 20:11:38 -- accel/accel.sh@21 -- # val= 00:06:06.699 20:11:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.699 20:11:38 -- accel/accel.sh@20 -- # IFS=: 00:06:06.699 20:11:38 -- accel/accel.sh@20 -- # read -r var val 00:06:06.700 20:11:38 -- accel/accel.sh@21 -- # val= 00:06:06.700 20:11:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # IFS=: 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # read -r var val 00:06:06.700 20:11:38 -- accel/accel.sh@21 -- # val= 00:06:06.700 20:11:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # IFS=: 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # read -r var val 00:06:06.700 20:11:38 -- accel/accel.sh@21 -- # val= 00:06:06.700 20:11:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # IFS=: 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # read -r var val 00:06:06.700 20:11:38 -- accel/accel.sh@21 -- # val= 00:06:06.700 20:11:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # IFS=: 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # read -r var val 00:06:06.700 20:11:38 -- accel/accel.sh@21 -- # val= 00:06:06.700 20:11:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # IFS=: 00:06:06.700 20:11:38 -- accel/accel.sh@20 -- # read -r var val 00:06:06.700 20:11:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:06.700 20:11:38 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:06.700 20:11:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.700 00:06:06.700 real 0m2.719s 00:06:06.700 user 0m2.509s 00:06:06.700 sys 0m0.217s 00:06:06.700 20:11:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:06.700 20:11:38 -- common/autotest_common.sh@10 -- # set +x 00:06:06.700 ************************************ 00:06:06.700 END TEST accel_decomp_mthread 00:06:06.700 ************************************ 00:06:06.700 20:11:38 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:06.700 20:11:38 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:06.700 20:11:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:06.700 20:11:38 -- common/autotest_common.sh@10 -- # set +x 00:06:06.700 ************************************ 00:06:06.700 START TEST accel_deomp_full_mthread 00:06:06.700 ************************************ 00:06:06.700 20:11:38 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:06.700 20:11:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.700 20:11:38 -- accel/accel.sh@17 -- # local accel_module 00:06:06.700 20:11:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:06.700 20:11:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:06.700 20:11:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.700 20:11:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.700 20:11:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.700 20:11:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.700 20:11:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.700 20:11:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.700 20:11:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.700 20:11:38 -- accel/accel.sh@42 -- # jq -r . 00:06:06.700 [2024-07-22 20:11:38.328335] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:06.700 [2024-07-22 20:11:38.328409] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3247065 ] 00:06:06.700 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.700 [2024-07-22 20:11:38.382636] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.700 [2024-07-22 20:11:38.453871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.080 20:11:39 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:08.080 00:06:08.080 SPDK Configuration: 00:06:08.080 Core mask: 0x1 00:06:08.080 00:06:08.080 Accel Perf Configuration: 00:06:08.080 Workload Type: decompress 00:06:08.080 Transfer size: 111250 bytes 00:06:08.080 Vector count 1 00:06:08.080 Module: software 00:06:08.080 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.080 Queue depth: 32 00:06:08.080 Allocate depth: 32 00:06:08.080 # threads/core: 2 00:06:08.080 Run time: 1 seconds 00:06:08.080 Verify: Yes 00:06:08.080 00:06:08.080 Running for 1 seconds... 00:06:08.080 00:06:08.080 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:08.080 ------------------------------------------------------------------------------------ 00:06:08.080 0,1 2400/s 99 MiB/s 0 0 00:06:08.080 0,0 2368/s 97 MiB/s 0 0 00:06:08.080 ==================================================================================== 00:06:08.080 Total 4768/s 505 MiB/s 0 0' 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.080 20:11:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:08.080 20:11:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:08.080 20:11:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.080 20:11:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.080 20:11:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.080 20:11:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.080 20:11:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.080 20:11:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.080 20:11:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.080 20:11:39 -- accel/accel.sh@42 -- # jq -r . 00:06:08.080 [2024-07-22 20:11:39.707985] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:08.080 [2024-07-22 20:11:39.708094] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3247301 ] 00:06:08.080 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.080 [2024-07-22 20:11:39.762077] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.080 [2024-07-22 20:11:39.832253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.080 20:11:39 -- accel/accel.sh@21 -- # val= 00:06:08.080 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.080 20:11:39 -- accel/accel.sh@21 -- # val= 00:06:08.080 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.080 20:11:39 -- accel/accel.sh@21 -- # val= 00:06:08.080 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.080 20:11:39 -- accel/accel.sh@21 -- # val=0x1 00:06:08.080 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.080 20:11:39 -- accel/accel.sh@21 -- # val= 00:06:08.080 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.080 20:11:39 -- accel/accel.sh@21 -- # val= 00:06:08.080 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.080 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.080 20:11:39 -- accel/accel.sh@21 -- # val=decompress 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val= 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val=software 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val=32 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val=32 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val=2 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val=Yes 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val= 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:08.081 20:11:39 -- accel/accel.sh@21 -- # val= 00:06:08.081 20:11:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # IFS=: 00:06:08.081 20:11:39 -- accel/accel.sh@20 -- # read -r var val 00:06:09.458 20:11:41 -- accel/accel.sh@21 -- # val= 00:06:09.458 20:11:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # IFS=: 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # read -r var val 00:06:09.458 20:11:41 -- accel/accel.sh@21 -- # val= 00:06:09.458 20:11:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # IFS=: 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # read -r var val 00:06:09.458 20:11:41 -- accel/accel.sh@21 -- # val= 00:06:09.458 20:11:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # IFS=: 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # read -r var val 00:06:09.458 20:11:41 -- accel/accel.sh@21 -- # val= 00:06:09.458 20:11:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # IFS=: 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # read -r var val 00:06:09.458 20:11:41 -- accel/accel.sh@21 -- # val= 00:06:09.458 20:11:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # IFS=: 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # read -r var val 00:06:09.458 20:11:41 -- accel/accel.sh@21 -- # val= 00:06:09.458 20:11:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # IFS=: 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # read -r var val 00:06:09.458 20:11:41 -- accel/accel.sh@21 -- # val= 00:06:09.458 20:11:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # IFS=: 00:06:09.458 20:11:41 -- accel/accel.sh@20 -- # read -r var val 00:06:09.458 20:11:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:09.458 20:11:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:09.458 20:11:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:09.458 00:06:09.458 real 0m2.764s 00:06:09.458 user 0m2.547s 00:06:09.458 sys 0m0.223s 00:06:09.458 20:11:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:09.458 20:11:41 -- common/autotest_common.sh@10 -- # set +x 00:06:09.458 ************************************ 00:06:09.458 END TEST accel_deomp_full_mthread 00:06:09.458 ************************************ 00:06:09.458 20:11:41 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:09.458 20:11:41 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:09.458 20:11:41 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:09.458 20:11:41 -- accel/accel.sh@129 -- # build_accel_config 00:06:09.458 20:11:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:09.458 20:11:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.458 20:11:41 -- common/autotest_common.sh@10 -- # set +x 00:06:09.458 20:11:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.458 20:11:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.458 20:11:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.458 20:11:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.458 20:11:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.458 20:11:41 -- accel/accel.sh@42 -- # jq -r . 00:06:09.458 ************************************ 00:06:09.458 START TEST accel_dif_functional_tests 00:06:09.458 ************************************ 00:06:09.458 20:11:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:09.458 [2024-07-22 20:11:41.133326] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:09.458 [2024-07-22 20:11:41.133377] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3247571 ] 00:06:09.458 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.458 [2024-07-22 20:11:41.181379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:09.458 [2024-07-22 20:11:41.256088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:09.458 [2024-07-22 20:11:41.256161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.458 [2024-07-22 20:11:41.256161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:09.458 00:06:09.458 00:06:09.458 CUnit - A unit testing framework for C - Version 2.1-3 00:06:09.458 http://cunit.sourceforge.net/ 00:06:09.458 00:06:09.458 00:06:09.458 Suite: accel_dif 00:06:09.458 Test: verify: DIF generated, GUARD check ...passed 00:06:09.458 Test: verify: DIF generated, APPTAG check ...passed 00:06:09.458 Test: verify: DIF generated, REFTAG check ...passed 00:06:09.458 Test: verify: DIF not generated, GUARD check ...[2024-07-22 20:11:41.324959] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:09.458 [2024-07-22 20:11:41.325000] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:09.458 passed 00:06:09.458 Test: verify: DIF not generated, APPTAG check ...[2024-07-22 20:11:41.325032] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:09.458 [2024-07-22 20:11:41.325051] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:09.458 passed 00:06:09.458 Test: verify: DIF not generated, REFTAG check ...[2024-07-22 20:11:41.325070] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:09.459 [2024-07-22 20:11:41.325090] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:09.459 passed 00:06:09.459 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:09.459 Test: verify: APPTAG incorrect, APPTAG check ...[2024-07-22 20:11:41.325130] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:09.459 passed 00:06:09.459 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:09.459 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:09.459 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:09.459 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-07-22 20:11:41.325233] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:09.459 passed 00:06:09.459 Test: generate copy: DIF generated, GUARD check ...passed 00:06:09.459 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:09.459 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:09.459 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:09.459 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:09.459 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:09.459 Test: generate copy: iovecs-len validate ...[2024-07-22 20:11:41.325406] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:09.459 passed 00:06:09.459 Test: generate copy: buffer alignment validate ...passed 00:06:09.459 00:06:09.459 Run Summary: Type Total Ran Passed Failed Inactive 00:06:09.459 suites 1 1 n/a 0 0 00:06:09.459 tests 20 20 20 0 0 00:06:09.459 asserts 204 204 204 0 n/a 00:06:09.459 00:06:09.459 Elapsed time = 0.002 seconds 00:06:09.718 00:06:09.718 real 0m0.410s 00:06:09.718 user 0m0.634s 00:06:09.718 sys 0m0.133s 00:06:09.718 20:11:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:09.718 20:11:41 -- common/autotest_common.sh@10 -- # set +x 00:06:09.718 ************************************ 00:06:09.718 END TEST accel_dif_functional_tests 00:06:09.718 ************************************ 00:06:09.718 00:06:09.718 real 0m57.593s 00:06:09.718 user 1m6.294s 00:06:09.718 sys 0m5.886s 00:06:09.718 20:11:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:09.718 20:11:41 -- common/autotest_common.sh@10 -- # set +x 00:06:09.718 ************************************ 00:06:09.718 END TEST accel 00:06:09.718 ************************************ 00:06:09.718 20:11:41 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:09.718 20:11:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:09.718 20:11:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:09.718 20:11:41 -- common/autotest_common.sh@10 -- # set +x 00:06:09.718 ************************************ 00:06:09.718 START TEST accel_rpc 00:06:09.718 ************************************ 00:06:09.718 20:11:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:09.718 * Looking for test storage... 00:06:09.977 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:09.977 20:11:41 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:09.977 20:11:41 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3247817 00:06:09.977 20:11:41 -- accel/accel_rpc.sh@15 -- # waitforlisten 3247817 00:06:09.977 20:11:41 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:09.977 20:11:41 -- common/autotest_common.sh@819 -- # '[' -z 3247817 ']' 00:06:09.977 20:11:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:09.977 20:11:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:09.977 20:11:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:09.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:09.977 20:11:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:09.977 20:11:41 -- common/autotest_common.sh@10 -- # set +x 00:06:09.977 [2024-07-22 20:11:41.706521] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:09.977 [2024-07-22 20:11:41.706570] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3247817 ] 00:06:09.977 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.977 [2024-07-22 20:11:41.759309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.977 [2024-07-22 20:11:41.831932] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:09.977 [2024-07-22 20:11:41.832057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.913 20:11:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:10.913 20:11:42 -- common/autotest_common.sh@852 -- # return 0 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:10.913 20:11:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:10.913 20:11:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:10.913 20:11:42 -- common/autotest_common.sh@10 -- # set +x 00:06:10.913 ************************************ 00:06:10.913 START TEST accel_assign_opcode 00:06:10.913 ************************************ 00:06:10.913 20:11:42 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:10.913 20:11:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:10.913 20:11:42 -- common/autotest_common.sh@10 -- # set +x 00:06:10.913 [2024-07-22 20:11:42.502021] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:10.913 20:11:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:10.913 20:11:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:10.913 20:11:42 -- common/autotest_common.sh@10 -- # set +x 00:06:10.913 [2024-07-22 20:11:42.514052] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:10.913 20:11:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:10.913 20:11:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:10.913 20:11:42 -- common/autotest_common.sh@10 -- # set +x 00:06:10.913 20:11:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:10.913 20:11:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@42 -- # grep software 00:06:10.913 20:11:42 -- common/autotest_common.sh@10 -- # set +x 00:06:10.913 20:11:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:10.913 software 00:06:10.913 00:06:10.913 real 0m0.242s 00:06:10.913 user 0m0.044s 00:06:10.913 sys 0m0.013s 00:06:10.913 20:11:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:10.913 20:11:42 -- common/autotest_common.sh@10 -- # set +x 00:06:10.913 ************************************ 00:06:10.913 END TEST accel_assign_opcode 00:06:10.913 ************************************ 00:06:10.913 20:11:42 -- accel/accel_rpc.sh@55 -- # killprocess 3247817 00:06:10.913 20:11:42 -- common/autotest_common.sh@926 -- # '[' -z 3247817 ']' 00:06:10.913 20:11:42 -- common/autotest_common.sh@930 -- # kill -0 3247817 00:06:10.913 20:11:42 -- common/autotest_common.sh@931 -- # uname 00:06:10.913 20:11:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:10.913 20:11:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3247817 00:06:10.913 20:11:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:10.913 20:11:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:10.913 20:11:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3247817' 00:06:10.913 killing process with pid 3247817 00:06:10.913 20:11:42 -- common/autotest_common.sh@945 -- # kill 3247817 00:06:10.913 20:11:42 -- common/autotest_common.sh@950 -- # wait 3247817 00:06:11.482 00:06:11.482 real 0m1.565s 00:06:11.482 user 0m1.634s 00:06:11.482 sys 0m0.379s 00:06:11.482 20:11:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:11.482 20:11:43 -- common/autotest_common.sh@10 -- # set +x 00:06:11.482 ************************************ 00:06:11.482 END TEST accel_rpc 00:06:11.482 ************************************ 00:06:11.482 20:11:43 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:11.482 20:11:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:11.482 20:11:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:11.482 20:11:43 -- common/autotest_common.sh@10 -- # set +x 00:06:11.482 ************************************ 00:06:11.482 START TEST app_cmdline 00:06:11.482 ************************************ 00:06:11.482 20:11:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:11.482 * Looking for test storage... 00:06:11.482 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:11.482 20:11:43 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:11.482 20:11:43 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3248118 00:06:11.482 20:11:43 -- app/cmdline.sh@18 -- # waitforlisten 3248118 00:06:11.482 20:11:43 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:11.482 20:11:43 -- common/autotest_common.sh@819 -- # '[' -z 3248118 ']' 00:06:11.482 20:11:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:11.482 20:11:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:11.482 20:11:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:11.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:11.482 20:11:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:11.482 20:11:43 -- common/autotest_common.sh@10 -- # set +x 00:06:11.482 [2024-07-22 20:11:43.320009] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:11.482 [2024-07-22 20:11:43.320061] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3248118 ] 00:06:11.482 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.482 [2024-07-22 20:11:43.373689] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.741 [2024-07-22 20:11:43.451926] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:11.741 [2024-07-22 20:11:43.452038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.309 20:11:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:12.309 20:11:44 -- common/autotest_common.sh@852 -- # return 0 00:06:12.309 20:11:44 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:12.568 { 00:06:12.568 "version": "SPDK v24.01.1-pre git sha1 dbef7efac", 00:06:12.568 "fields": { 00:06:12.568 "major": 24, 00:06:12.568 "minor": 1, 00:06:12.568 "patch": 1, 00:06:12.568 "suffix": "-pre", 00:06:12.568 "commit": "dbef7efac" 00:06:12.568 } 00:06:12.568 } 00:06:12.568 20:11:44 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:12.568 20:11:44 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:12.568 20:11:44 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:12.568 20:11:44 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:12.568 20:11:44 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:12.568 20:11:44 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:12.568 20:11:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:12.568 20:11:44 -- common/autotest_common.sh@10 -- # set +x 00:06:12.568 20:11:44 -- app/cmdline.sh@26 -- # sort 00:06:12.568 20:11:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:12.568 20:11:44 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:12.568 20:11:44 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:12.568 20:11:44 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:12.568 20:11:44 -- common/autotest_common.sh@640 -- # local es=0 00:06:12.568 20:11:44 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:12.568 20:11:44 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:12.568 20:11:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:12.568 20:11:44 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:12.568 20:11:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:12.568 20:11:44 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:12.568 20:11:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:12.568 20:11:44 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:12.568 20:11:44 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:12.568 20:11:44 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:12.568 request: 00:06:12.568 { 00:06:12.568 "method": "env_dpdk_get_mem_stats", 00:06:12.568 "req_id": 1 00:06:12.568 } 00:06:12.568 Got JSON-RPC error response 00:06:12.568 response: 00:06:12.568 { 00:06:12.568 "code": -32601, 00:06:12.568 "message": "Method not found" 00:06:12.568 } 00:06:12.568 20:11:44 -- common/autotest_common.sh@643 -- # es=1 00:06:12.568 20:11:44 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:12.568 20:11:44 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:12.568 20:11:44 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:12.568 20:11:44 -- app/cmdline.sh@1 -- # killprocess 3248118 00:06:12.568 20:11:44 -- common/autotest_common.sh@926 -- # '[' -z 3248118 ']' 00:06:12.568 20:11:44 -- common/autotest_common.sh@930 -- # kill -0 3248118 00:06:12.568 20:11:44 -- common/autotest_common.sh@931 -- # uname 00:06:12.568 20:11:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:12.568 20:11:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3248118 00:06:12.827 20:11:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:12.827 20:11:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:12.827 20:11:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3248118' 00:06:12.827 killing process with pid 3248118 00:06:12.827 20:11:44 -- common/autotest_common.sh@945 -- # kill 3248118 00:06:12.827 20:11:44 -- common/autotest_common.sh@950 -- # wait 3248118 00:06:13.086 00:06:13.086 real 0m1.667s 00:06:13.086 user 0m1.979s 00:06:13.086 sys 0m0.416s 00:06:13.086 20:11:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:13.086 20:11:44 -- common/autotest_common.sh@10 -- # set +x 00:06:13.086 ************************************ 00:06:13.086 END TEST app_cmdline 00:06:13.086 ************************************ 00:06:13.086 20:11:44 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:13.086 20:11:44 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:13.086 20:11:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:13.086 20:11:44 -- common/autotest_common.sh@10 -- # set +x 00:06:13.086 ************************************ 00:06:13.086 START TEST version 00:06:13.086 ************************************ 00:06:13.086 20:11:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:13.086 * Looking for test storage... 00:06:13.086 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:13.086 20:11:44 -- app/version.sh@17 -- # get_header_version major 00:06:13.086 20:11:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:13.086 20:11:44 -- app/version.sh@14 -- # cut -f2 00:06:13.086 20:11:44 -- app/version.sh@14 -- # tr -d '"' 00:06:13.086 20:11:44 -- app/version.sh@17 -- # major=24 00:06:13.086 20:11:44 -- app/version.sh@18 -- # get_header_version minor 00:06:13.086 20:11:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:13.086 20:11:44 -- app/version.sh@14 -- # cut -f2 00:06:13.086 20:11:44 -- app/version.sh@14 -- # tr -d '"' 00:06:13.086 20:11:44 -- app/version.sh@18 -- # minor=1 00:06:13.086 20:11:44 -- app/version.sh@19 -- # get_header_version patch 00:06:13.086 20:11:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:13.086 20:11:44 -- app/version.sh@14 -- # cut -f2 00:06:13.086 20:11:44 -- app/version.sh@14 -- # tr -d '"' 00:06:13.086 20:11:44 -- app/version.sh@19 -- # patch=1 00:06:13.086 20:11:44 -- app/version.sh@20 -- # get_header_version suffix 00:06:13.086 20:11:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:13.086 20:11:44 -- app/version.sh@14 -- # cut -f2 00:06:13.086 20:11:44 -- app/version.sh@14 -- # tr -d '"' 00:06:13.086 20:11:44 -- app/version.sh@20 -- # suffix=-pre 00:06:13.086 20:11:44 -- app/version.sh@22 -- # version=24.1 00:06:13.086 20:11:44 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:13.086 20:11:44 -- app/version.sh@25 -- # version=24.1.1 00:06:13.086 20:11:44 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:13.086 20:11:44 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:13.086 20:11:45 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:13.345 20:11:45 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:13.345 20:11:45 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:13.345 00:06:13.345 real 0m0.143s 00:06:13.345 user 0m0.073s 00:06:13.345 sys 0m0.106s 00:06:13.345 20:11:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:13.345 20:11:45 -- common/autotest_common.sh@10 -- # set +x 00:06:13.345 ************************************ 00:06:13.345 END TEST version 00:06:13.346 ************************************ 00:06:13.346 20:11:45 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:06:13.346 20:11:45 -- spdk/autotest.sh@204 -- # uname -s 00:06:13.346 20:11:45 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:06:13.346 20:11:45 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:13.346 20:11:45 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:13.346 20:11:45 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:06:13.346 20:11:45 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:06:13.346 20:11:45 -- spdk/autotest.sh@268 -- # timing_exit lib 00:06:13.346 20:11:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:13.346 20:11:45 -- common/autotest_common.sh@10 -- # set +x 00:06:13.346 20:11:45 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:06:13.346 20:11:45 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:06:13.346 20:11:45 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:06:13.346 20:11:45 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:06:13.346 20:11:45 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:06:13.346 20:11:45 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:06:13.346 20:11:45 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:13.346 20:11:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:13.346 20:11:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:13.346 20:11:45 -- common/autotest_common.sh@10 -- # set +x 00:06:13.346 ************************************ 00:06:13.346 START TEST nvmf_tcp 00:06:13.346 ************************************ 00:06:13.346 20:11:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:13.346 * Looking for test storage... 00:06:13.346 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:13.346 20:11:45 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:13.346 20:11:45 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:13.346 20:11:45 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:13.346 20:11:45 -- nvmf/common.sh@7 -- # uname -s 00:06:13.346 20:11:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:13.346 20:11:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:13.346 20:11:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:13.346 20:11:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:13.346 20:11:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:13.346 20:11:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:13.346 20:11:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:13.346 20:11:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:13.346 20:11:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:13.346 20:11:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:13.346 20:11:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:06:13.346 20:11:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:06:13.346 20:11:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:13.346 20:11:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:13.346 20:11:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:13.346 20:11:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:13.346 20:11:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:13.346 20:11:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:13.346 20:11:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:13.346 20:11:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:13.346 20:11:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:13.346 20:11:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:13.346 20:11:45 -- paths/export.sh@5 -- # export PATH 00:06:13.346 20:11:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:13.346 20:11:45 -- nvmf/common.sh@46 -- # : 0 00:06:13.346 20:11:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:13.346 20:11:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:13.346 20:11:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:13.346 20:11:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:13.346 20:11:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:13.346 20:11:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:13.346 20:11:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:13.346 20:11:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:13.346 20:11:45 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:13.346 20:11:45 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:13.346 20:11:45 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:13.346 20:11:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:13.346 20:11:45 -- common/autotest_common.sh@10 -- # set +x 00:06:13.346 20:11:45 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:13.346 20:11:45 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:13.346 20:11:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:13.346 20:11:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:13.346 20:11:45 -- common/autotest_common.sh@10 -- # set +x 00:06:13.346 ************************************ 00:06:13.346 START TEST nvmf_example 00:06:13.346 ************************************ 00:06:13.346 20:11:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:13.606 * Looking for test storage... 00:06:13.606 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:13.606 20:11:45 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:13.606 20:11:45 -- nvmf/common.sh@7 -- # uname -s 00:06:13.606 20:11:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:13.606 20:11:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:13.606 20:11:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:13.606 20:11:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:13.606 20:11:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:13.606 20:11:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:13.606 20:11:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:13.606 20:11:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:13.606 20:11:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:13.606 20:11:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:13.606 20:11:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:06:13.606 20:11:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:06:13.606 20:11:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:13.606 20:11:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:13.606 20:11:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:13.606 20:11:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:13.606 20:11:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:13.606 20:11:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:13.606 20:11:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:13.606 20:11:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:13.606 20:11:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:13.606 20:11:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:13.606 20:11:45 -- paths/export.sh@5 -- # export PATH 00:06:13.606 20:11:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:13.606 20:11:45 -- nvmf/common.sh@46 -- # : 0 00:06:13.606 20:11:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:13.606 20:11:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:13.606 20:11:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:13.606 20:11:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:13.606 20:11:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:13.606 20:11:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:13.606 20:11:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:13.606 20:11:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:13.606 20:11:45 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:13.606 20:11:45 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:13.606 20:11:45 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:13.606 20:11:45 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:13.606 20:11:45 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:13.606 20:11:45 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:13.606 20:11:45 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:13.606 20:11:45 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:13.606 20:11:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:13.606 20:11:45 -- common/autotest_common.sh@10 -- # set +x 00:06:13.606 20:11:45 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:13.606 20:11:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:13.606 20:11:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:13.606 20:11:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:13.606 20:11:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:13.606 20:11:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:13.606 20:11:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:13.607 20:11:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:13.607 20:11:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:13.607 20:11:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:13.607 20:11:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:13.607 20:11:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:13.607 20:11:45 -- common/autotest_common.sh@10 -- # set +x 00:06:18.879 20:11:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:18.879 20:11:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:18.879 20:11:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:18.879 20:11:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:18.879 20:11:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:18.879 20:11:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:18.879 20:11:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:18.879 20:11:50 -- nvmf/common.sh@294 -- # net_devs=() 00:06:18.879 20:11:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:18.879 20:11:50 -- nvmf/common.sh@295 -- # e810=() 00:06:18.879 20:11:50 -- nvmf/common.sh@295 -- # local -ga e810 00:06:18.879 20:11:50 -- nvmf/common.sh@296 -- # x722=() 00:06:18.879 20:11:50 -- nvmf/common.sh@296 -- # local -ga x722 00:06:18.879 20:11:50 -- nvmf/common.sh@297 -- # mlx=() 00:06:18.879 20:11:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:18.879 20:11:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:18.879 20:11:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:18.879 20:11:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:18.879 20:11:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:18.879 20:11:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:18.879 20:11:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:18.879 20:11:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:18.879 20:11:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:18.880 20:11:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:06:18.880 Found 0000:86:00.0 (0x8086 - 0x159b) 00:06:18.880 20:11:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:18.880 20:11:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:06:18.880 Found 0000:86:00.1 (0x8086 - 0x159b) 00:06:18.880 20:11:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:18.880 20:11:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:18.880 20:11:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:18.880 20:11:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:18.880 20:11:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:18.880 20:11:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:06:18.880 Found net devices under 0000:86:00.0: cvl_0_0 00:06:18.880 20:11:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:18.880 20:11:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:18.880 20:11:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:18.880 20:11:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:18.880 20:11:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:18.880 20:11:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:06:18.880 Found net devices under 0000:86:00.1: cvl_0_1 00:06:18.880 20:11:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:18.880 20:11:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:18.880 20:11:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:18.880 20:11:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:18.880 20:11:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:18.880 20:11:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:18.880 20:11:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:18.880 20:11:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:18.880 20:11:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:18.880 20:11:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:18.880 20:11:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:18.880 20:11:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:18.880 20:11:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:18.880 20:11:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:18.880 20:11:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:18.880 20:11:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:18.880 20:11:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:18.880 20:11:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:18.880 20:11:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:18.880 20:11:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:18.880 20:11:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:18.880 20:11:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:18.880 20:11:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:18.880 20:11:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:18.880 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:18.880 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.299 ms 00:06:18.880 00:06:18.880 --- 10.0.0.2 ping statistics --- 00:06:18.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:18.880 rtt min/avg/max/mdev = 0.299/0.299/0.299/0.000 ms 00:06:18.880 20:11:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:18.880 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:18.880 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.305 ms 00:06:18.880 00:06:18.880 --- 10.0.0.1 ping statistics --- 00:06:18.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:18.880 rtt min/avg/max/mdev = 0.305/0.305/0.305/0.000 ms 00:06:18.880 20:11:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:18.880 20:11:50 -- nvmf/common.sh@410 -- # return 0 00:06:18.880 20:11:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:18.880 20:11:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:18.880 20:11:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:18.880 20:11:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:18.880 20:11:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:18.880 20:11:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:18.880 20:11:50 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:18.880 20:11:50 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:18.880 20:11:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:18.880 20:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:18.880 20:11:50 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:18.880 20:11:50 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:18.880 20:11:50 -- target/nvmf_example.sh@34 -- # nvmfpid=3251526 00:06:18.880 20:11:50 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:18.880 20:11:50 -- target/nvmf_example.sh@36 -- # waitforlisten 3251526 00:06:18.880 20:11:50 -- common/autotest_common.sh@819 -- # '[' -z 3251526 ']' 00:06:18.880 20:11:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:18.880 20:11:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:18.880 20:11:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:18.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:18.880 20:11:50 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:18.880 20:11:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:18.880 20:11:50 -- common/autotest_common.sh@10 -- # set +x 00:06:18.880 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.446 20:11:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:19.446 20:11:51 -- common/autotest_common.sh@852 -- # return 0 00:06:19.446 20:11:51 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:19.446 20:11:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:19.446 20:11:51 -- common/autotest_common.sh@10 -- # set +x 00:06:19.704 20:11:51 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:19.704 20:11:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.704 20:11:51 -- common/autotest_common.sh@10 -- # set +x 00:06:19.704 20:11:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:19.704 20:11:51 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:19.704 20:11:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.704 20:11:51 -- common/autotest_common.sh@10 -- # set +x 00:06:19.704 20:11:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:19.704 20:11:51 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:19.704 20:11:51 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:19.704 20:11:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.704 20:11:51 -- common/autotest_common.sh@10 -- # set +x 00:06:19.704 20:11:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:19.704 20:11:51 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:19.704 20:11:51 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:19.704 20:11:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.704 20:11:51 -- common/autotest_common.sh@10 -- # set +x 00:06:19.704 20:11:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:19.704 20:11:51 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:19.704 20:11:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.704 20:11:51 -- common/autotest_common.sh@10 -- # set +x 00:06:19.704 20:11:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:19.704 20:11:51 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:19.704 20:11:51 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:19.704 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.897 Initializing NVMe Controllers 00:06:31.897 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:31.897 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:31.897 Initialization complete. Launching workers. 00:06:31.897 ======================================================== 00:06:31.897 Latency(us) 00:06:31.897 Device Information : IOPS MiB/s Average min max 00:06:31.897 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 13940.63 54.46 4593.90 706.61 15464.58 00:06:31.897 ======================================================== 00:06:31.897 Total : 13940.63 54.46 4593.90 706.61 15464.58 00:06:31.897 00:06:31.897 20:12:01 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:31.897 20:12:01 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:31.897 20:12:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:31.897 20:12:01 -- nvmf/common.sh@116 -- # sync 00:06:31.897 20:12:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:31.897 20:12:01 -- nvmf/common.sh@119 -- # set +e 00:06:31.897 20:12:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:31.897 20:12:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:31.897 rmmod nvme_tcp 00:06:31.897 rmmod nvme_fabrics 00:06:31.897 rmmod nvme_keyring 00:06:31.897 20:12:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:31.897 20:12:01 -- nvmf/common.sh@123 -- # set -e 00:06:31.897 20:12:01 -- nvmf/common.sh@124 -- # return 0 00:06:31.897 20:12:01 -- nvmf/common.sh@477 -- # '[' -n 3251526 ']' 00:06:31.897 20:12:01 -- nvmf/common.sh@478 -- # killprocess 3251526 00:06:31.897 20:12:01 -- common/autotest_common.sh@926 -- # '[' -z 3251526 ']' 00:06:31.897 20:12:01 -- common/autotest_common.sh@930 -- # kill -0 3251526 00:06:31.897 20:12:01 -- common/autotest_common.sh@931 -- # uname 00:06:31.897 20:12:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:31.897 20:12:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3251526 00:06:31.897 20:12:01 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:06:31.897 20:12:01 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:06:31.897 20:12:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3251526' 00:06:31.897 killing process with pid 3251526 00:06:31.897 20:12:01 -- common/autotest_common.sh@945 -- # kill 3251526 00:06:31.897 20:12:01 -- common/autotest_common.sh@950 -- # wait 3251526 00:06:31.897 nvmf threads initialize successfully 00:06:31.897 bdev subsystem init successfully 00:06:31.897 created a nvmf target service 00:06:31.897 create targets's poll groups done 00:06:31.897 all subsystems of target started 00:06:31.897 nvmf target is running 00:06:31.897 all subsystems of target stopped 00:06:31.897 destroy targets's poll groups done 00:06:31.897 destroyed the nvmf target service 00:06:31.897 bdev subsystem finish successfully 00:06:31.897 nvmf threads destroy successfully 00:06:31.897 20:12:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:31.897 20:12:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:31.897 20:12:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:31.897 20:12:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:31.897 20:12:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:31.897 20:12:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:31.897 20:12:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:31.897 20:12:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:32.156 20:12:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:32.156 20:12:04 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:32.156 20:12:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:32.156 20:12:04 -- common/autotest_common.sh@10 -- # set +x 00:06:32.156 00:06:32.156 real 0m18.817s 00:06:32.156 user 0m45.672s 00:06:32.156 sys 0m5.119s 00:06:32.156 20:12:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:32.156 20:12:04 -- common/autotest_common.sh@10 -- # set +x 00:06:32.156 ************************************ 00:06:32.156 END TEST nvmf_example 00:06:32.156 ************************************ 00:06:32.156 20:12:04 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:32.156 20:12:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:32.156 20:12:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:32.156 20:12:04 -- common/autotest_common.sh@10 -- # set +x 00:06:32.156 ************************************ 00:06:32.156 START TEST nvmf_filesystem 00:06:32.156 ************************************ 00:06:32.156 20:12:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:32.417 * Looking for test storage... 00:06:32.417 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:32.417 20:12:04 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:32.417 20:12:04 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:32.417 20:12:04 -- common/autotest_common.sh@34 -- # set -e 00:06:32.417 20:12:04 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:32.417 20:12:04 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:32.417 20:12:04 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:32.417 20:12:04 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:32.417 20:12:04 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:32.417 20:12:04 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:32.417 20:12:04 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:32.417 20:12:04 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:32.417 20:12:04 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:32.417 20:12:04 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:32.417 20:12:04 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:32.417 20:12:04 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:32.417 20:12:04 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:32.417 20:12:04 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:32.417 20:12:04 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:32.417 20:12:04 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:32.417 20:12:04 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:32.417 20:12:04 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:32.417 20:12:04 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:32.417 20:12:04 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:32.417 20:12:04 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:32.417 20:12:04 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:32.417 20:12:04 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:32.417 20:12:04 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:32.417 20:12:04 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:32.417 20:12:04 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:32.417 20:12:04 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:32.417 20:12:04 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:32.417 20:12:04 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:32.417 20:12:04 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:32.417 20:12:04 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:32.417 20:12:04 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:32.417 20:12:04 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:32.417 20:12:04 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:32.417 20:12:04 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:32.417 20:12:04 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:32.417 20:12:04 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:32.417 20:12:04 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:32.417 20:12:04 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:32.417 20:12:04 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:32.417 20:12:04 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:32.417 20:12:04 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:32.417 20:12:04 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:32.417 20:12:04 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:32.417 20:12:04 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:32.417 20:12:04 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:32.417 20:12:04 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:32.417 20:12:04 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:32.417 20:12:04 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:32.417 20:12:04 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:32.417 20:12:04 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:32.417 20:12:04 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:32.417 20:12:04 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:32.417 20:12:04 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:32.417 20:12:04 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:32.417 20:12:04 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:32.417 20:12:04 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:32.417 20:12:04 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:32.417 20:12:04 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:32.417 20:12:04 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:32.417 20:12:04 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:32.417 20:12:04 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:32.417 20:12:04 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:32.417 20:12:04 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:32.417 20:12:04 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:32.417 20:12:04 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:32.417 20:12:04 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:32.417 20:12:04 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:32.417 20:12:04 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:32.417 20:12:04 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:32.417 20:12:04 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:32.417 20:12:04 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:32.417 20:12:04 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:32.417 20:12:04 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:32.417 20:12:04 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:32.417 20:12:04 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:32.417 20:12:04 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:32.417 20:12:04 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:32.417 20:12:04 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:32.417 20:12:04 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:32.417 20:12:04 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:32.417 20:12:04 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:32.417 20:12:04 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:32.417 20:12:04 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:32.417 20:12:04 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:32.417 20:12:04 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:32.417 20:12:04 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:32.417 20:12:04 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:32.417 20:12:04 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:32.417 20:12:04 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:32.417 20:12:04 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:32.417 20:12:04 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:32.417 20:12:04 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:32.417 20:12:04 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:32.417 20:12:04 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:32.417 20:12:04 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:32.417 20:12:04 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:32.417 20:12:04 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:32.417 20:12:04 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:32.417 #define SPDK_CONFIG_H 00:06:32.417 #define SPDK_CONFIG_APPS 1 00:06:32.417 #define SPDK_CONFIG_ARCH native 00:06:32.417 #undef SPDK_CONFIG_ASAN 00:06:32.417 #undef SPDK_CONFIG_AVAHI 00:06:32.417 #undef SPDK_CONFIG_CET 00:06:32.417 #define SPDK_CONFIG_COVERAGE 1 00:06:32.417 #define SPDK_CONFIG_CROSS_PREFIX 00:06:32.417 #undef SPDK_CONFIG_CRYPTO 00:06:32.417 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:32.417 #undef SPDK_CONFIG_CUSTOMOCF 00:06:32.417 #undef SPDK_CONFIG_DAOS 00:06:32.417 #define SPDK_CONFIG_DAOS_DIR 00:06:32.417 #define SPDK_CONFIG_DEBUG 1 00:06:32.417 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:32.417 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:32.417 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:32.417 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:32.417 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:32.417 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:32.417 #define SPDK_CONFIG_EXAMPLES 1 00:06:32.417 #undef SPDK_CONFIG_FC 00:06:32.417 #define SPDK_CONFIG_FC_PATH 00:06:32.417 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:32.417 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:32.417 #undef SPDK_CONFIG_FUSE 00:06:32.417 #undef SPDK_CONFIG_FUZZER 00:06:32.417 #define SPDK_CONFIG_FUZZER_LIB 00:06:32.417 #undef SPDK_CONFIG_GOLANG 00:06:32.418 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:32.418 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:32.418 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:32.418 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:32.418 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:32.418 #define SPDK_CONFIG_IDXD 1 00:06:32.418 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:32.418 #undef SPDK_CONFIG_IPSEC_MB 00:06:32.418 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:32.418 #define SPDK_CONFIG_ISAL 1 00:06:32.418 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:32.418 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:32.418 #define SPDK_CONFIG_LIBDIR 00:06:32.418 #undef SPDK_CONFIG_LTO 00:06:32.418 #define SPDK_CONFIG_MAX_LCORES 00:06:32.418 #define SPDK_CONFIG_NVME_CUSE 1 00:06:32.418 #undef SPDK_CONFIG_OCF 00:06:32.418 #define SPDK_CONFIG_OCF_PATH 00:06:32.418 #define SPDK_CONFIG_OPENSSL_PATH 00:06:32.418 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:32.418 #undef SPDK_CONFIG_PGO_USE 00:06:32.418 #define SPDK_CONFIG_PREFIX /usr/local 00:06:32.418 #undef SPDK_CONFIG_RAID5F 00:06:32.418 #undef SPDK_CONFIG_RBD 00:06:32.418 #define SPDK_CONFIG_RDMA 1 00:06:32.418 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:32.418 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:32.418 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:32.418 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:32.418 #define SPDK_CONFIG_SHARED 1 00:06:32.418 #undef SPDK_CONFIG_SMA 00:06:32.418 #define SPDK_CONFIG_TESTS 1 00:06:32.418 #undef SPDK_CONFIG_TSAN 00:06:32.418 #define SPDK_CONFIG_UBLK 1 00:06:32.418 #define SPDK_CONFIG_UBSAN 1 00:06:32.418 #undef SPDK_CONFIG_UNIT_TESTS 00:06:32.418 #undef SPDK_CONFIG_URING 00:06:32.418 #define SPDK_CONFIG_URING_PATH 00:06:32.418 #undef SPDK_CONFIG_URING_ZNS 00:06:32.418 #undef SPDK_CONFIG_USDT 00:06:32.418 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:32.418 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:32.418 #undef SPDK_CONFIG_VFIO_USER 00:06:32.418 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:32.418 #define SPDK_CONFIG_VHOST 1 00:06:32.418 #define SPDK_CONFIG_VIRTIO 1 00:06:32.418 #undef SPDK_CONFIG_VTUNE 00:06:32.418 #define SPDK_CONFIG_VTUNE_DIR 00:06:32.418 #define SPDK_CONFIG_WERROR 1 00:06:32.418 #define SPDK_CONFIG_WPDK_DIR 00:06:32.418 #undef SPDK_CONFIG_XNVME 00:06:32.418 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:32.418 20:12:04 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:32.418 20:12:04 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:32.418 20:12:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:32.418 20:12:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:32.418 20:12:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:32.418 20:12:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.418 20:12:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.418 20:12:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.418 20:12:04 -- paths/export.sh@5 -- # export PATH 00:06:32.418 20:12:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.418 20:12:04 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:32.418 20:12:04 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:32.418 20:12:04 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:32.418 20:12:04 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:32.418 20:12:04 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:32.418 20:12:04 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:32.418 20:12:04 -- pm/common@16 -- # TEST_TAG=N/A 00:06:32.418 20:12:04 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:32.418 20:12:04 -- common/autotest_common.sh@52 -- # : 1 00:06:32.418 20:12:04 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:32.418 20:12:04 -- common/autotest_common.sh@56 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:32.418 20:12:04 -- common/autotest_common.sh@58 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:32.418 20:12:04 -- common/autotest_common.sh@60 -- # : 1 00:06:32.418 20:12:04 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:32.418 20:12:04 -- common/autotest_common.sh@62 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:32.418 20:12:04 -- common/autotest_common.sh@64 -- # : 00:06:32.418 20:12:04 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:32.418 20:12:04 -- common/autotest_common.sh@66 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:32.418 20:12:04 -- common/autotest_common.sh@68 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:32.418 20:12:04 -- common/autotest_common.sh@70 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:32.418 20:12:04 -- common/autotest_common.sh@72 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:32.418 20:12:04 -- common/autotest_common.sh@74 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:32.418 20:12:04 -- common/autotest_common.sh@76 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:32.418 20:12:04 -- common/autotest_common.sh@78 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:32.418 20:12:04 -- common/autotest_common.sh@80 -- # : 1 00:06:32.418 20:12:04 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:32.418 20:12:04 -- common/autotest_common.sh@82 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:32.418 20:12:04 -- common/autotest_common.sh@84 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:32.418 20:12:04 -- common/autotest_common.sh@86 -- # : 1 00:06:32.418 20:12:04 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:32.418 20:12:04 -- common/autotest_common.sh@88 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:32.418 20:12:04 -- common/autotest_common.sh@90 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:32.418 20:12:04 -- common/autotest_common.sh@92 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:32.418 20:12:04 -- common/autotest_common.sh@94 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:32.418 20:12:04 -- common/autotest_common.sh@96 -- # : tcp 00:06:32.418 20:12:04 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:32.418 20:12:04 -- common/autotest_common.sh@98 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:32.418 20:12:04 -- common/autotest_common.sh@100 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:32.418 20:12:04 -- common/autotest_common.sh@102 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:32.418 20:12:04 -- common/autotest_common.sh@104 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:32.418 20:12:04 -- common/autotest_common.sh@106 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:32.418 20:12:04 -- common/autotest_common.sh@108 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:32.418 20:12:04 -- common/autotest_common.sh@110 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:32.418 20:12:04 -- common/autotest_common.sh@112 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:32.418 20:12:04 -- common/autotest_common.sh@114 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:32.418 20:12:04 -- common/autotest_common.sh@116 -- # : 1 00:06:32.418 20:12:04 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:32.418 20:12:04 -- common/autotest_common.sh@118 -- # : 00:06:32.418 20:12:04 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:32.418 20:12:04 -- common/autotest_common.sh@120 -- # : 0 00:06:32.418 20:12:04 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:32.419 20:12:04 -- common/autotest_common.sh@122 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:32.419 20:12:04 -- common/autotest_common.sh@124 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:32.419 20:12:04 -- common/autotest_common.sh@126 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:32.419 20:12:04 -- common/autotest_common.sh@128 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:32.419 20:12:04 -- common/autotest_common.sh@130 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:32.419 20:12:04 -- common/autotest_common.sh@132 -- # : 00:06:32.419 20:12:04 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:32.419 20:12:04 -- common/autotest_common.sh@134 -- # : true 00:06:32.419 20:12:04 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:32.419 20:12:04 -- common/autotest_common.sh@136 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:32.419 20:12:04 -- common/autotest_common.sh@138 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:32.419 20:12:04 -- common/autotest_common.sh@140 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:32.419 20:12:04 -- common/autotest_common.sh@142 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:32.419 20:12:04 -- common/autotest_common.sh@144 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:32.419 20:12:04 -- common/autotest_common.sh@146 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:32.419 20:12:04 -- common/autotest_common.sh@148 -- # : e810 00:06:32.419 20:12:04 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:32.419 20:12:04 -- common/autotest_common.sh@150 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:32.419 20:12:04 -- common/autotest_common.sh@152 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:32.419 20:12:04 -- common/autotest_common.sh@154 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:32.419 20:12:04 -- common/autotest_common.sh@156 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:32.419 20:12:04 -- common/autotest_common.sh@158 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:32.419 20:12:04 -- common/autotest_common.sh@160 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:32.419 20:12:04 -- common/autotest_common.sh@163 -- # : 00:06:32.419 20:12:04 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:32.419 20:12:04 -- common/autotest_common.sh@165 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:32.419 20:12:04 -- common/autotest_common.sh@167 -- # : 0 00:06:32.419 20:12:04 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:32.419 20:12:04 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:32.419 20:12:04 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:32.419 20:12:04 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:32.419 20:12:04 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:32.419 20:12:04 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:32.419 20:12:04 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:32.419 20:12:04 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:32.419 20:12:04 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:32.419 20:12:04 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:32.419 20:12:04 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:32.419 20:12:04 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:32.419 20:12:04 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:32.419 20:12:04 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:32.419 20:12:04 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:32.419 20:12:04 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:32.419 20:12:04 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:32.419 20:12:04 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:32.419 20:12:04 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:32.419 20:12:04 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:32.419 20:12:04 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:32.419 20:12:04 -- common/autotest_common.sh@196 -- # cat 00:06:32.419 20:12:04 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:32.419 20:12:04 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:32.419 20:12:04 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:32.419 20:12:04 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:32.419 20:12:04 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:32.419 20:12:04 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:32.419 20:12:04 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:32.419 20:12:04 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:32.419 20:12:04 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:32.419 20:12:04 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:32.419 20:12:04 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:32.419 20:12:04 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:32.419 20:12:04 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:32.419 20:12:04 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:32.419 20:12:04 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:32.419 20:12:04 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:32.419 20:12:04 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:32.419 20:12:04 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:32.419 20:12:04 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:32.419 20:12:04 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:06:32.419 20:12:04 -- common/autotest_common.sh@249 -- # export valgrind= 00:06:32.419 20:12:04 -- common/autotest_common.sh@249 -- # valgrind= 00:06:32.419 20:12:04 -- common/autotest_common.sh@255 -- # uname -s 00:06:32.419 20:12:04 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:06:32.419 20:12:04 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:06:32.419 20:12:04 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:06:32.419 20:12:04 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:06:32.419 20:12:04 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:32.419 20:12:04 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:32.419 20:12:04 -- common/autotest_common.sh@265 -- # MAKE=make 00:06:32.419 20:12:04 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j96 00:06:32.419 20:12:04 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:06:32.419 20:12:04 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:06:32.419 20:12:04 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:32.419 20:12:04 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:06:32.419 20:12:04 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:06:32.419 20:12:04 -- common/autotest_common.sh@291 -- # for i in "$@" 00:06:32.419 20:12:04 -- common/autotest_common.sh@292 -- # case "$i" in 00:06:32.419 20:12:04 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:06:32.419 20:12:04 -- common/autotest_common.sh@309 -- # [[ -z 3254100 ]] 00:06:32.419 20:12:04 -- common/autotest_common.sh@309 -- # kill -0 3254100 00:06:32.419 20:12:04 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:06:32.419 20:12:04 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:06:32.419 20:12:04 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:06:32.420 20:12:04 -- common/autotest_common.sh@322 -- # local mount target_dir 00:06:32.420 20:12:04 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:06:32.420 20:12:04 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:06:32.420 20:12:04 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:06:32.420 20:12:04 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:06:32.420 20:12:04 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.BSB6Hp 00:06:32.420 20:12:04 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:32.420 20:12:04 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:06:32.420 20:12:04 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:06:32.420 20:12:04 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.BSB6Hp/tests/target /tmp/spdk.BSB6Hp 00:06:32.420 20:12:04 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:06:32.420 20:12:04 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:32.420 20:12:04 -- common/autotest_common.sh@318 -- # df -T 00:06:32.420 20:12:04 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:06:32.420 20:12:04 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:06:32.420 20:12:04 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # avails["$mount"]=950202368 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:06:32.420 20:12:04 -- common/autotest_common.sh@354 -- # uses["$mount"]=4334227456 00:06:32.420 20:12:04 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # avails["$mount"]=185348411392 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # sizes["$mount"]=195974283264 00:06:32.420 20:12:04 -- common/autotest_common.sh@354 -- # uses["$mount"]=10625871872 00:06:32.420 20:12:04 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # avails["$mount"]=97933623296 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # sizes["$mount"]=97987141632 00:06:32.420 20:12:04 -- common/autotest_common.sh@354 -- # uses["$mount"]=53518336 00:06:32.420 20:12:04 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # avails["$mount"]=39185477632 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # sizes["$mount"]=39194857472 00:06:32.420 20:12:04 -- common/autotest_common.sh@354 -- # uses["$mount"]=9379840 00:06:32.420 20:12:04 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # avails["$mount"]=97985310720 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # sizes["$mount"]=97987141632 00:06:32.420 20:12:04 -- common/autotest_common.sh@354 -- # uses["$mount"]=1830912 00:06:32.420 20:12:04 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # avails["$mount"]=19597422592 00:06:32.420 20:12:04 -- common/autotest_common.sh@353 -- # sizes["$mount"]=19597426688 00:06:32.420 20:12:04 -- common/autotest_common.sh@354 -- # uses["$mount"]=4096 00:06:32.420 20:12:04 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:32.420 20:12:04 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:06:32.420 * Looking for test storage... 00:06:32.420 20:12:04 -- common/autotest_common.sh@359 -- # local target_space new_size 00:06:32.420 20:12:04 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:06:32.420 20:12:04 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:32.420 20:12:04 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:32.420 20:12:04 -- common/autotest_common.sh@363 -- # mount=/ 00:06:32.420 20:12:04 -- common/autotest_common.sh@365 -- # target_space=185348411392 00:06:32.420 20:12:04 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:06:32.420 20:12:04 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:06:32.420 20:12:04 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:06:32.420 20:12:04 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:06:32.420 20:12:04 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:06:32.420 20:12:04 -- common/autotest_common.sh@372 -- # new_size=12840464384 00:06:32.420 20:12:04 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:32.420 20:12:04 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:32.420 20:12:04 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:32.420 20:12:04 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:32.420 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:32.420 20:12:04 -- common/autotest_common.sh@380 -- # return 0 00:06:32.420 20:12:04 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:06:32.420 20:12:04 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:06:32.420 20:12:04 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:32.420 20:12:04 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:32.420 20:12:04 -- common/autotest_common.sh@1672 -- # true 00:06:32.420 20:12:04 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:06:32.420 20:12:04 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:32.420 20:12:04 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:32.420 20:12:04 -- common/autotest_common.sh@27 -- # exec 00:06:32.420 20:12:04 -- common/autotest_common.sh@29 -- # exec 00:06:32.420 20:12:04 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:32.420 20:12:04 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:32.420 20:12:04 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:32.420 20:12:04 -- common/autotest_common.sh@18 -- # set -x 00:06:32.420 20:12:04 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:32.420 20:12:04 -- nvmf/common.sh@7 -- # uname -s 00:06:32.420 20:12:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:32.420 20:12:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:32.420 20:12:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:32.420 20:12:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:32.420 20:12:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:32.420 20:12:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:32.420 20:12:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:32.420 20:12:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:32.420 20:12:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:32.420 20:12:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:32.420 20:12:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:06:32.420 20:12:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:06:32.420 20:12:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:32.420 20:12:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:32.420 20:12:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:32.420 20:12:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:32.420 20:12:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:32.420 20:12:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:32.420 20:12:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:32.420 20:12:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.420 20:12:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.420 20:12:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.420 20:12:04 -- paths/export.sh@5 -- # export PATH 00:06:32.421 20:12:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.421 20:12:04 -- nvmf/common.sh@46 -- # : 0 00:06:32.421 20:12:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:32.421 20:12:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:32.421 20:12:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:32.421 20:12:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:32.421 20:12:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:32.421 20:12:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:32.421 20:12:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:32.421 20:12:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:32.421 20:12:04 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:32.421 20:12:04 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:32.421 20:12:04 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:32.421 20:12:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:32.421 20:12:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:32.421 20:12:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:32.421 20:12:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:32.421 20:12:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:32.421 20:12:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:32.421 20:12:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:32.421 20:12:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:32.421 20:12:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:32.421 20:12:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:32.421 20:12:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:32.421 20:12:04 -- common/autotest_common.sh@10 -- # set +x 00:06:37.683 20:12:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:37.683 20:12:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:37.683 20:12:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:37.683 20:12:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:37.683 20:12:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:37.683 20:12:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:37.683 20:12:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:37.683 20:12:09 -- nvmf/common.sh@294 -- # net_devs=() 00:06:37.683 20:12:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:37.683 20:12:09 -- nvmf/common.sh@295 -- # e810=() 00:06:37.683 20:12:09 -- nvmf/common.sh@295 -- # local -ga e810 00:06:37.683 20:12:09 -- nvmf/common.sh@296 -- # x722=() 00:06:37.683 20:12:09 -- nvmf/common.sh@296 -- # local -ga x722 00:06:37.683 20:12:09 -- nvmf/common.sh@297 -- # mlx=() 00:06:37.683 20:12:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:37.683 20:12:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:37.683 20:12:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:37.683 20:12:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:37.683 20:12:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:37.683 20:12:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:37.683 20:12:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:06:37.683 Found 0000:86:00.0 (0x8086 - 0x159b) 00:06:37.683 20:12:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:37.683 20:12:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:06:37.683 Found 0000:86:00.1 (0x8086 - 0x159b) 00:06:37.683 20:12:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:37.683 20:12:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:37.683 20:12:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:37.683 20:12:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:37.683 20:12:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:37.683 20:12:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:06:37.683 Found net devices under 0000:86:00.0: cvl_0_0 00:06:37.683 20:12:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:37.683 20:12:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:37.683 20:12:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:37.683 20:12:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:37.683 20:12:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:37.683 20:12:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:06:37.683 Found net devices under 0000:86:00.1: cvl_0_1 00:06:37.683 20:12:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:37.683 20:12:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:37.683 20:12:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:37.683 20:12:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:37.683 20:12:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:37.683 20:12:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:37.683 20:12:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:37.683 20:12:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:37.683 20:12:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:37.683 20:12:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:37.683 20:12:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:37.683 20:12:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:37.683 20:12:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:37.683 20:12:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:37.683 20:12:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:37.683 20:12:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:37.683 20:12:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:37.683 20:12:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:37.683 20:12:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:37.683 20:12:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:37.683 20:12:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:37.683 20:12:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:37.942 20:12:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:37.942 20:12:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:37.942 20:12:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:37.942 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:37.942 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.190 ms 00:06:37.942 00:06:37.942 --- 10.0.0.2 ping statistics --- 00:06:37.942 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:37.942 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:06:37.942 20:12:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:37.942 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:37.942 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.279 ms 00:06:37.942 00:06:37.942 --- 10.0.0.1 ping statistics --- 00:06:37.942 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:37.942 rtt min/avg/max/mdev = 0.279/0.279/0.279/0.000 ms 00:06:37.942 20:12:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:37.942 20:12:09 -- nvmf/common.sh@410 -- # return 0 00:06:37.942 20:12:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:37.942 20:12:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:37.942 20:12:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:37.942 20:12:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:37.942 20:12:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:37.942 20:12:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:37.942 20:12:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:37.942 20:12:09 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:37.942 20:12:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:37.942 20:12:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:37.942 20:12:09 -- common/autotest_common.sh@10 -- # set +x 00:06:37.942 ************************************ 00:06:37.942 START TEST nvmf_filesystem_no_in_capsule 00:06:37.942 ************************************ 00:06:37.942 20:12:09 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:06:37.942 20:12:09 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:37.942 20:12:09 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:37.942 20:12:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:37.942 20:12:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:37.942 20:12:09 -- common/autotest_common.sh@10 -- # set +x 00:06:37.942 20:12:09 -- nvmf/common.sh@469 -- # nvmfpid=3257442 00:06:37.942 20:12:09 -- nvmf/common.sh@470 -- # waitforlisten 3257442 00:06:37.942 20:12:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:37.942 20:12:09 -- common/autotest_common.sh@819 -- # '[' -z 3257442 ']' 00:06:37.942 20:12:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.942 20:12:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:37.942 20:12:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.942 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.942 20:12:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:37.942 20:12:09 -- common/autotest_common.sh@10 -- # set +x 00:06:37.942 [2024-07-22 20:12:09.760354] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:37.942 [2024-07-22 20:12:09.760395] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:37.942 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.942 [2024-07-22 20:12:09.815796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:38.201 [2024-07-22 20:12:09.899009] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:38.201 [2024-07-22 20:12:09.899124] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:38.201 [2024-07-22 20:12:09.899132] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:38.201 [2024-07-22 20:12:09.899139] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:38.201 [2024-07-22 20:12:09.899193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:38.201 [2024-07-22 20:12:09.899288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:38.201 [2024-07-22 20:12:09.899315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:38.201 [2024-07-22 20:12:09.899316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.767 20:12:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:38.767 20:12:10 -- common/autotest_common.sh@852 -- # return 0 00:06:38.767 20:12:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:38.767 20:12:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:38.767 20:12:10 -- common/autotest_common.sh@10 -- # set +x 00:06:38.767 20:12:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:38.767 20:12:10 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:38.767 20:12:10 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:38.767 20:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:38.767 20:12:10 -- common/autotest_common.sh@10 -- # set +x 00:06:38.767 [2024-07-22 20:12:10.605321] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:38.767 20:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:38.767 20:12:10 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:38.767 20:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:38.767 20:12:10 -- common/autotest_common.sh@10 -- # set +x 00:06:39.081 Malloc1 00:06:39.081 20:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:39.081 20:12:10 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:39.081 20:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:39.081 20:12:10 -- common/autotest_common.sh@10 -- # set +x 00:06:39.081 20:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:39.081 20:12:10 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:39.081 20:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:39.081 20:12:10 -- common/autotest_common.sh@10 -- # set +x 00:06:39.081 20:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:39.081 20:12:10 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:39.081 20:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:39.081 20:12:10 -- common/autotest_common.sh@10 -- # set +x 00:06:39.081 [2024-07-22 20:12:10.754365] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:39.081 20:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:39.081 20:12:10 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:39.081 20:12:10 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:06:39.081 20:12:10 -- common/autotest_common.sh@1358 -- # local bdev_info 00:06:39.081 20:12:10 -- common/autotest_common.sh@1359 -- # local bs 00:06:39.081 20:12:10 -- common/autotest_common.sh@1360 -- # local nb 00:06:39.081 20:12:10 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:39.081 20:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:39.081 20:12:10 -- common/autotest_common.sh@10 -- # set +x 00:06:39.081 20:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:39.081 20:12:10 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:06:39.081 { 00:06:39.081 "name": "Malloc1", 00:06:39.081 "aliases": [ 00:06:39.081 "8be11a36-cf66-4b5c-a694-df2cfd1f9f9f" 00:06:39.081 ], 00:06:39.081 "product_name": "Malloc disk", 00:06:39.081 "block_size": 512, 00:06:39.081 "num_blocks": 1048576, 00:06:39.081 "uuid": "8be11a36-cf66-4b5c-a694-df2cfd1f9f9f", 00:06:39.081 "assigned_rate_limits": { 00:06:39.081 "rw_ios_per_sec": 0, 00:06:39.081 "rw_mbytes_per_sec": 0, 00:06:39.081 "r_mbytes_per_sec": 0, 00:06:39.081 "w_mbytes_per_sec": 0 00:06:39.081 }, 00:06:39.081 "claimed": true, 00:06:39.081 "claim_type": "exclusive_write", 00:06:39.081 "zoned": false, 00:06:39.081 "supported_io_types": { 00:06:39.081 "read": true, 00:06:39.081 "write": true, 00:06:39.081 "unmap": true, 00:06:39.081 "write_zeroes": true, 00:06:39.081 "flush": true, 00:06:39.081 "reset": true, 00:06:39.081 "compare": false, 00:06:39.081 "compare_and_write": false, 00:06:39.081 "abort": true, 00:06:39.081 "nvme_admin": false, 00:06:39.081 "nvme_io": false 00:06:39.081 }, 00:06:39.081 "memory_domains": [ 00:06:39.081 { 00:06:39.081 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:39.081 "dma_device_type": 2 00:06:39.081 } 00:06:39.081 ], 00:06:39.081 "driver_specific": {} 00:06:39.081 } 00:06:39.081 ]' 00:06:39.081 20:12:10 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:06:39.081 20:12:10 -- common/autotest_common.sh@1362 -- # bs=512 00:06:39.081 20:12:10 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:06:39.081 20:12:10 -- common/autotest_common.sh@1363 -- # nb=1048576 00:06:39.081 20:12:10 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:06:39.081 20:12:10 -- common/autotest_common.sh@1367 -- # echo 512 00:06:39.081 20:12:10 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:39.081 20:12:10 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:40.014 20:12:11 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:40.014 20:12:11 -- common/autotest_common.sh@1177 -- # local i=0 00:06:40.014 20:12:11 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:06:40.014 20:12:11 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:06:40.014 20:12:11 -- common/autotest_common.sh@1184 -- # sleep 2 00:06:42.540 20:12:13 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:06:42.540 20:12:13 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:06:42.540 20:12:13 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:06:42.540 20:12:13 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:06:42.540 20:12:13 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:06:42.540 20:12:13 -- common/autotest_common.sh@1187 -- # return 0 00:06:42.540 20:12:13 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:42.540 20:12:13 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:42.540 20:12:13 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:42.540 20:12:13 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:42.540 20:12:13 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:42.540 20:12:13 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:42.540 20:12:13 -- setup/common.sh@80 -- # echo 536870912 00:06:42.540 20:12:13 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:42.540 20:12:13 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:42.540 20:12:13 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:42.540 20:12:13 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:42.541 20:12:14 -- target/filesystem.sh@69 -- # partprobe 00:06:42.541 20:12:14 -- target/filesystem.sh@70 -- # sleep 1 00:06:43.473 20:12:15 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:43.473 20:12:15 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:43.473 20:12:15 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:43.473 20:12:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:43.473 20:12:15 -- common/autotest_common.sh@10 -- # set +x 00:06:43.473 ************************************ 00:06:43.473 START TEST filesystem_ext4 00:06:43.473 ************************************ 00:06:43.473 20:12:15 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:43.473 20:12:15 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:43.474 20:12:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:43.474 20:12:15 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:43.474 20:12:15 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:06:43.474 20:12:15 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:43.474 20:12:15 -- common/autotest_common.sh@904 -- # local i=0 00:06:43.474 20:12:15 -- common/autotest_common.sh@905 -- # local force 00:06:43.474 20:12:15 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:06:43.474 20:12:15 -- common/autotest_common.sh@908 -- # force=-F 00:06:43.474 20:12:15 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:43.474 mke2fs 1.46.5 (30-Dec-2021) 00:06:43.474 Discarding device blocks: 0/522240 done 00:06:43.474 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:43.474 Filesystem UUID: 4bbb0bfb-0db2-4150-8a48-66a17c4ba965 00:06:43.474 Superblock backups stored on blocks: 00:06:43.474 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:43.474 00:06:43.474 Allocating group tables: 0/64 done 00:06:43.474 Writing inode tables: 0/64 done 00:06:46.755 Creating journal (8192 blocks): done 00:06:46.755 Writing superblocks and filesystem accounting information: 0/64 done 00:06:46.755 00:06:46.755 20:12:18 -- common/autotest_common.sh@921 -- # return 0 00:06:46.755 20:12:18 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:46.755 20:12:18 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:46.755 20:12:18 -- target/filesystem.sh@25 -- # sync 00:06:46.755 20:12:18 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:46.755 20:12:18 -- target/filesystem.sh@27 -- # sync 00:06:46.755 20:12:18 -- target/filesystem.sh@29 -- # i=0 00:06:46.755 20:12:18 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:46.755 20:12:18 -- target/filesystem.sh@37 -- # kill -0 3257442 00:06:46.755 20:12:18 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:46.755 20:12:18 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:46.756 20:12:18 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:46.756 20:12:18 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:46.756 00:06:46.756 real 0m3.115s 00:06:46.756 user 0m0.023s 00:06:46.756 sys 0m0.046s 00:06:46.756 20:12:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:46.756 20:12:18 -- common/autotest_common.sh@10 -- # set +x 00:06:46.756 ************************************ 00:06:46.756 END TEST filesystem_ext4 00:06:46.756 ************************************ 00:06:46.756 20:12:18 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:46.756 20:12:18 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:46.756 20:12:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:46.756 20:12:18 -- common/autotest_common.sh@10 -- # set +x 00:06:46.756 ************************************ 00:06:46.756 START TEST filesystem_btrfs 00:06:46.756 ************************************ 00:06:46.756 20:12:18 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:46.756 20:12:18 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:46.756 20:12:18 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:46.756 20:12:18 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:46.756 20:12:18 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:06:46.756 20:12:18 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:46.756 20:12:18 -- common/autotest_common.sh@904 -- # local i=0 00:06:46.756 20:12:18 -- common/autotest_common.sh@905 -- # local force 00:06:46.756 20:12:18 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:06:46.756 20:12:18 -- common/autotest_common.sh@910 -- # force=-f 00:06:46.756 20:12:18 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:46.756 btrfs-progs v6.6.2 00:06:46.756 See https://btrfs.readthedocs.io for more information. 00:06:46.756 00:06:46.756 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:46.756 NOTE: several default settings have changed in version 5.15, please make sure 00:06:46.756 this does not affect your deployments: 00:06:46.756 - DUP for metadata (-m dup) 00:06:46.756 - enabled no-holes (-O no-holes) 00:06:46.756 - enabled free-space-tree (-R free-space-tree) 00:06:46.756 00:06:46.756 Label: (null) 00:06:46.756 UUID: 57730ae3-3eb2-43a9-aa2e-96913963ea62 00:06:46.756 Node size: 16384 00:06:46.756 Sector size: 4096 00:06:46.756 Filesystem size: 510.00MiB 00:06:46.756 Block group profiles: 00:06:46.756 Data: single 8.00MiB 00:06:46.756 Metadata: DUP 32.00MiB 00:06:46.756 System: DUP 8.00MiB 00:06:46.756 SSD detected: yes 00:06:46.756 Zoned device: no 00:06:46.756 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:46.756 Runtime features: free-space-tree 00:06:46.756 Checksum: crc32c 00:06:46.756 Number of devices: 1 00:06:46.756 Devices: 00:06:46.756 ID SIZE PATH 00:06:46.756 1 510.00MiB /dev/nvme0n1p1 00:06:46.756 00:06:46.756 20:12:18 -- common/autotest_common.sh@921 -- # return 0 00:06:46.756 20:12:18 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:47.691 20:12:19 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:47.691 20:12:19 -- target/filesystem.sh@25 -- # sync 00:06:47.691 20:12:19 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:47.691 20:12:19 -- target/filesystem.sh@27 -- # sync 00:06:47.691 20:12:19 -- target/filesystem.sh@29 -- # i=0 00:06:47.691 20:12:19 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:47.691 20:12:19 -- target/filesystem.sh@37 -- # kill -0 3257442 00:06:47.691 20:12:19 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:47.691 20:12:19 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:47.691 20:12:19 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:47.691 20:12:19 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:47.691 00:06:47.691 real 0m1.214s 00:06:47.691 user 0m0.016s 00:06:47.691 sys 0m0.064s 00:06:47.691 20:12:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:47.691 20:12:19 -- common/autotest_common.sh@10 -- # set +x 00:06:47.691 ************************************ 00:06:47.691 END TEST filesystem_btrfs 00:06:47.691 ************************************ 00:06:47.691 20:12:19 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:47.691 20:12:19 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:47.691 20:12:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:47.691 20:12:19 -- common/autotest_common.sh@10 -- # set +x 00:06:47.950 ************************************ 00:06:47.950 START TEST filesystem_xfs 00:06:47.950 ************************************ 00:06:47.950 20:12:19 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:06:47.950 20:12:19 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:47.950 20:12:19 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:47.950 20:12:19 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:47.950 20:12:19 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:06:47.950 20:12:19 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:47.950 20:12:19 -- common/autotest_common.sh@904 -- # local i=0 00:06:47.950 20:12:19 -- common/autotest_common.sh@905 -- # local force 00:06:47.950 20:12:19 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:06:47.950 20:12:19 -- common/autotest_common.sh@910 -- # force=-f 00:06:47.950 20:12:19 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:47.950 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:47.950 = sectsz=512 attr=2, projid32bit=1 00:06:47.950 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:47.950 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:47.950 data = bsize=4096 blocks=130560, imaxpct=25 00:06:47.950 = sunit=0 swidth=0 blks 00:06:47.950 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:47.950 log =internal log bsize=4096 blocks=16384, version=2 00:06:47.950 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:47.950 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:48.883 Discarding blocks...Done. 00:06:48.883 20:12:20 -- common/autotest_common.sh@921 -- # return 0 00:06:48.883 20:12:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:50.784 20:12:22 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:50.784 20:12:22 -- target/filesystem.sh@25 -- # sync 00:06:50.784 20:12:22 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:50.784 20:12:22 -- target/filesystem.sh@27 -- # sync 00:06:50.784 20:12:22 -- target/filesystem.sh@29 -- # i=0 00:06:50.784 20:12:22 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:50.784 20:12:22 -- target/filesystem.sh@37 -- # kill -0 3257442 00:06:50.784 20:12:22 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:50.784 20:12:22 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:50.784 20:12:22 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:50.784 20:12:22 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:50.784 00:06:50.784 real 0m3.031s 00:06:50.784 user 0m0.020s 00:06:50.784 sys 0m0.051s 00:06:50.784 20:12:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:50.784 20:12:22 -- common/autotest_common.sh@10 -- # set +x 00:06:50.784 ************************************ 00:06:50.784 END TEST filesystem_xfs 00:06:50.784 ************************************ 00:06:50.784 20:12:22 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:51.043 20:12:22 -- target/filesystem.sh@93 -- # sync 00:06:51.043 20:12:22 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:51.043 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:51.043 20:12:22 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:51.043 20:12:22 -- common/autotest_common.sh@1198 -- # local i=0 00:06:51.043 20:12:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:06:51.043 20:12:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:51.043 20:12:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:06:51.043 20:12:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:51.043 20:12:22 -- common/autotest_common.sh@1210 -- # return 0 00:06:51.043 20:12:22 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:51.043 20:12:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:51.043 20:12:22 -- common/autotest_common.sh@10 -- # set +x 00:06:51.043 20:12:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:51.043 20:12:22 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:51.043 20:12:22 -- target/filesystem.sh@101 -- # killprocess 3257442 00:06:51.043 20:12:22 -- common/autotest_common.sh@926 -- # '[' -z 3257442 ']' 00:06:51.043 20:12:22 -- common/autotest_common.sh@930 -- # kill -0 3257442 00:06:51.043 20:12:22 -- common/autotest_common.sh@931 -- # uname 00:06:51.043 20:12:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:51.043 20:12:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3257442 00:06:51.043 20:12:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:51.043 20:12:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:51.043 20:12:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3257442' 00:06:51.043 killing process with pid 3257442 00:06:51.043 20:12:22 -- common/autotest_common.sh@945 -- # kill 3257442 00:06:51.043 20:12:22 -- common/autotest_common.sh@950 -- # wait 3257442 00:06:51.612 20:12:23 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:51.612 00:06:51.612 real 0m13.603s 00:06:51.612 user 0m53.304s 00:06:51.612 sys 0m1.079s 00:06:51.612 20:12:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:51.612 20:12:23 -- common/autotest_common.sh@10 -- # set +x 00:06:51.612 ************************************ 00:06:51.612 END TEST nvmf_filesystem_no_in_capsule 00:06:51.612 ************************************ 00:06:51.612 20:12:23 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:51.612 20:12:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:51.612 20:12:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:51.612 20:12:23 -- common/autotest_common.sh@10 -- # set +x 00:06:51.612 ************************************ 00:06:51.612 START TEST nvmf_filesystem_in_capsule 00:06:51.612 ************************************ 00:06:51.612 20:12:23 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:06:51.612 20:12:23 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:51.612 20:12:23 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:51.612 20:12:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:51.612 20:12:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:51.612 20:12:23 -- common/autotest_common.sh@10 -- # set +x 00:06:51.612 20:12:23 -- nvmf/common.sh@469 -- # nvmfpid=3260090 00:06:51.612 20:12:23 -- nvmf/common.sh@470 -- # waitforlisten 3260090 00:06:51.612 20:12:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:51.612 20:12:23 -- common/autotest_common.sh@819 -- # '[' -z 3260090 ']' 00:06:51.612 20:12:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:51.612 20:12:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:51.612 20:12:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:51.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:51.612 20:12:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:51.612 20:12:23 -- common/autotest_common.sh@10 -- # set +x 00:06:51.612 [2024-07-22 20:12:23.402942] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:06:51.612 [2024-07-22 20:12:23.402987] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:51.612 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.612 [2024-07-22 20:12:23.459822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:51.612 [2024-07-22 20:12:23.537612] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:51.612 [2024-07-22 20:12:23.537723] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:51.612 [2024-07-22 20:12:23.537730] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:51.612 [2024-07-22 20:12:23.537736] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:51.612 [2024-07-22 20:12:23.537784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:51.612 [2024-07-22 20:12:23.537882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:51.612 [2024-07-22 20:12:23.537906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:51.612 [2024-07-22 20:12:23.537907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.555 20:12:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:52.555 20:12:24 -- common/autotest_common.sh@852 -- # return 0 00:06:52.555 20:12:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:52.555 20:12:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:52.555 20:12:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.555 20:12:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:52.555 20:12:24 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:52.555 20:12:24 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:52.555 20:12:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.555 20:12:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.555 [2024-07-22 20:12:24.257389] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:52.555 20:12:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.555 20:12:24 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:52.555 20:12:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.555 20:12:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.555 Malloc1 00:06:52.555 20:12:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.555 20:12:24 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:52.555 20:12:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.555 20:12:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.555 20:12:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.555 20:12:24 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:52.555 20:12:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.555 20:12:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.555 20:12:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.555 20:12:24 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:52.555 20:12:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.555 20:12:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.555 [2024-07-22 20:12:24.399980] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:52.555 20:12:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.555 20:12:24 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:52.555 20:12:24 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:06:52.555 20:12:24 -- common/autotest_common.sh@1358 -- # local bdev_info 00:06:52.555 20:12:24 -- common/autotest_common.sh@1359 -- # local bs 00:06:52.555 20:12:24 -- common/autotest_common.sh@1360 -- # local nb 00:06:52.555 20:12:24 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:52.555 20:12:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:52.555 20:12:24 -- common/autotest_common.sh@10 -- # set +x 00:06:52.555 20:12:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:52.555 20:12:24 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:06:52.555 { 00:06:52.555 "name": "Malloc1", 00:06:52.555 "aliases": [ 00:06:52.555 "33951248-c7f5-4a5d-a57f-91fce91d5671" 00:06:52.555 ], 00:06:52.555 "product_name": "Malloc disk", 00:06:52.555 "block_size": 512, 00:06:52.555 "num_blocks": 1048576, 00:06:52.555 "uuid": "33951248-c7f5-4a5d-a57f-91fce91d5671", 00:06:52.555 "assigned_rate_limits": { 00:06:52.555 "rw_ios_per_sec": 0, 00:06:52.555 "rw_mbytes_per_sec": 0, 00:06:52.555 "r_mbytes_per_sec": 0, 00:06:52.555 "w_mbytes_per_sec": 0 00:06:52.555 }, 00:06:52.555 "claimed": true, 00:06:52.555 "claim_type": "exclusive_write", 00:06:52.555 "zoned": false, 00:06:52.555 "supported_io_types": { 00:06:52.555 "read": true, 00:06:52.555 "write": true, 00:06:52.555 "unmap": true, 00:06:52.555 "write_zeroes": true, 00:06:52.555 "flush": true, 00:06:52.555 "reset": true, 00:06:52.555 "compare": false, 00:06:52.555 "compare_and_write": false, 00:06:52.555 "abort": true, 00:06:52.555 "nvme_admin": false, 00:06:52.555 "nvme_io": false 00:06:52.555 }, 00:06:52.555 "memory_domains": [ 00:06:52.555 { 00:06:52.555 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:52.555 "dma_device_type": 2 00:06:52.555 } 00:06:52.555 ], 00:06:52.555 "driver_specific": {} 00:06:52.555 } 00:06:52.555 ]' 00:06:52.555 20:12:24 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:06:52.555 20:12:24 -- common/autotest_common.sh@1362 -- # bs=512 00:06:52.555 20:12:24 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:06:52.813 20:12:24 -- common/autotest_common.sh@1363 -- # nb=1048576 00:06:52.813 20:12:24 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:06:52.813 20:12:24 -- common/autotest_common.sh@1367 -- # echo 512 00:06:52.813 20:12:24 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:52.813 20:12:24 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:53.747 20:12:25 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:53.747 20:12:25 -- common/autotest_common.sh@1177 -- # local i=0 00:06:53.747 20:12:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:06:53.747 20:12:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:06:53.747 20:12:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:06:56.276 20:12:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:06:56.277 20:12:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:06:56.277 20:12:27 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:06:56.277 20:12:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:06:56.277 20:12:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:06:56.277 20:12:27 -- common/autotest_common.sh@1187 -- # return 0 00:06:56.277 20:12:27 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:56.277 20:12:27 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:56.277 20:12:27 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:56.277 20:12:27 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:56.277 20:12:27 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:56.277 20:12:27 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:56.277 20:12:27 -- setup/common.sh@80 -- # echo 536870912 00:06:56.277 20:12:27 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:56.277 20:12:27 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:56.277 20:12:27 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:56.277 20:12:27 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:56.277 20:12:27 -- target/filesystem.sh@69 -- # partprobe 00:06:56.277 20:12:28 -- target/filesystem.sh@70 -- # sleep 1 00:06:57.212 20:12:29 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:57.212 20:12:29 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:57.212 20:12:29 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:57.212 20:12:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:57.212 20:12:29 -- common/autotest_common.sh@10 -- # set +x 00:06:57.212 ************************************ 00:06:57.212 START TEST filesystem_in_capsule_ext4 00:06:57.212 ************************************ 00:06:57.212 20:12:29 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:57.212 20:12:29 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:57.212 20:12:29 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:57.212 20:12:29 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:57.212 20:12:29 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:06:57.212 20:12:29 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:57.212 20:12:29 -- common/autotest_common.sh@904 -- # local i=0 00:06:57.212 20:12:29 -- common/autotest_common.sh@905 -- # local force 00:06:57.212 20:12:29 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:06:57.212 20:12:29 -- common/autotest_common.sh@908 -- # force=-F 00:06:57.212 20:12:29 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:57.212 mke2fs 1.46.5 (30-Dec-2021) 00:06:57.470 Discarding device blocks: 0/522240 done 00:06:57.470 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:57.470 Filesystem UUID: f2067933-0b56-4c8e-a997-3ac7b965b4e5 00:06:57.470 Superblock backups stored on blocks: 00:06:57.470 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:57.470 00:06:57.470 Allocating group tables: 0/64 done 00:06:57.470 Writing inode tables: 0/64 done 00:06:57.470 Creating journal (8192 blocks): done 00:06:58.551 Writing superblocks and filesystem accounting information: 0/6410/64 done 00:06:58.551 00:06:58.551 20:12:30 -- common/autotest_common.sh@921 -- # return 0 00:06:58.551 20:12:30 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:59.484 20:12:31 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:59.484 20:12:31 -- target/filesystem.sh@25 -- # sync 00:06:59.484 20:12:31 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:59.484 20:12:31 -- target/filesystem.sh@27 -- # sync 00:06:59.484 20:12:31 -- target/filesystem.sh@29 -- # i=0 00:06:59.484 20:12:31 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:59.485 20:12:31 -- target/filesystem.sh@37 -- # kill -0 3260090 00:06:59.485 20:12:31 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:59.485 20:12:31 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:59.485 20:12:31 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:59.485 20:12:31 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:59.485 00:06:59.485 real 0m2.171s 00:06:59.485 user 0m0.022s 00:06:59.485 sys 0m0.047s 00:06:59.485 20:12:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:59.485 20:12:31 -- common/autotest_common.sh@10 -- # set +x 00:06:59.485 ************************************ 00:06:59.485 END TEST filesystem_in_capsule_ext4 00:06:59.485 ************************************ 00:06:59.485 20:12:31 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:59.485 20:12:31 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:59.485 20:12:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:59.485 20:12:31 -- common/autotest_common.sh@10 -- # set +x 00:06:59.485 ************************************ 00:06:59.485 START TEST filesystem_in_capsule_btrfs 00:06:59.485 ************************************ 00:06:59.485 20:12:31 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:59.485 20:12:31 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:59.485 20:12:31 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:59.485 20:12:31 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:59.485 20:12:31 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:06:59.485 20:12:31 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:59.485 20:12:31 -- common/autotest_common.sh@904 -- # local i=0 00:06:59.485 20:12:31 -- common/autotest_common.sh@905 -- # local force 00:06:59.485 20:12:31 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:06:59.485 20:12:31 -- common/autotest_common.sh@910 -- # force=-f 00:06:59.485 20:12:31 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:59.743 btrfs-progs v6.6.2 00:06:59.743 See https://btrfs.readthedocs.io for more information. 00:06:59.743 00:06:59.743 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:59.743 NOTE: several default settings have changed in version 5.15, please make sure 00:06:59.743 this does not affect your deployments: 00:06:59.743 - DUP for metadata (-m dup) 00:06:59.743 - enabled no-holes (-O no-holes) 00:06:59.743 - enabled free-space-tree (-R free-space-tree) 00:06:59.743 00:06:59.743 Label: (null) 00:06:59.743 UUID: 8f0b8874-36c1-461d-9930-d95571979a5e 00:06:59.743 Node size: 16384 00:06:59.743 Sector size: 4096 00:06:59.743 Filesystem size: 510.00MiB 00:06:59.743 Block group profiles: 00:06:59.743 Data: single 8.00MiB 00:06:59.743 Metadata: DUP 32.00MiB 00:06:59.743 System: DUP 8.00MiB 00:06:59.743 SSD detected: yes 00:06:59.743 Zoned device: no 00:06:59.743 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:59.743 Runtime features: free-space-tree 00:06:59.743 Checksum: crc32c 00:06:59.743 Number of devices: 1 00:06:59.743 Devices: 00:06:59.743 ID SIZE PATH 00:06:59.743 1 510.00MiB /dev/nvme0n1p1 00:06:59.743 00:06:59.743 20:12:31 -- common/autotest_common.sh@921 -- # return 0 00:06:59.743 20:12:31 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:00.677 20:12:32 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:00.677 20:12:32 -- target/filesystem.sh@25 -- # sync 00:07:00.677 20:12:32 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:00.677 20:12:32 -- target/filesystem.sh@27 -- # sync 00:07:00.677 20:12:32 -- target/filesystem.sh@29 -- # i=0 00:07:00.677 20:12:32 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:00.677 20:12:32 -- target/filesystem.sh@37 -- # kill -0 3260090 00:07:00.677 20:12:32 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:00.677 20:12:32 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:00.677 20:12:32 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:00.677 20:12:32 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:00.677 00:07:00.677 real 0m1.202s 00:07:00.677 user 0m0.024s 00:07:00.677 sys 0m0.057s 00:07:00.677 20:12:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:00.677 20:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:00.677 ************************************ 00:07:00.677 END TEST filesystem_in_capsule_btrfs 00:07:00.677 ************************************ 00:07:00.677 20:12:32 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:00.677 20:12:32 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:00.677 20:12:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:00.677 20:12:32 -- common/autotest_common.sh@10 -- # set +x 00:07:00.677 ************************************ 00:07:00.677 START TEST filesystem_in_capsule_xfs 00:07:00.677 ************************************ 00:07:00.677 20:12:32 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:07:00.677 20:12:32 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:00.677 20:12:32 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:00.677 20:12:32 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:00.677 20:12:32 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:07:00.677 20:12:32 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:00.677 20:12:32 -- common/autotest_common.sh@904 -- # local i=0 00:07:00.677 20:12:32 -- common/autotest_common.sh@905 -- # local force 00:07:00.677 20:12:32 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:07:00.677 20:12:32 -- common/autotest_common.sh@910 -- # force=-f 00:07:00.677 20:12:32 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:00.935 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:00.935 = sectsz=512 attr=2, projid32bit=1 00:07:00.935 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:00.935 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:00.935 data = bsize=4096 blocks=130560, imaxpct=25 00:07:00.935 = sunit=0 swidth=0 blks 00:07:00.935 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:00.935 log =internal log bsize=4096 blocks=16384, version=2 00:07:00.935 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:00.935 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:01.501 Discarding blocks...Done. 00:07:01.501 20:12:33 -- common/autotest_common.sh@921 -- # return 0 00:07:01.501 20:12:33 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:03.401 20:12:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:03.401 20:12:35 -- target/filesystem.sh@25 -- # sync 00:07:03.401 20:12:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:03.401 20:12:35 -- target/filesystem.sh@27 -- # sync 00:07:03.401 20:12:35 -- target/filesystem.sh@29 -- # i=0 00:07:03.401 20:12:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:03.401 20:12:35 -- target/filesystem.sh@37 -- # kill -0 3260090 00:07:03.401 20:12:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:03.401 20:12:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:03.401 20:12:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:03.401 20:12:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:03.401 00:07:03.401 real 0m2.697s 00:07:03.401 user 0m0.019s 00:07:03.401 sys 0m0.052s 00:07:03.401 20:12:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:03.401 20:12:35 -- common/autotest_common.sh@10 -- # set +x 00:07:03.401 ************************************ 00:07:03.401 END TEST filesystem_in_capsule_xfs 00:07:03.401 ************************************ 00:07:03.401 20:12:35 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:04.057 20:12:35 -- target/filesystem.sh@93 -- # sync 00:07:04.057 20:12:35 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:04.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:04.057 20:12:35 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:04.057 20:12:35 -- common/autotest_common.sh@1198 -- # local i=0 00:07:04.057 20:12:35 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:07:04.057 20:12:35 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:04.057 20:12:35 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:07:04.057 20:12:35 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:04.057 20:12:35 -- common/autotest_common.sh@1210 -- # return 0 00:07:04.057 20:12:35 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:04.057 20:12:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:04.057 20:12:35 -- common/autotest_common.sh@10 -- # set +x 00:07:04.057 20:12:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:04.057 20:12:35 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:04.057 20:12:35 -- target/filesystem.sh@101 -- # killprocess 3260090 00:07:04.057 20:12:35 -- common/autotest_common.sh@926 -- # '[' -z 3260090 ']' 00:07:04.057 20:12:35 -- common/autotest_common.sh@930 -- # kill -0 3260090 00:07:04.057 20:12:35 -- common/autotest_common.sh@931 -- # uname 00:07:04.057 20:12:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:04.057 20:12:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3260090 00:07:04.058 20:12:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:04.058 20:12:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:04.058 20:12:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3260090' 00:07:04.058 killing process with pid 3260090 00:07:04.058 20:12:35 -- common/autotest_common.sh@945 -- # kill 3260090 00:07:04.058 20:12:35 -- common/autotest_common.sh@950 -- # wait 3260090 00:07:04.316 20:12:36 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:04.316 00:07:04.316 real 0m12.851s 00:07:04.316 user 0m50.367s 00:07:04.316 sys 0m1.077s 00:07:04.316 20:12:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:04.316 20:12:36 -- common/autotest_common.sh@10 -- # set +x 00:07:04.316 ************************************ 00:07:04.316 END TEST nvmf_filesystem_in_capsule 00:07:04.316 ************************************ 00:07:04.316 20:12:36 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:04.316 20:12:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:04.316 20:12:36 -- nvmf/common.sh@116 -- # sync 00:07:04.316 20:12:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:04.316 20:12:36 -- nvmf/common.sh@119 -- # set +e 00:07:04.316 20:12:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:04.316 20:12:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:04.316 rmmod nvme_tcp 00:07:04.575 rmmod nvme_fabrics 00:07:04.576 rmmod nvme_keyring 00:07:04.576 20:12:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:04.576 20:12:36 -- nvmf/common.sh@123 -- # set -e 00:07:04.576 20:12:36 -- nvmf/common.sh@124 -- # return 0 00:07:04.576 20:12:36 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:04.576 20:12:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:04.576 20:12:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:04.576 20:12:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:04.576 20:12:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:04.576 20:12:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:04.576 20:12:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:04.576 20:12:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:04.576 20:12:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:06.479 20:12:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:06.479 00:07:06.479 real 0m34.277s 00:07:06.479 user 1m45.399s 00:07:06.479 sys 0m6.275s 00:07:06.479 20:12:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:06.479 20:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:06.479 ************************************ 00:07:06.479 END TEST nvmf_filesystem 00:07:06.479 ************************************ 00:07:06.479 20:12:38 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:06.479 20:12:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:06.479 20:12:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:06.479 20:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:06.479 ************************************ 00:07:06.479 START TEST nvmf_discovery 00:07:06.479 ************************************ 00:07:06.479 20:12:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:06.738 * Looking for test storage... 00:07:06.738 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:06.738 20:12:38 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:06.738 20:12:38 -- nvmf/common.sh@7 -- # uname -s 00:07:06.738 20:12:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:06.738 20:12:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:06.738 20:12:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:06.738 20:12:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:06.738 20:12:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:06.738 20:12:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:06.738 20:12:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:06.738 20:12:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:06.738 20:12:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:06.738 20:12:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:06.738 20:12:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:07:06.738 20:12:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:07:06.738 20:12:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:06.738 20:12:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:06.738 20:12:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:06.738 20:12:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:06.738 20:12:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:06.738 20:12:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:06.738 20:12:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:06.738 20:12:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:06.738 20:12:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:06.738 20:12:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:06.738 20:12:38 -- paths/export.sh@5 -- # export PATH 00:07:06.738 20:12:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:06.738 20:12:38 -- nvmf/common.sh@46 -- # : 0 00:07:06.738 20:12:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:06.738 20:12:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:06.738 20:12:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:06.738 20:12:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:06.738 20:12:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:06.738 20:12:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:06.738 20:12:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:06.738 20:12:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:06.738 20:12:38 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:06.738 20:12:38 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:06.738 20:12:38 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:06.738 20:12:38 -- target/discovery.sh@15 -- # hash nvme 00:07:06.738 20:12:38 -- target/discovery.sh@20 -- # nvmftestinit 00:07:06.738 20:12:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:06.738 20:12:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:06.738 20:12:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:06.738 20:12:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:06.738 20:12:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:06.738 20:12:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:06.738 20:12:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:06.738 20:12:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:06.738 20:12:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:06.738 20:12:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:06.738 20:12:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:06.738 20:12:38 -- common/autotest_common.sh@10 -- # set +x 00:07:12.011 20:12:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:12.011 20:12:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:12.011 20:12:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:12.011 20:12:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:12.011 20:12:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:12.011 20:12:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:12.011 20:12:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:12.011 20:12:43 -- nvmf/common.sh@294 -- # net_devs=() 00:07:12.011 20:12:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:12.011 20:12:43 -- nvmf/common.sh@295 -- # e810=() 00:07:12.011 20:12:43 -- nvmf/common.sh@295 -- # local -ga e810 00:07:12.011 20:12:43 -- nvmf/common.sh@296 -- # x722=() 00:07:12.011 20:12:43 -- nvmf/common.sh@296 -- # local -ga x722 00:07:12.011 20:12:43 -- nvmf/common.sh@297 -- # mlx=() 00:07:12.011 20:12:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:12.011 20:12:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:12.011 20:12:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:12.011 20:12:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:12.011 20:12:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:12.011 20:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:12.011 20:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:07:12.011 Found 0000:86:00.0 (0x8086 - 0x159b) 00:07:12.011 20:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:12.011 20:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:07:12.011 Found 0000:86:00.1 (0x8086 - 0x159b) 00:07:12.011 20:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:12.011 20:12:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:12.012 20:12:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:12.012 20:12:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:12.012 20:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:12.012 20:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:12.012 20:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:12.012 20:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:12.012 20:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:07:12.012 Found net devices under 0000:86:00.0: cvl_0_0 00:07:12.012 20:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:12.012 20:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:12.012 20:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:12.012 20:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:12.012 20:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:12.012 20:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:07:12.012 Found net devices under 0000:86:00.1: cvl_0_1 00:07:12.012 20:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:12.012 20:12:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:12.012 20:12:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:12.012 20:12:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:12.012 20:12:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:12.012 20:12:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:12.012 20:12:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:12.012 20:12:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:12.012 20:12:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:12.012 20:12:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:12.012 20:12:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:12.012 20:12:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:12.012 20:12:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:12.012 20:12:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:12.012 20:12:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:12.012 20:12:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:12.012 20:12:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:12.012 20:12:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:12.012 20:12:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:12.012 20:12:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:12.012 20:12:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:12.012 20:12:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:12.012 20:12:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:12.012 20:12:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:12.012 20:12:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:12.012 20:12:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:12.012 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:12.012 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.181 ms 00:07:12.012 00:07:12.012 --- 10.0.0.2 ping statistics --- 00:07:12.012 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:12.012 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:07:12.012 20:12:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:12.012 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:12.012 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.274 ms 00:07:12.012 00:07:12.012 --- 10.0.0.1 ping statistics --- 00:07:12.012 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:12.012 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:07:12.012 20:12:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:12.012 20:12:43 -- nvmf/common.sh@410 -- # return 0 00:07:12.012 20:12:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:12.012 20:12:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:12.012 20:12:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:12.012 20:12:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:12.012 20:12:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:12.012 20:12:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:12.012 20:12:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:12.012 20:12:43 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:12.012 20:12:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:12.012 20:12:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:12.012 20:12:43 -- common/autotest_common.sh@10 -- # set +x 00:07:12.012 20:12:43 -- nvmf/common.sh@469 -- # nvmfpid=3265944 00:07:12.012 20:12:43 -- nvmf/common.sh@470 -- # waitforlisten 3265944 00:07:12.012 20:12:43 -- common/autotest_common.sh@819 -- # '[' -z 3265944 ']' 00:07:12.012 20:12:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:12.012 20:12:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:12.012 20:12:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:12.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:12.012 20:12:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:12.012 20:12:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:12.012 20:12:43 -- common/autotest_common.sh@10 -- # set +x 00:07:12.012 [2024-07-22 20:12:43.720862] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:07:12.012 [2024-07-22 20:12:43.720906] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:12.012 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.012 [2024-07-22 20:12:43.777798] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:12.012 [2024-07-22 20:12:43.856099] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:12.012 [2024-07-22 20:12:43.856206] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:12.012 [2024-07-22 20:12:43.856215] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:12.012 [2024-07-22 20:12:43.856221] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:12.012 [2024-07-22 20:12:43.856266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:12.012 [2024-07-22 20:12:43.856360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:12.012 [2024-07-22 20:12:43.856377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:12.012 [2024-07-22 20:12:43.856378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.946 20:12:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:12.946 20:12:44 -- common/autotest_common.sh@852 -- # return 0 00:07:12.946 20:12:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:12.946 20:12:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:12.946 20:12:44 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 [2024-07-22 20:12:44.567366] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@26 -- # seq 1 4 00:07:12.946 20:12:44 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:12.946 20:12:44 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 Null1 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 [2024-07-22 20:12:44.612876] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:12.946 20:12:44 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 Null2 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:12.946 20:12:44 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 Null3 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:12.946 20:12:44 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 Null4 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:12.946 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.946 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:12.946 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.946 20:12:44 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 4420 00:07:13.205 00:07:13.205 Discovery Log Number of Records 6, Generation counter 6 00:07:13.205 =====Discovery Log Entry 0====== 00:07:13.205 trtype: tcp 00:07:13.205 adrfam: ipv4 00:07:13.205 subtype: current discovery subsystem 00:07:13.205 treq: not required 00:07:13.205 portid: 0 00:07:13.205 trsvcid: 4420 00:07:13.205 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:13.205 traddr: 10.0.0.2 00:07:13.205 eflags: explicit discovery connections, duplicate discovery information 00:07:13.205 sectype: none 00:07:13.205 =====Discovery Log Entry 1====== 00:07:13.205 trtype: tcp 00:07:13.205 adrfam: ipv4 00:07:13.205 subtype: nvme subsystem 00:07:13.205 treq: not required 00:07:13.205 portid: 0 00:07:13.205 trsvcid: 4420 00:07:13.205 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:13.205 traddr: 10.0.0.2 00:07:13.205 eflags: none 00:07:13.205 sectype: none 00:07:13.205 =====Discovery Log Entry 2====== 00:07:13.205 trtype: tcp 00:07:13.205 adrfam: ipv4 00:07:13.205 subtype: nvme subsystem 00:07:13.205 treq: not required 00:07:13.205 portid: 0 00:07:13.205 trsvcid: 4420 00:07:13.205 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:13.205 traddr: 10.0.0.2 00:07:13.205 eflags: none 00:07:13.205 sectype: none 00:07:13.205 =====Discovery Log Entry 3====== 00:07:13.205 trtype: tcp 00:07:13.205 adrfam: ipv4 00:07:13.205 subtype: nvme subsystem 00:07:13.205 treq: not required 00:07:13.205 portid: 0 00:07:13.205 trsvcid: 4420 00:07:13.205 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:13.205 traddr: 10.0.0.2 00:07:13.205 eflags: none 00:07:13.205 sectype: none 00:07:13.205 =====Discovery Log Entry 4====== 00:07:13.205 trtype: tcp 00:07:13.205 adrfam: ipv4 00:07:13.205 subtype: nvme subsystem 00:07:13.205 treq: not required 00:07:13.205 portid: 0 00:07:13.205 trsvcid: 4420 00:07:13.205 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:13.205 traddr: 10.0.0.2 00:07:13.205 eflags: none 00:07:13.205 sectype: none 00:07:13.205 =====Discovery Log Entry 5====== 00:07:13.205 trtype: tcp 00:07:13.205 adrfam: ipv4 00:07:13.205 subtype: discovery subsystem referral 00:07:13.205 treq: not required 00:07:13.205 portid: 0 00:07:13.205 trsvcid: 4430 00:07:13.205 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:13.205 traddr: 10.0.0.2 00:07:13.205 eflags: none 00:07:13.205 sectype: none 00:07:13.205 20:12:44 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:13.205 Perform nvmf subsystem discovery via RPC 00:07:13.205 20:12:44 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:13.205 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.205 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:13.205 [2024-07-22 20:12:44.925794] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:13.205 [ 00:07:13.205 { 00:07:13.205 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:13.205 "subtype": "Discovery", 00:07:13.205 "listen_addresses": [ 00:07:13.205 { 00:07:13.205 "transport": "TCP", 00:07:13.205 "trtype": "TCP", 00:07:13.205 "adrfam": "IPv4", 00:07:13.205 "traddr": "10.0.0.2", 00:07:13.205 "trsvcid": "4420" 00:07:13.205 } 00:07:13.205 ], 00:07:13.205 "allow_any_host": true, 00:07:13.205 "hosts": [] 00:07:13.205 }, 00:07:13.205 { 00:07:13.205 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:13.205 "subtype": "NVMe", 00:07:13.205 "listen_addresses": [ 00:07:13.205 { 00:07:13.205 "transport": "TCP", 00:07:13.205 "trtype": "TCP", 00:07:13.205 "adrfam": "IPv4", 00:07:13.205 "traddr": "10.0.0.2", 00:07:13.205 "trsvcid": "4420" 00:07:13.205 } 00:07:13.205 ], 00:07:13.205 "allow_any_host": true, 00:07:13.205 "hosts": [], 00:07:13.205 "serial_number": "SPDK00000000000001", 00:07:13.205 "model_number": "SPDK bdev Controller", 00:07:13.205 "max_namespaces": 32, 00:07:13.205 "min_cntlid": 1, 00:07:13.205 "max_cntlid": 65519, 00:07:13.205 "namespaces": [ 00:07:13.205 { 00:07:13.205 "nsid": 1, 00:07:13.205 "bdev_name": "Null1", 00:07:13.205 "name": "Null1", 00:07:13.205 "nguid": "B90446A662BF4972BD38C77CA1FB4237", 00:07:13.205 "uuid": "b90446a6-62bf-4972-bd38-c77ca1fb4237" 00:07:13.205 } 00:07:13.205 ] 00:07:13.205 }, 00:07:13.205 { 00:07:13.205 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:13.205 "subtype": "NVMe", 00:07:13.205 "listen_addresses": [ 00:07:13.205 { 00:07:13.205 "transport": "TCP", 00:07:13.205 "trtype": "TCP", 00:07:13.205 "adrfam": "IPv4", 00:07:13.205 "traddr": "10.0.0.2", 00:07:13.205 "trsvcid": "4420" 00:07:13.205 } 00:07:13.205 ], 00:07:13.205 "allow_any_host": true, 00:07:13.205 "hosts": [], 00:07:13.205 "serial_number": "SPDK00000000000002", 00:07:13.205 "model_number": "SPDK bdev Controller", 00:07:13.205 "max_namespaces": 32, 00:07:13.205 "min_cntlid": 1, 00:07:13.205 "max_cntlid": 65519, 00:07:13.205 "namespaces": [ 00:07:13.205 { 00:07:13.205 "nsid": 1, 00:07:13.205 "bdev_name": "Null2", 00:07:13.205 "name": "Null2", 00:07:13.205 "nguid": "BF456EEFF8E3432B94085A4224E55320", 00:07:13.205 "uuid": "bf456eef-f8e3-432b-9408-5a4224e55320" 00:07:13.205 } 00:07:13.205 ] 00:07:13.205 }, 00:07:13.205 { 00:07:13.205 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:13.205 "subtype": "NVMe", 00:07:13.205 "listen_addresses": [ 00:07:13.205 { 00:07:13.205 "transport": "TCP", 00:07:13.205 "trtype": "TCP", 00:07:13.205 "adrfam": "IPv4", 00:07:13.205 "traddr": "10.0.0.2", 00:07:13.205 "trsvcid": "4420" 00:07:13.205 } 00:07:13.205 ], 00:07:13.205 "allow_any_host": true, 00:07:13.205 "hosts": [], 00:07:13.205 "serial_number": "SPDK00000000000003", 00:07:13.205 "model_number": "SPDK bdev Controller", 00:07:13.205 "max_namespaces": 32, 00:07:13.205 "min_cntlid": 1, 00:07:13.205 "max_cntlid": 65519, 00:07:13.205 "namespaces": [ 00:07:13.205 { 00:07:13.205 "nsid": 1, 00:07:13.205 "bdev_name": "Null3", 00:07:13.205 "name": "Null3", 00:07:13.205 "nguid": "0D857F9E7E0A44E6A7AE5269C02BE8AB", 00:07:13.205 "uuid": "0d857f9e-7e0a-44e6-a7ae-5269c02be8ab" 00:07:13.205 } 00:07:13.205 ] 00:07:13.205 }, 00:07:13.205 { 00:07:13.205 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:13.205 "subtype": "NVMe", 00:07:13.205 "listen_addresses": [ 00:07:13.205 { 00:07:13.205 "transport": "TCP", 00:07:13.205 "trtype": "TCP", 00:07:13.205 "adrfam": "IPv4", 00:07:13.205 "traddr": "10.0.0.2", 00:07:13.205 "trsvcid": "4420" 00:07:13.205 } 00:07:13.205 ], 00:07:13.205 "allow_any_host": true, 00:07:13.205 "hosts": [], 00:07:13.205 "serial_number": "SPDK00000000000004", 00:07:13.205 "model_number": "SPDK bdev Controller", 00:07:13.205 "max_namespaces": 32, 00:07:13.205 "min_cntlid": 1, 00:07:13.205 "max_cntlid": 65519, 00:07:13.205 "namespaces": [ 00:07:13.205 { 00:07:13.205 "nsid": 1, 00:07:13.205 "bdev_name": "Null4", 00:07:13.205 "name": "Null4", 00:07:13.205 "nguid": "8794C8E2A9CD4DEFA894A50B56928EA5", 00:07:13.205 "uuid": "8794c8e2-a9cd-4def-a894-a50b56928ea5" 00:07:13.205 } 00:07:13.205 ] 00:07:13.205 } 00:07:13.205 ] 00:07:13.205 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.205 20:12:44 -- target/discovery.sh@42 -- # seq 1 4 00:07:13.205 20:12:44 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:13.205 20:12:44 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:13.205 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.205 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:13.205 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.205 20:12:44 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:13.205 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.205 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:13.205 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.205 20:12:44 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:13.205 20:12:44 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:13.205 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.205 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:13.206 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.206 20:12:44 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:13.206 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.206 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:13.206 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.206 20:12:44 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:13.206 20:12:44 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:13.206 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.206 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:13.206 20:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.206 20:12:44 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:13.206 20:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.206 20:12:44 -- common/autotest_common.sh@10 -- # set +x 00:07:13.206 20:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.206 20:12:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:13.206 20:12:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:13.206 20:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.206 20:12:45 -- common/autotest_common.sh@10 -- # set +x 00:07:13.206 20:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.206 20:12:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:13.206 20:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.206 20:12:45 -- common/autotest_common.sh@10 -- # set +x 00:07:13.206 20:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.206 20:12:45 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:13.206 20:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.206 20:12:45 -- common/autotest_common.sh@10 -- # set +x 00:07:13.206 20:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.206 20:12:45 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:13.206 20:12:45 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:13.206 20:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:13.206 20:12:45 -- common/autotest_common.sh@10 -- # set +x 00:07:13.206 20:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:13.206 20:12:45 -- target/discovery.sh@49 -- # check_bdevs= 00:07:13.206 20:12:45 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:13.206 20:12:45 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:13.206 20:12:45 -- target/discovery.sh@57 -- # nvmftestfini 00:07:13.206 20:12:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:13.206 20:12:45 -- nvmf/common.sh@116 -- # sync 00:07:13.206 20:12:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:13.206 20:12:45 -- nvmf/common.sh@119 -- # set +e 00:07:13.206 20:12:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:13.206 20:12:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:13.206 rmmod nvme_tcp 00:07:13.206 rmmod nvme_fabrics 00:07:13.206 rmmod nvme_keyring 00:07:13.206 20:12:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:13.206 20:12:45 -- nvmf/common.sh@123 -- # set -e 00:07:13.206 20:12:45 -- nvmf/common.sh@124 -- # return 0 00:07:13.206 20:12:45 -- nvmf/common.sh@477 -- # '[' -n 3265944 ']' 00:07:13.206 20:12:45 -- nvmf/common.sh@478 -- # killprocess 3265944 00:07:13.206 20:12:45 -- common/autotest_common.sh@926 -- # '[' -z 3265944 ']' 00:07:13.206 20:12:45 -- common/autotest_common.sh@930 -- # kill -0 3265944 00:07:13.206 20:12:45 -- common/autotest_common.sh@931 -- # uname 00:07:13.206 20:12:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:13.206 20:12:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3265944 00:07:13.464 20:12:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:13.464 20:12:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:13.464 20:12:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3265944' 00:07:13.464 killing process with pid 3265944 00:07:13.464 20:12:45 -- common/autotest_common.sh@945 -- # kill 3265944 00:07:13.465 [2024-07-22 20:12:45.174575] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:13.465 20:12:45 -- common/autotest_common.sh@950 -- # wait 3265944 00:07:13.465 20:12:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:13.465 20:12:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:13.465 20:12:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:13.465 20:12:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:13.465 20:12:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:13.465 20:12:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:13.465 20:12:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:13.465 20:12:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:16.002 20:12:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:16.002 00:07:16.002 real 0m9.045s 00:07:16.002 user 0m7.479s 00:07:16.002 sys 0m4.300s 00:07:16.002 20:12:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:16.002 20:12:47 -- common/autotest_common.sh@10 -- # set +x 00:07:16.002 ************************************ 00:07:16.002 END TEST nvmf_discovery 00:07:16.002 ************************************ 00:07:16.002 20:12:47 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:16.002 20:12:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:16.002 20:12:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:16.002 20:12:47 -- common/autotest_common.sh@10 -- # set +x 00:07:16.002 ************************************ 00:07:16.002 START TEST nvmf_referrals 00:07:16.002 ************************************ 00:07:16.002 20:12:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:16.002 * Looking for test storage... 00:07:16.002 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:16.002 20:12:47 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:16.002 20:12:47 -- nvmf/common.sh@7 -- # uname -s 00:07:16.002 20:12:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:16.002 20:12:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:16.002 20:12:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:16.002 20:12:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:16.002 20:12:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:16.002 20:12:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:16.002 20:12:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:16.002 20:12:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:16.002 20:12:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:16.002 20:12:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:16.002 20:12:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:07:16.002 20:12:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:07:16.002 20:12:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:16.002 20:12:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:16.002 20:12:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:16.002 20:12:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:16.002 20:12:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:16.002 20:12:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:16.002 20:12:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:16.002 20:12:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:16.002 20:12:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:16.002 20:12:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:16.002 20:12:47 -- paths/export.sh@5 -- # export PATH 00:07:16.002 20:12:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:16.002 20:12:47 -- nvmf/common.sh@46 -- # : 0 00:07:16.002 20:12:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:16.002 20:12:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:16.002 20:12:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:16.002 20:12:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:16.002 20:12:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:16.002 20:12:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:16.002 20:12:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:16.002 20:12:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:16.002 20:12:47 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:16.002 20:12:47 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:16.002 20:12:47 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:16.002 20:12:47 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:16.002 20:12:47 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:16.002 20:12:47 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:16.002 20:12:47 -- target/referrals.sh@37 -- # nvmftestinit 00:07:16.002 20:12:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:16.002 20:12:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:16.002 20:12:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:16.002 20:12:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:16.002 20:12:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:16.002 20:12:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:16.002 20:12:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:16.002 20:12:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:16.002 20:12:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:16.002 20:12:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:16.002 20:12:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:16.002 20:12:47 -- common/autotest_common.sh@10 -- # set +x 00:07:21.270 20:12:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:21.270 20:12:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:21.270 20:12:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:21.270 20:12:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:21.270 20:12:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:21.270 20:12:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:21.270 20:12:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:21.270 20:12:52 -- nvmf/common.sh@294 -- # net_devs=() 00:07:21.270 20:12:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:21.270 20:12:52 -- nvmf/common.sh@295 -- # e810=() 00:07:21.270 20:12:52 -- nvmf/common.sh@295 -- # local -ga e810 00:07:21.270 20:12:52 -- nvmf/common.sh@296 -- # x722=() 00:07:21.270 20:12:52 -- nvmf/common.sh@296 -- # local -ga x722 00:07:21.270 20:12:52 -- nvmf/common.sh@297 -- # mlx=() 00:07:21.270 20:12:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:21.270 20:12:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:21.270 20:12:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:21.270 20:12:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:21.270 20:12:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:21.270 20:12:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:21.270 20:12:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:07:21.270 Found 0000:86:00.0 (0x8086 - 0x159b) 00:07:21.270 20:12:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:21.270 20:12:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:07:21.270 Found 0000:86:00.1 (0x8086 - 0x159b) 00:07:21.270 20:12:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:21.270 20:12:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:21.270 20:12:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:21.270 20:12:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:21.270 20:12:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:21.270 20:12:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:07:21.270 Found net devices under 0000:86:00.0: cvl_0_0 00:07:21.270 20:12:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:21.270 20:12:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:21.270 20:12:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:21.270 20:12:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:21.270 20:12:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:21.270 20:12:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:07:21.270 Found net devices under 0000:86:00.1: cvl_0_1 00:07:21.270 20:12:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:21.270 20:12:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:21.270 20:12:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:21.270 20:12:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:21.270 20:12:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:21.270 20:12:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:21.270 20:12:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:21.270 20:12:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:21.270 20:12:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:21.270 20:12:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:21.271 20:12:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:21.271 20:12:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:21.271 20:12:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:21.271 20:12:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:21.271 20:12:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:21.271 20:12:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:21.271 20:12:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:21.271 20:12:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:21.271 20:12:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:21.271 20:12:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:21.271 20:12:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:21.271 20:12:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:21.271 20:12:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:21.271 20:12:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:21.271 20:12:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:21.271 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:21.271 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:07:21.271 00:07:21.271 --- 10.0.0.2 ping statistics --- 00:07:21.271 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:21.271 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:07:21.271 20:12:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:21.271 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:21.271 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.277 ms 00:07:21.271 00:07:21.271 --- 10.0.0.1 ping statistics --- 00:07:21.271 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:21.271 rtt min/avg/max/mdev = 0.277/0.277/0.277/0.000 ms 00:07:21.271 20:12:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:21.271 20:12:53 -- nvmf/common.sh@410 -- # return 0 00:07:21.271 20:12:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:21.271 20:12:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:21.271 20:12:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:21.271 20:12:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:21.271 20:12:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:21.271 20:12:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:21.271 20:12:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:21.271 20:12:53 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:21.271 20:12:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:21.271 20:12:53 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:21.271 20:12:53 -- common/autotest_common.sh@10 -- # set +x 00:07:21.271 20:12:53 -- nvmf/common.sh@469 -- # nvmfpid=3269556 00:07:21.271 20:12:53 -- nvmf/common.sh@470 -- # waitforlisten 3269556 00:07:21.271 20:12:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:21.271 20:12:53 -- common/autotest_common.sh@819 -- # '[' -z 3269556 ']' 00:07:21.271 20:12:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:21.271 20:12:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:21.271 20:12:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:21.271 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:21.271 20:12:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:21.271 20:12:53 -- common/autotest_common.sh@10 -- # set +x 00:07:21.271 [2024-07-22 20:12:53.115787] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:07:21.271 [2024-07-22 20:12:53.115833] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:21.271 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.271 [2024-07-22 20:12:53.171537] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:21.529 [2024-07-22 20:12:53.245340] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:21.530 [2024-07-22 20:12:53.245451] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:21.530 [2024-07-22 20:12:53.245458] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:21.530 [2024-07-22 20:12:53.245464] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:21.530 [2024-07-22 20:12:53.245501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:21.530 [2024-07-22 20:12:53.245600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:21.530 [2024-07-22 20:12:53.245675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:21.530 [2024-07-22 20:12:53.245676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.096 20:12:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:22.096 20:12:53 -- common/autotest_common.sh@852 -- # return 0 00:07:22.096 20:12:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:22.096 20:12:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:22.096 20:12:53 -- common/autotest_common.sh@10 -- # set +x 00:07:22.096 20:12:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:22.096 20:12:53 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:22.096 20:12:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.096 20:12:53 -- common/autotest_common.sh@10 -- # set +x 00:07:22.096 [2024-07-22 20:12:53.982454] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:22.096 20:12:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.096 20:12:53 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:22.096 20:12:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.096 20:12:53 -- common/autotest_common.sh@10 -- # set +x 00:07:22.096 [2024-07-22 20:12:53.995813] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:22.096 20:12:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.096 20:12:53 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:22.096 20:12:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.096 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.096 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.096 20:12:54 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:22.096 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.096 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.096 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.096 20:12:54 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:22.096 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.096 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.096 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.096 20:12:54 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:22.096 20:12:54 -- target/referrals.sh@48 -- # jq length 00:07:22.096 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.096 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.354 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.354 20:12:54 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:22.354 20:12:54 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:22.354 20:12:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:22.354 20:12:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:22.354 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.354 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.354 20:12:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:22.354 20:12:54 -- target/referrals.sh@21 -- # sort 00:07:22.354 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.354 20:12:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:22.354 20:12:54 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:22.354 20:12:54 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:22.354 20:12:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:22.354 20:12:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:22.354 20:12:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:22.354 20:12:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:22.354 20:12:54 -- target/referrals.sh@26 -- # sort 00:07:22.354 20:12:54 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:22.354 20:12:54 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:22.354 20:12:54 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:22.354 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.354 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.354 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.354 20:12:54 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:22.354 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.354 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.354 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.354 20:12:54 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:22.354 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.354 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.354 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.354 20:12:54 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:22.354 20:12:54 -- target/referrals.sh@56 -- # jq length 00:07:22.354 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.354 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.354 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.614 20:12:54 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:22.614 20:12:54 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:22.614 20:12:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:22.614 20:12:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:22.614 20:12:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:22.614 20:12:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:22.614 20:12:54 -- target/referrals.sh@26 -- # sort 00:07:22.614 20:12:54 -- target/referrals.sh@26 -- # echo 00:07:22.614 20:12:54 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:22.614 20:12:54 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:22.614 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.614 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.614 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.614 20:12:54 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:22.614 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.614 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.614 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.614 20:12:54 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:22.614 20:12:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:22.614 20:12:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:22.614 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.614 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.614 20:12:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:22.614 20:12:54 -- target/referrals.sh@21 -- # sort 00:07:22.614 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.614 20:12:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:22.614 20:12:54 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:22.614 20:12:54 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:22.614 20:12:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:22.614 20:12:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:22.614 20:12:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:22.614 20:12:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:22.614 20:12:54 -- target/referrals.sh@26 -- # sort 00:07:22.614 20:12:54 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:22.614 20:12:54 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:22.614 20:12:54 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:22.614 20:12:54 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:22.614 20:12:54 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:22.614 20:12:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:22.614 20:12:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:22.873 20:12:54 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:22.873 20:12:54 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:22.873 20:12:54 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:22.873 20:12:54 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:22.873 20:12:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:22.873 20:12:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:22.873 20:12:54 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:22.873 20:12:54 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:22.873 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.873 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.873 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.873 20:12:54 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:22.873 20:12:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:22.873 20:12:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:22.873 20:12:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:22.873 20:12:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:22.873 20:12:54 -- target/referrals.sh@21 -- # sort 00:07:22.873 20:12:54 -- common/autotest_common.sh@10 -- # set +x 00:07:22.873 20:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:22.873 20:12:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:22.873 20:12:54 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:22.873 20:12:54 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:22.873 20:12:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:22.873 20:12:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:22.873 20:12:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:22.873 20:12:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:22.873 20:12:54 -- target/referrals.sh@26 -- # sort 00:07:23.131 20:12:54 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:23.131 20:12:54 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:23.131 20:12:54 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:23.131 20:12:54 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:23.131 20:12:54 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:23.131 20:12:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:23.131 20:12:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:23.131 20:12:55 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:23.131 20:12:55 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:23.131 20:12:55 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:23.131 20:12:55 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:23.131 20:12:55 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:23.131 20:12:55 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:23.390 20:12:55 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:23.390 20:12:55 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:23.390 20:12:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:23.390 20:12:55 -- common/autotest_common.sh@10 -- # set +x 00:07:23.390 20:12:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:23.390 20:12:55 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:23.390 20:12:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:23.390 20:12:55 -- common/autotest_common.sh@10 -- # set +x 00:07:23.390 20:12:55 -- target/referrals.sh@82 -- # jq length 00:07:23.390 20:12:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:23.390 20:12:55 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:23.390 20:12:55 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:23.390 20:12:55 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:23.390 20:12:55 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:23.390 20:12:55 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:23.390 20:12:55 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:23.390 20:12:55 -- target/referrals.sh@26 -- # sort 00:07:23.390 20:12:55 -- target/referrals.sh@26 -- # echo 00:07:23.390 20:12:55 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:23.390 20:12:55 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:23.390 20:12:55 -- target/referrals.sh@86 -- # nvmftestfini 00:07:23.390 20:12:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:23.390 20:12:55 -- nvmf/common.sh@116 -- # sync 00:07:23.390 20:12:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:23.390 20:12:55 -- nvmf/common.sh@119 -- # set +e 00:07:23.390 20:12:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:23.390 20:12:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:23.390 rmmod nvme_tcp 00:07:23.649 rmmod nvme_fabrics 00:07:23.649 rmmod nvme_keyring 00:07:23.649 20:12:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:23.649 20:12:55 -- nvmf/common.sh@123 -- # set -e 00:07:23.649 20:12:55 -- nvmf/common.sh@124 -- # return 0 00:07:23.649 20:12:55 -- nvmf/common.sh@477 -- # '[' -n 3269556 ']' 00:07:23.649 20:12:55 -- nvmf/common.sh@478 -- # killprocess 3269556 00:07:23.649 20:12:55 -- common/autotest_common.sh@926 -- # '[' -z 3269556 ']' 00:07:23.649 20:12:55 -- common/autotest_common.sh@930 -- # kill -0 3269556 00:07:23.649 20:12:55 -- common/autotest_common.sh@931 -- # uname 00:07:23.649 20:12:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:23.649 20:12:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3269556 00:07:23.649 20:12:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:23.649 20:12:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:23.649 20:12:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3269556' 00:07:23.649 killing process with pid 3269556 00:07:23.649 20:12:55 -- common/autotest_common.sh@945 -- # kill 3269556 00:07:23.649 20:12:55 -- common/autotest_common.sh@950 -- # wait 3269556 00:07:23.908 20:12:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:23.908 20:12:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:23.908 20:12:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:23.908 20:12:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:23.908 20:12:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:23.908 20:12:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:23.908 20:12:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:23.908 20:12:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:25.809 20:12:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:25.809 00:07:25.809 real 0m10.188s 00:07:25.809 user 0m11.726s 00:07:25.809 sys 0m4.639s 00:07:25.809 20:12:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:25.809 20:12:57 -- common/autotest_common.sh@10 -- # set +x 00:07:25.809 ************************************ 00:07:25.809 END TEST nvmf_referrals 00:07:25.809 ************************************ 00:07:25.809 20:12:57 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:25.809 20:12:57 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:25.809 20:12:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:25.809 20:12:57 -- common/autotest_common.sh@10 -- # set +x 00:07:25.809 ************************************ 00:07:25.809 START TEST nvmf_connect_disconnect 00:07:25.809 ************************************ 00:07:25.809 20:12:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:26.068 * Looking for test storage... 00:07:26.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:26.068 20:12:57 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:26.068 20:12:57 -- nvmf/common.sh@7 -- # uname -s 00:07:26.068 20:12:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:26.068 20:12:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:26.068 20:12:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:26.068 20:12:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:26.068 20:12:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:26.068 20:12:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:26.068 20:12:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:26.068 20:12:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:26.068 20:12:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:26.068 20:12:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:26.068 20:12:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:07:26.068 20:12:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:07:26.068 20:12:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:26.068 20:12:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:26.068 20:12:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:26.068 20:12:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:26.068 20:12:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:26.068 20:12:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:26.068 20:12:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:26.068 20:12:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:26.068 20:12:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:26.068 20:12:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:26.068 20:12:57 -- paths/export.sh@5 -- # export PATH 00:07:26.068 20:12:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:26.068 20:12:57 -- nvmf/common.sh@46 -- # : 0 00:07:26.068 20:12:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:26.068 20:12:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:26.068 20:12:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:26.068 20:12:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:26.068 20:12:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:26.068 20:12:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:26.068 20:12:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:26.068 20:12:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:26.068 20:12:57 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:26.068 20:12:57 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:26.068 20:12:57 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:26.068 20:12:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:26.068 20:12:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:26.068 20:12:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:26.068 20:12:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:26.068 20:12:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:26.068 20:12:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:26.068 20:12:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:26.068 20:12:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:26.068 20:12:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:26.068 20:12:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:26.068 20:12:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:26.068 20:12:57 -- common/autotest_common.sh@10 -- # set +x 00:07:31.338 20:13:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:31.338 20:13:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:31.338 20:13:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:31.338 20:13:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:31.338 20:13:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:31.338 20:13:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:31.338 20:13:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:31.338 20:13:03 -- nvmf/common.sh@294 -- # net_devs=() 00:07:31.338 20:13:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:31.338 20:13:03 -- nvmf/common.sh@295 -- # e810=() 00:07:31.338 20:13:03 -- nvmf/common.sh@295 -- # local -ga e810 00:07:31.338 20:13:03 -- nvmf/common.sh@296 -- # x722=() 00:07:31.338 20:13:03 -- nvmf/common.sh@296 -- # local -ga x722 00:07:31.338 20:13:03 -- nvmf/common.sh@297 -- # mlx=() 00:07:31.338 20:13:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:31.338 20:13:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:31.338 20:13:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:31.338 20:13:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:31.338 20:13:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:31.338 20:13:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.338 20:13:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:07:31.338 Found 0000:86:00.0 (0x8086 - 0x159b) 00:07:31.338 20:13:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.338 20:13:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:07:31.338 Found 0000:86:00.1 (0x8086 - 0x159b) 00:07:31.338 20:13:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:31.338 20:13:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.338 20:13:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.338 20:13:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.338 20:13:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.338 20:13:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:07:31.338 Found net devices under 0000:86:00.0: cvl_0_0 00:07:31.338 20:13:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.338 20:13:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.338 20:13:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.338 20:13:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.338 20:13:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.338 20:13:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:07:31.338 Found net devices under 0000:86:00.1: cvl_0_1 00:07:31.338 20:13:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.338 20:13:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:31.338 20:13:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:31.338 20:13:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:31.338 20:13:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:31.338 20:13:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:31.338 20:13:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:31.338 20:13:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:31.338 20:13:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:31.338 20:13:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:31.338 20:13:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:31.338 20:13:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:31.338 20:13:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:31.338 20:13:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:31.338 20:13:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:31.338 20:13:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:31.338 20:13:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:31.339 20:13:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:31.339 20:13:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:31.339 20:13:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:31.339 20:13:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:31.339 20:13:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:31.339 20:13:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:31.339 20:13:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:31.597 20:13:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:31.597 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:31.597 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:07:31.597 00:07:31.597 --- 10.0.0.2 ping statistics --- 00:07:31.597 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:31.597 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:07:31.597 20:13:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:31.597 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:31.597 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.282 ms 00:07:31.597 00:07:31.597 --- 10.0.0.1 ping statistics --- 00:07:31.597 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:31.597 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:07:31.597 20:13:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:31.597 20:13:03 -- nvmf/common.sh@410 -- # return 0 00:07:31.597 20:13:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:31.597 20:13:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:31.597 20:13:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:31.597 20:13:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:31.597 20:13:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:31.597 20:13:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:31.597 20:13:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:31.597 20:13:03 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:31.597 20:13:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:31.597 20:13:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:31.597 20:13:03 -- common/autotest_common.sh@10 -- # set +x 00:07:31.597 20:13:03 -- nvmf/common.sh@469 -- # nvmfpid=3273638 00:07:31.597 20:13:03 -- nvmf/common.sh@470 -- # waitforlisten 3273638 00:07:31.597 20:13:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:31.597 20:13:03 -- common/autotest_common.sh@819 -- # '[' -z 3273638 ']' 00:07:31.597 20:13:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:31.597 20:13:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:31.597 20:13:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:31.597 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:31.597 20:13:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:31.597 20:13:03 -- common/autotest_common.sh@10 -- # set +x 00:07:31.597 [2024-07-22 20:13:03.373881] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:07:31.597 [2024-07-22 20:13:03.373931] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:31.597 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.597 [2024-07-22 20:13:03.430459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:31.597 [2024-07-22 20:13:03.509650] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:31.597 [2024-07-22 20:13:03.509757] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:31.597 [2024-07-22 20:13:03.509765] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:31.597 [2024-07-22 20:13:03.509771] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:31.597 [2024-07-22 20:13:03.509805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:31.597 [2024-07-22 20:13:03.509902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:31.597 [2024-07-22 20:13:03.509988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:31.597 [2024-07-22 20:13:03.509989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.533 20:13:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:32.533 20:13:04 -- common/autotest_common.sh@852 -- # return 0 00:07:32.533 20:13:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:32.533 20:13:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:32.533 20:13:04 -- common/autotest_common.sh@10 -- # set +x 00:07:32.533 20:13:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:32.533 20:13:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:32.533 20:13:04 -- common/autotest_common.sh@10 -- # set +x 00:07:32.533 [2024-07-22 20:13:04.232360] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:32.533 20:13:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:32.533 20:13:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:32.533 20:13:04 -- common/autotest_common.sh@10 -- # set +x 00:07:32.533 20:13:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:32.533 20:13:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:32.533 20:13:04 -- common/autotest_common.sh@10 -- # set +x 00:07:32.533 20:13:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:32.533 20:13:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:32.533 20:13:04 -- common/autotest_common.sh@10 -- # set +x 00:07:32.533 20:13:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:32.533 20:13:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:32.533 20:13:04 -- common/autotest_common.sh@10 -- # set +x 00:07:32.533 [2024-07-22 20:13:04.283927] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:32.533 20:13:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:32.533 20:13:04 -- target/connect_disconnect.sh@34 -- # set +x 00:07:35.155 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:37.063 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:39.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:42.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:44.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:46.579 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:48.488 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:51.025 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:52.929 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.463 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.998 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:59.901 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.437 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.390 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.924 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.458 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.364 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.899 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.821 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.357 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.262 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.811 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.713 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.366 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:36.271 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:43.248 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.783 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.319 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.760 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.664 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.200 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.638 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.609 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.146 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.677 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.020 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.556 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.094 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.001 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.074 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.980 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.523 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.507 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.945 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.480 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.011 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.913 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.444 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.348 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.882 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.323 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.858 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.762 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.320 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.901 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.806 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.341 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.246 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.781 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.686 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.219 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.754 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.656 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.092 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.624 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.615 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.153 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.059 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.597 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.136 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.040 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.484 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.039 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.578 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.023 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.557 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.546 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.085 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.994 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.535 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.443 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.981 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.427 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.335 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.335 20:16:52 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:20.335 20:16:52 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:20.335 20:16:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:20.335 20:16:52 -- nvmf/common.sh@116 -- # sync 00:11:20.335 20:16:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:20.335 20:16:52 -- nvmf/common.sh@119 -- # set +e 00:11:20.335 20:16:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:20.335 20:16:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:20.335 rmmod nvme_tcp 00:11:20.335 rmmod nvme_fabrics 00:11:20.595 rmmod nvme_keyring 00:11:20.595 20:16:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:20.595 20:16:52 -- nvmf/common.sh@123 -- # set -e 00:11:20.595 20:16:52 -- nvmf/common.sh@124 -- # return 0 00:11:20.595 20:16:52 -- nvmf/common.sh@477 -- # '[' -n 3273638 ']' 00:11:20.595 20:16:52 -- nvmf/common.sh@478 -- # killprocess 3273638 00:11:20.595 20:16:52 -- common/autotest_common.sh@926 -- # '[' -z 3273638 ']' 00:11:20.595 20:16:52 -- common/autotest_common.sh@930 -- # kill -0 3273638 00:11:20.595 20:16:52 -- common/autotest_common.sh@931 -- # uname 00:11:20.595 20:16:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:20.595 20:16:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3273638 00:11:20.595 20:16:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:20.595 20:16:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:20.595 20:16:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3273638' 00:11:20.595 killing process with pid 3273638 00:11:20.595 20:16:52 -- common/autotest_common.sh@945 -- # kill 3273638 00:11:20.595 20:16:52 -- common/autotest_common.sh@950 -- # wait 3273638 00:11:20.855 20:16:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:20.855 20:16:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:20.855 20:16:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:20.855 20:16:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:20.855 20:16:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:20.855 20:16:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:20.855 20:16:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:20.855 20:16:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:22.766 20:16:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:22.766 00:11:22.766 real 3m56.913s 00:11:22.766 user 15m9.450s 00:11:22.766 sys 0m16.926s 00:11:22.766 20:16:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:22.766 20:16:54 -- common/autotest_common.sh@10 -- # set +x 00:11:22.766 ************************************ 00:11:22.766 END TEST nvmf_connect_disconnect 00:11:22.766 ************************************ 00:11:22.766 20:16:54 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:22.766 20:16:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:22.766 20:16:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:22.766 20:16:54 -- common/autotest_common.sh@10 -- # set +x 00:11:22.766 ************************************ 00:11:22.766 START TEST nvmf_multitarget 00:11:22.766 ************************************ 00:11:22.766 20:16:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:23.027 * Looking for test storage... 00:11:23.027 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:23.027 20:16:54 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:23.027 20:16:54 -- nvmf/common.sh@7 -- # uname -s 00:11:23.027 20:16:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:23.027 20:16:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:23.027 20:16:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:23.027 20:16:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:23.027 20:16:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:23.027 20:16:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:23.027 20:16:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:23.027 20:16:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:23.027 20:16:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:23.027 20:16:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:23.027 20:16:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:11:23.027 20:16:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:11:23.027 20:16:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:23.027 20:16:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:23.027 20:16:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:23.027 20:16:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:23.027 20:16:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:23.027 20:16:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:23.027 20:16:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:23.027 20:16:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:23.027 20:16:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:23.027 20:16:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:23.027 20:16:54 -- paths/export.sh@5 -- # export PATH 00:11:23.027 20:16:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:23.027 20:16:54 -- nvmf/common.sh@46 -- # : 0 00:11:23.027 20:16:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:23.027 20:16:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:23.027 20:16:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:23.028 20:16:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:23.028 20:16:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:23.028 20:16:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:23.028 20:16:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:23.028 20:16:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:23.028 20:16:54 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:23.028 20:16:54 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:23.028 20:16:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:23.028 20:16:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:23.028 20:16:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:23.028 20:16:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:23.028 20:16:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:23.028 20:16:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:23.028 20:16:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:23.028 20:16:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:23.028 20:16:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:23.028 20:16:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:23.028 20:16:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:23.028 20:16:54 -- common/autotest_common.sh@10 -- # set +x 00:11:28.305 20:16:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:28.305 20:16:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:28.305 20:16:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:28.305 20:16:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:28.305 20:16:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:28.305 20:16:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:28.305 20:16:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:28.305 20:16:59 -- nvmf/common.sh@294 -- # net_devs=() 00:11:28.305 20:16:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:28.305 20:16:59 -- nvmf/common.sh@295 -- # e810=() 00:11:28.305 20:16:59 -- nvmf/common.sh@295 -- # local -ga e810 00:11:28.305 20:16:59 -- nvmf/common.sh@296 -- # x722=() 00:11:28.305 20:16:59 -- nvmf/common.sh@296 -- # local -ga x722 00:11:28.305 20:16:59 -- nvmf/common.sh@297 -- # mlx=() 00:11:28.305 20:16:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:28.305 20:16:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:28.305 20:16:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:28.305 20:16:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:28.305 20:16:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:28.305 20:16:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:28.305 20:16:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:11:28.305 Found 0000:86:00.0 (0x8086 - 0x159b) 00:11:28.305 20:16:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:28.305 20:16:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:11:28.305 Found 0000:86:00.1 (0x8086 - 0x159b) 00:11:28.305 20:16:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:28.305 20:16:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:28.305 20:16:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:28.305 20:16:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:28.305 20:16:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:28.305 20:16:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:11:28.305 Found net devices under 0000:86:00.0: cvl_0_0 00:11:28.305 20:16:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:28.305 20:16:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:28.305 20:16:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:28.305 20:16:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:28.305 20:16:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:28.305 20:16:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:11:28.305 Found net devices under 0000:86:00.1: cvl_0_1 00:11:28.305 20:16:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:28.305 20:16:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:28.305 20:16:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:28.305 20:16:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:28.305 20:16:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:28.305 20:16:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:28.305 20:16:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:28.305 20:16:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:28.305 20:16:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:28.305 20:16:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:28.305 20:16:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:28.305 20:16:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:28.305 20:16:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:28.305 20:16:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:28.305 20:16:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:28.305 20:16:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:28.305 20:16:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:28.305 20:16:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:28.305 20:16:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:28.305 20:16:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:28.305 20:17:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:28.305 20:17:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:28.305 20:17:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:28.305 20:17:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:28.305 20:17:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:28.305 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:28.305 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.161 ms 00:11:28.305 00:11:28.305 --- 10.0.0.2 ping statistics --- 00:11:28.305 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:28.305 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:11:28.305 20:17:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:28.305 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:28.305 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.233 ms 00:11:28.305 00:11:28.305 --- 10.0.0.1 ping statistics --- 00:11:28.305 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:28.305 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:11:28.305 20:17:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:28.305 20:17:00 -- nvmf/common.sh@410 -- # return 0 00:11:28.305 20:17:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:28.305 20:17:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:28.305 20:17:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:28.305 20:17:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:28.305 20:17:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:28.305 20:17:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:28.305 20:17:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:28.305 20:17:00 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:28.305 20:17:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:28.305 20:17:00 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:28.305 20:17:00 -- common/autotest_common.sh@10 -- # set +x 00:11:28.305 20:17:00 -- nvmf/common.sh@469 -- # nvmfpid=3317470 00:11:28.305 20:17:00 -- nvmf/common.sh@470 -- # waitforlisten 3317470 00:11:28.305 20:17:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:28.305 20:17:00 -- common/autotest_common.sh@819 -- # '[' -z 3317470 ']' 00:11:28.305 20:17:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:28.305 20:17:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:28.305 20:17:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:28.305 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:28.305 20:17:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:28.305 20:17:00 -- common/autotest_common.sh@10 -- # set +x 00:11:28.305 [2024-07-22 20:17:00.201371] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:11:28.305 [2024-07-22 20:17:00.201412] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:28.305 EAL: No free 2048 kB hugepages reported on node 1 00:11:28.565 [2024-07-22 20:17:00.263263] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:28.565 [2024-07-22 20:17:00.338285] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:28.565 [2024-07-22 20:17:00.338399] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:28.565 [2024-07-22 20:17:00.338407] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:28.565 [2024-07-22 20:17:00.338414] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:28.565 [2024-07-22 20:17:00.338453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:28.565 [2024-07-22 20:17:00.338471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:28.565 [2024-07-22 20:17:00.338492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:28.565 [2024-07-22 20:17:00.338494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:29.134 20:17:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:29.134 20:17:01 -- common/autotest_common.sh@852 -- # return 0 00:11:29.134 20:17:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:29.134 20:17:01 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:29.134 20:17:01 -- common/autotest_common.sh@10 -- # set +x 00:11:29.134 20:17:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:29.134 20:17:01 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:29.134 20:17:01 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:29.134 20:17:01 -- target/multitarget.sh@21 -- # jq length 00:11:29.393 20:17:01 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:29.393 20:17:01 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:29.393 "nvmf_tgt_1" 00:11:29.393 20:17:01 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:29.393 "nvmf_tgt_2" 00:11:29.653 20:17:01 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:29.653 20:17:01 -- target/multitarget.sh@28 -- # jq length 00:11:29.653 20:17:01 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:29.653 20:17:01 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:29.653 true 00:11:29.653 20:17:01 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:29.913 true 00:11:29.913 20:17:01 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:29.913 20:17:01 -- target/multitarget.sh@35 -- # jq length 00:11:29.913 20:17:01 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:29.913 20:17:01 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:29.913 20:17:01 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:29.913 20:17:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:29.913 20:17:01 -- nvmf/common.sh@116 -- # sync 00:11:29.913 20:17:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:29.913 20:17:01 -- nvmf/common.sh@119 -- # set +e 00:11:29.913 20:17:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:29.913 20:17:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:29.913 rmmod nvme_tcp 00:11:29.913 rmmod nvme_fabrics 00:11:29.913 rmmod nvme_keyring 00:11:29.913 20:17:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:29.913 20:17:01 -- nvmf/common.sh@123 -- # set -e 00:11:29.913 20:17:01 -- nvmf/common.sh@124 -- # return 0 00:11:29.913 20:17:01 -- nvmf/common.sh@477 -- # '[' -n 3317470 ']' 00:11:29.913 20:17:01 -- nvmf/common.sh@478 -- # killprocess 3317470 00:11:29.913 20:17:01 -- common/autotest_common.sh@926 -- # '[' -z 3317470 ']' 00:11:29.913 20:17:01 -- common/autotest_common.sh@930 -- # kill -0 3317470 00:11:29.913 20:17:01 -- common/autotest_common.sh@931 -- # uname 00:11:29.913 20:17:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:29.913 20:17:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3317470 00:11:29.913 20:17:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:29.913 20:17:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:29.913 20:17:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3317470' 00:11:29.913 killing process with pid 3317470 00:11:29.913 20:17:01 -- common/autotest_common.sh@945 -- # kill 3317470 00:11:29.913 20:17:01 -- common/autotest_common.sh@950 -- # wait 3317470 00:11:30.173 20:17:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:30.173 20:17:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:30.173 20:17:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:30.173 20:17:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:30.173 20:17:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:30.173 20:17:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:30.173 20:17:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:30.173 20:17:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:32.789 20:17:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:32.789 00:11:32.789 real 0m9.439s 00:11:32.789 user 0m8.930s 00:11:32.789 sys 0m4.512s 00:11:32.789 20:17:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:32.789 20:17:04 -- common/autotest_common.sh@10 -- # set +x 00:11:32.789 ************************************ 00:11:32.789 END TEST nvmf_multitarget 00:11:32.789 ************************************ 00:11:32.789 20:17:04 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:32.789 20:17:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:32.789 20:17:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:32.789 20:17:04 -- common/autotest_common.sh@10 -- # set +x 00:11:32.789 ************************************ 00:11:32.789 START TEST nvmf_rpc 00:11:32.789 ************************************ 00:11:32.789 20:17:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:32.789 * Looking for test storage... 00:11:32.789 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:32.789 20:17:04 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:32.789 20:17:04 -- nvmf/common.sh@7 -- # uname -s 00:11:32.789 20:17:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:32.789 20:17:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:32.789 20:17:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:32.789 20:17:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:32.789 20:17:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:32.789 20:17:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:32.789 20:17:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:32.789 20:17:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:32.789 20:17:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:32.789 20:17:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:32.789 20:17:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:11:32.789 20:17:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:11:32.789 20:17:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:32.789 20:17:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:32.789 20:17:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:32.789 20:17:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:32.789 20:17:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:32.789 20:17:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:32.789 20:17:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:32.789 20:17:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.789 20:17:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.789 20:17:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.789 20:17:04 -- paths/export.sh@5 -- # export PATH 00:11:32.789 20:17:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.789 20:17:04 -- nvmf/common.sh@46 -- # : 0 00:11:32.789 20:17:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:32.789 20:17:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:32.789 20:17:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:32.789 20:17:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:32.789 20:17:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:32.789 20:17:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:32.789 20:17:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:32.789 20:17:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:32.789 20:17:04 -- target/rpc.sh@11 -- # loops=5 00:11:32.789 20:17:04 -- target/rpc.sh@23 -- # nvmftestinit 00:11:32.789 20:17:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:32.789 20:17:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:32.789 20:17:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:32.789 20:17:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:32.789 20:17:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:32.789 20:17:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:32.789 20:17:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:32.789 20:17:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:32.789 20:17:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:32.789 20:17:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:32.789 20:17:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:32.789 20:17:04 -- common/autotest_common.sh@10 -- # set +x 00:11:38.062 20:17:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:38.062 20:17:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:38.062 20:17:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:38.062 20:17:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:38.062 20:17:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:38.062 20:17:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:38.062 20:17:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:38.062 20:17:09 -- nvmf/common.sh@294 -- # net_devs=() 00:11:38.062 20:17:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:38.062 20:17:09 -- nvmf/common.sh@295 -- # e810=() 00:11:38.062 20:17:09 -- nvmf/common.sh@295 -- # local -ga e810 00:11:38.062 20:17:09 -- nvmf/common.sh@296 -- # x722=() 00:11:38.062 20:17:09 -- nvmf/common.sh@296 -- # local -ga x722 00:11:38.062 20:17:09 -- nvmf/common.sh@297 -- # mlx=() 00:11:38.062 20:17:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:38.062 20:17:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:38.062 20:17:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:38.062 20:17:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:38.062 20:17:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:38.062 20:17:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:38.062 20:17:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:11:38.062 Found 0000:86:00.0 (0x8086 - 0x159b) 00:11:38.062 20:17:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:38.062 20:17:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:11:38.062 Found 0000:86:00.1 (0x8086 - 0x159b) 00:11:38.062 20:17:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:38.062 20:17:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:38.062 20:17:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:38.062 20:17:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:38.062 20:17:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:38.062 20:17:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:11:38.062 Found net devices under 0000:86:00.0: cvl_0_0 00:11:38.062 20:17:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:38.062 20:17:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:38.062 20:17:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:38.062 20:17:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:38.062 20:17:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:38.062 20:17:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:11:38.062 Found net devices under 0000:86:00.1: cvl_0_1 00:11:38.062 20:17:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:38.062 20:17:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:38.062 20:17:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:38.062 20:17:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:38.062 20:17:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:38.062 20:17:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:38.062 20:17:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:38.062 20:17:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:38.062 20:17:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:38.062 20:17:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:38.062 20:17:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:38.062 20:17:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:38.062 20:17:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:38.062 20:17:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:38.062 20:17:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:38.062 20:17:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:38.062 20:17:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:38.062 20:17:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:38.062 20:17:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:38.062 20:17:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:38.062 20:17:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:38.062 20:17:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:38.062 20:17:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:38.062 20:17:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:38.062 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:38.062 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.160 ms 00:11:38.062 00:11:38.062 --- 10.0.0.2 ping statistics --- 00:11:38.062 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:38.062 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:11:38.062 20:17:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:38.062 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:38.062 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.231 ms 00:11:38.062 00:11:38.062 --- 10.0.0.1 ping statistics --- 00:11:38.062 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:38.062 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:11:38.062 20:17:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:38.062 20:17:09 -- nvmf/common.sh@410 -- # return 0 00:11:38.062 20:17:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:38.062 20:17:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:38.062 20:17:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:38.062 20:17:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:38.062 20:17:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:38.062 20:17:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:38.062 20:17:09 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:38.062 20:17:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:38.062 20:17:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:38.062 20:17:09 -- common/autotest_common.sh@10 -- # set +x 00:11:38.062 20:17:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:38.062 20:17:09 -- nvmf/common.sh@469 -- # nvmfpid=3321219 00:11:38.062 20:17:09 -- nvmf/common.sh@470 -- # waitforlisten 3321219 00:11:38.062 20:17:09 -- common/autotest_common.sh@819 -- # '[' -z 3321219 ']' 00:11:38.062 20:17:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:38.062 20:17:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:38.062 20:17:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:38.062 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:38.062 20:17:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:38.062 20:17:09 -- common/autotest_common.sh@10 -- # set +x 00:11:38.062 [2024-07-22 20:17:09.823749] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:11:38.062 [2024-07-22 20:17:09.823789] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:38.062 EAL: No free 2048 kB hugepages reported on node 1 00:11:38.062 [2024-07-22 20:17:09.882246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:38.062 [2024-07-22 20:17:09.956143] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:38.063 [2024-07-22 20:17:09.956255] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:38.063 [2024-07-22 20:17:09.956262] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:38.063 [2024-07-22 20:17:09.956269] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:38.063 [2024-07-22 20:17:09.956310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:38.063 [2024-07-22 20:17:09.956418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:38.063 [2024-07-22 20:17:09.956504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:38.063 [2024-07-22 20:17:09.956504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:38.999 20:17:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:38.999 20:17:10 -- common/autotest_common.sh@852 -- # return 0 00:11:38.999 20:17:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:38.999 20:17:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:38.999 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:38.999 20:17:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:38.999 20:17:10 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:38.999 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:38.999 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:38.999 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:38.999 20:17:10 -- target/rpc.sh@26 -- # stats='{ 00:11:38.999 "tick_rate": 2300000000, 00:11:38.999 "poll_groups": [ 00:11:38.999 { 00:11:38.999 "name": "nvmf_tgt_poll_group_0", 00:11:38.999 "admin_qpairs": 0, 00:11:38.999 "io_qpairs": 0, 00:11:38.999 "current_admin_qpairs": 0, 00:11:38.999 "current_io_qpairs": 0, 00:11:38.999 "pending_bdev_io": 0, 00:11:38.999 "completed_nvme_io": 0, 00:11:38.999 "transports": [] 00:11:38.999 }, 00:11:38.999 { 00:11:38.999 "name": "nvmf_tgt_poll_group_1", 00:11:38.999 "admin_qpairs": 0, 00:11:38.999 "io_qpairs": 0, 00:11:38.999 "current_admin_qpairs": 0, 00:11:38.999 "current_io_qpairs": 0, 00:11:38.999 "pending_bdev_io": 0, 00:11:38.999 "completed_nvme_io": 0, 00:11:38.999 "transports": [] 00:11:38.999 }, 00:11:38.999 { 00:11:38.999 "name": "nvmf_tgt_poll_group_2", 00:11:38.999 "admin_qpairs": 0, 00:11:38.999 "io_qpairs": 0, 00:11:38.999 "current_admin_qpairs": 0, 00:11:38.999 "current_io_qpairs": 0, 00:11:38.999 "pending_bdev_io": 0, 00:11:38.999 "completed_nvme_io": 0, 00:11:38.999 "transports": [] 00:11:38.999 }, 00:11:38.999 { 00:11:38.999 "name": "nvmf_tgt_poll_group_3", 00:11:38.999 "admin_qpairs": 0, 00:11:38.999 "io_qpairs": 0, 00:11:38.999 "current_admin_qpairs": 0, 00:11:38.999 "current_io_qpairs": 0, 00:11:38.999 "pending_bdev_io": 0, 00:11:38.999 "completed_nvme_io": 0, 00:11:38.999 "transports": [] 00:11:38.999 } 00:11:38.999 ] 00:11:38.999 }' 00:11:38.999 20:17:10 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:38.999 20:17:10 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:38.999 20:17:10 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:38.999 20:17:10 -- target/rpc.sh@15 -- # wc -l 00:11:38.999 20:17:10 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:38.999 20:17:10 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:38.999 20:17:10 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:38.999 20:17:10 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:38.999 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:38.999 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:38.999 [2024-07-22 20:17:10.778751] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:38.999 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:38.999 20:17:10 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:38.999 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:38.999 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:38.999 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:38.999 20:17:10 -- target/rpc.sh@33 -- # stats='{ 00:11:38.999 "tick_rate": 2300000000, 00:11:38.999 "poll_groups": [ 00:11:38.999 { 00:11:38.999 "name": "nvmf_tgt_poll_group_0", 00:11:38.999 "admin_qpairs": 0, 00:11:38.999 "io_qpairs": 0, 00:11:38.999 "current_admin_qpairs": 0, 00:11:38.999 "current_io_qpairs": 0, 00:11:38.999 "pending_bdev_io": 0, 00:11:38.999 "completed_nvme_io": 0, 00:11:38.999 "transports": [ 00:11:38.999 { 00:11:38.999 "trtype": "TCP" 00:11:38.999 } 00:11:38.999 ] 00:11:38.999 }, 00:11:38.999 { 00:11:38.999 "name": "nvmf_tgt_poll_group_1", 00:11:38.999 "admin_qpairs": 0, 00:11:38.999 "io_qpairs": 0, 00:11:38.999 "current_admin_qpairs": 0, 00:11:38.999 "current_io_qpairs": 0, 00:11:38.999 "pending_bdev_io": 0, 00:11:38.999 "completed_nvme_io": 0, 00:11:38.999 "transports": [ 00:11:38.999 { 00:11:38.999 "trtype": "TCP" 00:11:38.999 } 00:11:38.999 ] 00:11:38.999 }, 00:11:38.999 { 00:11:38.999 "name": "nvmf_tgt_poll_group_2", 00:11:38.999 "admin_qpairs": 0, 00:11:38.999 "io_qpairs": 0, 00:11:38.999 "current_admin_qpairs": 0, 00:11:38.999 "current_io_qpairs": 0, 00:11:38.999 "pending_bdev_io": 0, 00:11:38.999 "completed_nvme_io": 0, 00:11:38.999 "transports": [ 00:11:38.999 { 00:11:38.999 "trtype": "TCP" 00:11:39.000 } 00:11:39.000 ] 00:11:39.000 }, 00:11:39.000 { 00:11:39.000 "name": "nvmf_tgt_poll_group_3", 00:11:39.000 "admin_qpairs": 0, 00:11:39.000 "io_qpairs": 0, 00:11:39.000 "current_admin_qpairs": 0, 00:11:39.000 "current_io_qpairs": 0, 00:11:39.000 "pending_bdev_io": 0, 00:11:39.000 "completed_nvme_io": 0, 00:11:39.000 "transports": [ 00:11:39.000 { 00:11:39.000 "trtype": "TCP" 00:11:39.000 } 00:11:39.000 ] 00:11:39.000 } 00:11:39.000 ] 00:11:39.000 }' 00:11:39.000 20:17:10 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:39.000 20:17:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:39.000 20:17:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:39.000 20:17:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:39.000 20:17:10 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:39.000 20:17:10 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:39.000 20:17:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:39.000 20:17:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:39.000 20:17:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:39.000 20:17:10 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:39.000 20:17:10 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:39.000 20:17:10 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:39.000 20:17:10 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:39.000 20:17:10 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:39.000 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.000 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:39.000 Malloc1 00:11:39.000 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.000 20:17:10 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:39.000 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.000 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:39.000 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.000 20:17:10 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:39.000 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.000 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:39.000 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.000 20:17:10 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:39.000 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.000 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:39.259 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.259 20:17:10 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:39.259 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.259 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:39.259 [2024-07-22 20:17:10.950849] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:39.259 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.259 20:17:10 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:11:39.259 20:17:10 -- common/autotest_common.sh@640 -- # local es=0 00:11:39.259 20:17:10 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:11:39.259 20:17:10 -- common/autotest_common.sh@628 -- # local arg=nvme 00:11:39.259 20:17:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:39.259 20:17:10 -- common/autotest_common.sh@632 -- # type -t nvme 00:11:39.259 20:17:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:39.259 20:17:10 -- common/autotest_common.sh@634 -- # type -P nvme 00:11:39.259 20:17:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:39.259 20:17:10 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:11:39.259 20:17:10 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:11:39.259 20:17:10 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:11:39.259 [2024-07-22 20:17:10.975402] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562' 00:11:39.259 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:39.259 could not add new controller: failed to write to nvme-fabrics device 00:11:39.259 20:17:10 -- common/autotest_common.sh@643 -- # es=1 00:11:39.259 20:17:10 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:11:39.259 20:17:10 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:11:39.259 20:17:10 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:11:39.259 20:17:10 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:11:39.259 20:17:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.259 20:17:10 -- common/autotest_common.sh@10 -- # set +x 00:11:39.259 20:17:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.259 20:17:10 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:40.197 20:17:12 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:40.197 20:17:12 -- common/autotest_common.sh@1177 -- # local i=0 00:11:40.197 20:17:12 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:40.197 20:17:12 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:40.197 20:17:12 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:42.732 20:17:14 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:42.732 20:17:14 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:42.732 20:17:14 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:42.732 20:17:14 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:42.732 20:17:14 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:42.732 20:17:14 -- common/autotest_common.sh@1187 -- # return 0 00:11:42.732 20:17:14 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:42.732 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.732 20:17:14 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:42.732 20:17:14 -- common/autotest_common.sh@1198 -- # local i=0 00:11:42.732 20:17:14 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:42.732 20:17:14 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:42.732 20:17:14 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:42.732 20:17:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:42.732 20:17:14 -- common/autotest_common.sh@1210 -- # return 0 00:11:42.732 20:17:14 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:11:42.732 20:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:42.732 20:17:14 -- common/autotest_common.sh@10 -- # set +x 00:11:42.732 20:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:42.732 20:17:14 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:42.732 20:17:14 -- common/autotest_common.sh@640 -- # local es=0 00:11:42.732 20:17:14 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:42.732 20:17:14 -- common/autotest_common.sh@628 -- # local arg=nvme 00:11:42.732 20:17:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:42.732 20:17:14 -- common/autotest_common.sh@632 -- # type -t nvme 00:11:42.732 20:17:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:42.732 20:17:14 -- common/autotest_common.sh@634 -- # type -P nvme 00:11:42.732 20:17:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:42.732 20:17:14 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:11:42.732 20:17:14 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:11:42.732 20:17:14 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:42.732 [2024-07-22 20:17:14.200651] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562' 00:11:42.732 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:42.732 could not add new controller: failed to write to nvme-fabrics device 00:11:42.732 20:17:14 -- common/autotest_common.sh@643 -- # es=1 00:11:42.732 20:17:14 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:11:42.732 20:17:14 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:11:42.732 20:17:14 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:11:42.732 20:17:14 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:42.732 20:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:42.732 20:17:14 -- common/autotest_common.sh@10 -- # set +x 00:11:42.732 20:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:42.732 20:17:14 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:43.668 20:17:15 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:43.668 20:17:15 -- common/autotest_common.sh@1177 -- # local i=0 00:11:43.668 20:17:15 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:43.668 20:17:15 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:43.668 20:17:15 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:45.575 20:17:17 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:45.575 20:17:17 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:45.575 20:17:17 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:45.575 20:17:17 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:45.575 20:17:17 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:45.575 20:17:17 -- common/autotest_common.sh@1187 -- # return 0 00:11:45.575 20:17:17 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:45.575 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.575 20:17:17 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:45.575 20:17:17 -- common/autotest_common.sh@1198 -- # local i=0 00:11:45.575 20:17:17 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:45.575 20:17:17 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:45.575 20:17:17 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:45.575 20:17:17 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:45.575 20:17:17 -- common/autotest_common.sh@1210 -- # return 0 00:11:45.575 20:17:17 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.575 20:17:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.575 20:17:17 -- common/autotest_common.sh@10 -- # set +x 00:11:45.575 20:17:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.575 20:17:17 -- target/rpc.sh@81 -- # seq 1 5 00:11:45.575 20:17:17 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:45.575 20:17:17 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:45.575 20:17:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.576 20:17:17 -- common/autotest_common.sh@10 -- # set +x 00:11:45.576 20:17:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.576 20:17:17 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:45.576 20:17:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.576 20:17:17 -- common/autotest_common.sh@10 -- # set +x 00:11:45.576 [2024-07-22 20:17:17.509990] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.835 20:17:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.835 20:17:17 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:45.835 20:17:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.835 20:17:17 -- common/autotest_common.sh@10 -- # set +x 00:11:45.835 20:17:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.835 20:17:17 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:45.835 20:17:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.835 20:17:17 -- common/autotest_common.sh@10 -- # set +x 00:11:45.835 20:17:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.835 20:17:17 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:46.772 20:17:18 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:46.772 20:17:18 -- common/autotest_common.sh@1177 -- # local i=0 00:11:46.772 20:17:18 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:46.772 20:17:18 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:46.772 20:17:18 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:49.311 20:17:20 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:49.311 20:17:20 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:49.311 20:17:20 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:49.311 20:17:20 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:49.311 20:17:20 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:49.311 20:17:20 -- common/autotest_common.sh@1187 -- # return 0 00:11:49.311 20:17:20 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:49.311 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.311 20:17:20 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:49.311 20:17:20 -- common/autotest_common.sh@1198 -- # local i=0 00:11:49.311 20:17:20 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:49.311 20:17:20 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:49.311 20:17:20 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:49.311 20:17:20 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:49.311 20:17:20 -- common/autotest_common.sh@1210 -- # return 0 00:11:49.311 20:17:20 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:49.311 20:17:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.311 20:17:20 -- common/autotest_common.sh@10 -- # set +x 00:11:49.311 20:17:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.311 20:17:20 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:49.311 20:17:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.311 20:17:20 -- common/autotest_common.sh@10 -- # set +x 00:11:49.311 20:17:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.311 20:17:20 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:49.311 20:17:20 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:49.311 20:17:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.311 20:17:20 -- common/autotest_common.sh@10 -- # set +x 00:11:49.311 20:17:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.311 20:17:20 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:49.311 20:17:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.311 20:17:20 -- common/autotest_common.sh@10 -- # set +x 00:11:49.311 [2024-07-22 20:17:20.833218] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:49.311 20:17:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.311 20:17:20 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:49.311 20:17:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.311 20:17:20 -- common/autotest_common.sh@10 -- # set +x 00:11:49.311 20:17:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.311 20:17:20 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:49.311 20:17:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:49.311 20:17:20 -- common/autotest_common.sh@10 -- # set +x 00:11:49.311 20:17:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:49.312 20:17:20 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.249 20:17:22 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:50.249 20:17:22 -- common/autotest_common.sh@1177 -- # local i=0 00:11:50.249 20:17:22 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:50.249 20:17:22 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:50.249 20:17:22 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:52.152 20:17:24 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:52.152 20:17:24 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:52.152 20:17:24 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:52.152 20:17:24 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:52.152 20:17:24 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:52.152 20:17:24 -- common/autotest_common.sh@1187 -- # return 0 00:11:52.152 20:17:24 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:52.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.412 20:17:24 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:52.412 20:17:24 -- common/autotest_common.sh@1198 -- # local i=0 00:11:52.412 20:17:24 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:52.412 20:17:24 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.412 20:17:24 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:52.412 20:17:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.412 20:17:24 -- common/autotest_common.sh@1210 -- # return 0 00:11:52.412 20:17:24 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:52.412 20:17:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:52.412 20:17:24 -- common/autotest_common.sh@10 -- # set +x 00:11:52.412 20:17:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:52.412 20:17:24 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:52.412 20:17:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:52.412 20:17:24 -- common/autotest_common.sh@10 -- # set +x 00:11:52.412 20:17:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:52.412 20:17:24 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:52.412 20:17:24 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:52.412 20:17:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:52.412 20:17:24 -- common/autotest_common.sh@10 -- # set +x 00:11:52.412 20:17:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:52.412 20:17:24 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:52.412 20:17:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:52.412 20:17:24 -- common/autotest_common.sh@10 -- # set +x 00:11:52.412 [2024-07-22 20:17:24.183126] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:52.412 20:17:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:52.412 20:17:24 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:52.412 20:17:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:52.412 20:17:24 -- common/autotest_common.sh@10 -- # set +x 00:11:52.412 20:17:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:52.412 20:17:24 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:52.412 20:17:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:52.412 20:17:24 -- common/autotest_common.sh@10 -- # set +x 00:11:52.412 20:17:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:52.412 20:17:24 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.348 20:17:25 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:53.348 20:17:25 -- common/autotest_common.sh@1177 -- # local i=0 00:11:53.348 20:17:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:53.348 20:17:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:53.348 20:17:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:55.953 20:17:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:55.953 20:17:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:55.953 20:17:27 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:55.953 20:17:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:55.953 20:17:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:55.953 20:17:27 -- common/autotest_common.sh@1187 -- # return 0 00:11:55.953 20:17:27 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:55.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.953 20:17:27 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:55.953 20:17:27 -- common/autotest_common.sh@1198 -- # local i=0 00:11:55.953 20:17:27 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:55.953 20:17:27 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.953 20:17:27 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:55.953 20:17:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.953 20:17:27 -- common/autotest_common.sh@1210 -- # return 0 00:11:55.953 20:17:27 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:55.953 20:17:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:55.953 20:17:27 -- common/autotest_common.sh@10 -- # set +x 00:11:55.953 20:17:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:55.953 20:17:27 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:55.953 20:17:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:55.953 20:17:27 -- common/autotest_common.sh@10 -- # set +x 00:11:55.953 20:17:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:55.953 20:17:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:55.953 20:17:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:55.953 20:17:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:55.953 20:17:27 -- common/autotest_common.sh@10 -- # set +x 00:11:55.953 20:17:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:55.953 20:17:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:55.953 20:17:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:55.953 20:17:27 -- common/autotest_common.sh@10 -- # set +x 00:11:55.953 [2024-07-22 20:17:27.461081] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:55.953 20:17:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:55.953 20:17:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:55.953 20:17:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:55.953 20:17:27 -- common/autotest_common.sh@10 -- # set +x 00:11:55.953 20:17:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:55.953 20:17:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:55.953 20:17:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:55.953 20:17:27 -- common/autotest_common.sh@10 -- # set +x 00:11:55.953 20:17:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:55.953 20:17:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:56.891 20:17:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:56.891 20:17:28 -- common/autotest_common.sh@1177 -- # local i=0 00:11:56.891 20:17:28 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:56.891 20:17:28 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:56.891 20:17:28 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:58.797 20:17:30 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:58.797 20:17:30 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:58.797 20:17:30 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:58.797 20:17:30 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:58.797 20:17:30 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:58.797 20:17:30 -- common/autotest_common.sh@1187 -- # return 0 00:11:58.797 20:17:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:58.797 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.797 20:17:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:58.797 20:17:30 -- common/autotest_common.sh@1198 -- # local i=0 00:11:58.798 20:17:30 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:58.798 20:17:30 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.798 20:17:30 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:58.798 20:17:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.798 20:17:30 -- common/autotest_common.sh@1210 -- # return 0 00:11:58.798 20:17:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:58.798 20:17:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:58.798 20:17:30 -- common/autotest_common.sh@10 -- # set +x 00:11:58.798 20:17:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:58.798 20:17:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:58.798 20:17:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:58.798 20:17:30 -- common/autotest_common.sh@10 -- # set +x 00:11:58.798 20:17:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:58.798 20:17:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:58.798 20:17:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:58.798 20:17:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:58.798 20:17:30 -- common/autotest_common.sh@10 -- # set +x 00:11:59.057 20:17:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.058 20:17:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:59.058 20:17:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.058 20:17:30 -- common/autotest_common.sh@10 -- # set +x 00:11:59.058 [2024-07-22 20:17:30.744816] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:59.058 20:17:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.058 20:17:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:59.058 20:17:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.058 20:17:30 -- common/autotest_common.sh@10 -- # set +x 00:11:59.058 20:17:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.058 20:17:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:59.058 20:17:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.058 20:17:30 -- common/autotest_common.sh@10 -- # set +x 00:11:59.058 20:17:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.058 20:17:30 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:59.996 20:17:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:59.996 20:17:31 -- common/autotest_common.sh@1177 -- # local i=0 00:11:59.996 20:17:31 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:59.996 20:17:31 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:59.996 20:17:31 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:02.088 20:17:33 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:02.088 20:17:33 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:02.088 20:17:33 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:02.088 20:17:33 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:02.088 20:17:33 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:02.088 20:17:33 -- common/autotest_common.sh@1187 -- # return 0 00:12:02.088 20:17:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:02.088 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.088 20:17:33 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:02.088 20:17:33 -- common/autotest_common.sh@1198 -- # local i=0 00:12:02.088 20:17:33 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:02.088 20:17:33 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:02.088 20:17:33 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:02.088 20:17:33 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:02.088 20:17:33 -- common/autotest_common.sh@1210 -- # return 0 00:12:02.088 20:17:33 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:02.088 20:17:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.088 20:17:33 -- common/autotest_common.sh@10 -- # set +x 00:12:02.088 20:17:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.088 20:17:33 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:02.089 20:17:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.089 20:17:33 -- common/autotest_common.sh@10 -- # set +x 00:12:02.089 20:17:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.089 20:17:33 -- target/rpc.sh@99 -- # seq 1 5 00:12:02.089 20:17:33 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:02.089 20:17:33 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:02.089 20:17:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.089 20:17:33 -- common/autotest_common.sh@10 -- # set +x 00:12:02.089 20:17:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.089 20:17:33 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:02.089 20:17:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.089 20:17:33 -- common/autotest_common.sh@10 -- # set +x 00:12:02.089 [2024-07-22 20:17:33.996694] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:02.089 20:17:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.089 20:17:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:02.089 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.089 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.089 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.089 20:17:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:02.089 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.089 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.089 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.089 20:17:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.089 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.089 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.089 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.089 20:17:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:02.089 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.348 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.348 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:02.349 20:17:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 [2024-07-22 20:17:34.044860] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:02.349 20:17:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 [2024-07-22 20:17:34.093019] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:02.349 20:17:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 [2024-07-22 20:17:34.145200] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:02.349 20:17:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 [2024-07-22 20:17:34.193352] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:02.349 20:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.349 20:17:34 -- common/autotest_common.sh@10 -- # set +x 00:12:02.349 20:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.349 20:17:34 -- target/rpc.sh@110 -- # stats='{ 00:12:02.349 "tick_rate": 2300000000, 00:12:02.349 "poll_groups": [ 00:12:02.349 { 00:12:02.349 "name": "nvmf_tgt_poll_group_0", 00:12:02.349 "admin_qpairs": 2, 00:12:02.349 "io_qpairs": 168, 00:12:02.349 "current_admin_qpairs": 0, 00:12:02.349 "current_io_qpairs": 0, 00:12:02.349 "pending_bdev_io": 0, 00:12:02.349 "completed_nvme_io": 261, 00:12:02.349 "transports": [ 00:12:02.349 { 00:12:02.349 "trtype": "TCP" 00:12:02.349 } 00:12:02.349 ] 00:12:02.349 }, 00:12:02.349 { 00:12:02.349 "name": "nvmf_tgt_poll_group_1", 00:12:02.349 "admin_qpairs": 2, 00:12:02.349 "io_qpairs": 168, 00:12:02.349 "current_admin_qpairs": 0, 00:12:02.349 "current_io_qpairs": 0, 00:12:02.349 "pending_bdev_io": 0, 00:12:02.349 "completed_nvme_io": 265, 00:12:02.349 "transports": [ 00:12:02.349 { 00:12:02.349 "trtype": "TCP" 00:12:02.349 } 00:12:02.349 ] 00:12:02.349 }, 00:12:02.349 { 00:12:02.349 "name": "nvmf_tgt_poll_group_2", 00:12:02.349 "admin_qpairs": 1, 00:12:02.349 "io_qpairs": 168, 00:12:02.349 "current_admin_qpairs": 0, 00:12:02.349 "current_io_qpairs": 0, 00:12:02.349 "pending_bdev_io": 0, 00:12:02.349 "completed_nvme_io": 218, 00:12:02.349 "transports": [ 00:12:02.349 { 00:12:02.349 "trtype": "TCP" 00:12:02.349 } 00:12:02.349 ] 00:12:02.349 }, 00:12:02.349 { 00:12:02.349 "name": "nvmf_tgt_poll_group_3", 00:12:02.349 "admin_qpairs": 2, 00:12:02.349 "io_qpairs": 168, 00:12:02.349 "current_admin_qpairs": 0, 00:12:02.349 "current_io_qpairs": 0, 00:12:02.349 "pending_bdev_io": 0, 00:12:02.349 "completed_nvme_io": 278, 00:12:02.350 "transports": [ 00:12:02.350 { 00:12:02.350 "trtype": "TCP" 00:12:02.350 } 00:12:02.350 ] 00:12:02.350 } 00:12:02.350 ] 00:12:02.350 }' 00:12:02.350 20:17:34 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:02.350 20:17:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:02.350 20:17:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:02.350 20:17:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:02.609 20:17:34 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:02.609 20:17:34 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:02.609 20:17:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:02.609 20:17:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:02.609 20:17:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:02.609 20:17:34 -- target/rpc.sh@113 -- # (( 672 > 0 )) 00:12:02.609 20:17:34 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:02.609 20:17:34 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:02.609 20:17:34 -- target/rpc.sh@123 -- # nvmftestfini 00:12:02.609 20:17:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:02.609 20:17:34 -- nvmf/common.sh@116 -- # sync 00:12:02.609 20:17:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:02.609 20:17:34 -- nvmf/common.sh@119 -- # set +e 00:12:02.609 20:17:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:02.609 20:17:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:02.609 rmmod nvme_tcp 00:12:02.609 rmmod nvme_fabrics 00:12:02.609 rmmod nvme_keyring 00:12:02.609 20:17:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:02.609 20:17:34 -- nvmf/common.sh@123 -- # set -e 00:12:02.609 20:17:34 -- nvmf/common.sh@124 -- # return 0 00:12:02.609 20:17:34 -- nvmf/common.sh@477 -- # '[' -n 3321219 ']' 00:12:02.609 20:17:34 -- nvmf/common.sh@478 -- # killprocess 3321219 00:12:02.609 20:17:34 -- common/autotest_common.sh@926 -- # '[' -z 3321219 ']' 00:12:02.609 20:17:34 -- common/autotest_common.sh@930 -- # kill -0 3321219 00:12:02.609 20:17:34 -- common/autotest_common.sh@931 -- # uname 00:12:02.609 20:17:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:02.609 20:17:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3321219 00:12:02.609 20:17:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:02.609 20:17:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:02.609 20:17:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3321219' 00:12:02.609 killing process with pid 3321219 00:12:02.610 20:17:34 -- common/autotest_common.sh@945 -- # kill 3321219 00:12:02.610 20:17:34 -- common/autotest_common.sh@950 -- # wait 3321219 00:12:02.869 20:17:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:02.869 20:17:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:02.869 20:17:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:02.870 20:17:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:02.870 20:17:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:02.870 20:17:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:02.870 20:17:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:02.870 20:17:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:05.408 20:17:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:05.408 00:12:05.408 real 0m32.568s 00:12:05.408 user 1m39.995s 00:12:05.408 sys 0m5.654s 00:12:05.408 20:17:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:05.408 20:17:36 -- common/autotest_common.sh@10 -- # set +x 00:12:05.408 ************************************ 00:12:05.408 END TEST nvmf_rpc 00:12:05.408 ************************************ 00:12:05.408 20:17:36 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:05.408 20:17:36 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:05.408 20:17:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:05.408 20:17:36 -- common/autotest_common.sh@10 -- # set +x 00:12:05.408 ************************************ 00:12:05.408 START TEST nvmf_invalid 00:12:05.408 ************************************ 00:12:05.408 20:17:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:05.408 * Looking for test storage... 00:12:05.408 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:05.408 20:17:36 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:05.408 20:17:36 -- nvmf/common.sh@7 -- # uname -s 00:12:05.408 20:17:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:05.408 20:17:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:05.408 20:17:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:05.408 20:17:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:05.408 20:17:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:05.408 20:17:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:05.408 20:17:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:05.408 20:17:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:05.408 20:17:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:05.408 20:17:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:05.408 20:17:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:12:05.408 20:17:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:12:05.408 20:17:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:05.408 20:17:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:05.408 20:17:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:05.408 20:17:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:05.408 20:17:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:05.408 20:17:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:05.408 20:17:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:05.408 20:17:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.408 20:17:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.408 20:17:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.408 20:17:36 -- paths/export.sh@5 -- # export PATH 00:12:05.408 20:17:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.408 20:17:36 -- nvmf/common.sh@46 -- # : 0 00:12:05.408 20:17:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:05.408 20:17:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:05.408 20:17:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:05.408 20:17:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:05.408 20:17:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:05.408 20:17:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:05.408 20:17:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:05.408 20:17:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:05.408 20:17:36 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:05.408 20:17:36 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:05.408 20:17:36 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:05.408 20:17:36 -- target/invalid.sh@14 -- # target=foobar 00:12:05.408 20:17:36 -- target/invalid.sh@16 -- # RANDOM=0 00:12:05.408 20:17:36 -- target/invalid.sh@34 -- # nvmftestinit 00:12:05.408 20:17:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:05.408 20:17:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:05.408 20:17:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:05.408 20:17:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:05.408 20:17:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:05.408 20:17:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:05.408 20:17:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:05.408 20:17:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:05.408 20:17:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:05.408 20:17:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:05.408 20:17:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:05.408 20:17:36 -- common/autotest_common.sh@10 -- # set +x 00:12:09.602 20:17:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:09.602 20:17:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:09.602 20:17:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:09.602 20:17:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:09.602 20:17:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:09.602 20:17:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:09.602 20:17:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:09.602 20:17:41 -- nvmf/common.sh@294 -- # net_devs=() 00:12:09.602 20:17:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:09.602 20:17:41 -- nvmf/common.sh@295 -- # e810=() 00:12:09.602 20:17:41 -- nvmf/common.sh@295 -- # local -ga e810 00:12:09.602 20:17:41 -- nvmf/common.sh@296 -- # x722=() 00:12:09.602 20:17:41 -- nvmf/common.sh@296 -- # local -ga x722 00:12:09.602 20:17:41 -- nvmf/common.sh@297 -- # mlx=() 00:12:09.602 20:17:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:09.602 20:17:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:09.602 20:17:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:09.602 20:17:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:09.602 20:17:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:09.602 20:17:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:09.602 20:17:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:12:09.602 Found 0000:86:00.0 (0x8086 - 0x159b) 00:12:09.602 20:17:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:09.602 20:17:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:12:09.602 Found 0000:86:00.1 (0x8086 - 0x159b) 00:12:09.602 20:17:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:09.602 20:17:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:09.602 20:17:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:09.603 20:17:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:09.603 20:17:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:09.603 20:17:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:09.603 20:17:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:09.603 20:17:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:09.603 20:17:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:12:09.603 Found net devices under 0000:86:00.0: cvl_0_0 00:12:09.603 20:17:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:09.603 20:17:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:09.603 20:17:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:09.603 20:17:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:09.603 20:17:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:09.603 20:17:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:12:09.603 Found net devices under 0000:86:00.1: cvl_0_1 00:12:09.603 20:17:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:09.603 20:17:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:09.603 20:17:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:09.603 20:17:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:09.603 20:17:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:09.603 20:17:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:09.603 20:17:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:09.603 20:17:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:09.603 20:17:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:09.603 20:17:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:09.603 20:17:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:09.603 20:17:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:09.603 20:17:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:09.603 20:17:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:09.603 20:17:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:09.603 20:17:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:09.603 20:17:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:09.603 20:17:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:09.603 20:17:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:09.862 20:17:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:09.862 20:17:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:09.862 20:17:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:09.862 20:17:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:09.862 20:17:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:09.862 20:17:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:09.862 20:17:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:09.862 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:09.862 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.290 ms 00:12:09.862 00:12:09.862 --- 10.0.0.2 ping statistics --- 00:12:09.862 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:09.862 rtt min/avg/max/mdev = 0.290/0.290/0.290/0.000 ms 00:12:09.862 20:17:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:09.862 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:09.862 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.295 ms 00:12:09.862 00:12:09.862 --- 10.0.0.1 ping statistics --- 00:12:09.862 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:09.862 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:12:09.862 20:17:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:09.862 20:17:41 -- nvmf/common.sh@410 -- # return 0 00:12:09.862 20:17:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:09.862 20:17:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:09.862 20:17:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:09.862 20:17:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:09.862 20:17:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:09.862 20:17:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:09.862 20:17:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:09.862 20:17:41 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:09.862 20:17:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:09.862 20:17:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:09.862 20:17:41 -- common/autotest_common.sh@10 -- # set +x 00:12:09.862 20:17:41 -- nvmf/common.sh@469 -- # nvmfpid=3328898 00:12:09.862 20:17:41 -- nvmf/common.sh@470 -- # waitforlisten 3328898 00:12:09.862 20:17:41 -- common/autotest_common.sh@819 -- # '[' -z 3328898 ']' 00:12:09.862 20:17:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:09.862 20:17:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:09.862 20:17:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:09.862 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:09.862 20:17:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:09.862 20:17:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:09.862 20:17:41 -- common/autotest_common.sh@10 -- # set +x 00:12:10.121 [2024-07-22 20:17:41.833416] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:12:10.122 [2024-07-22 20:17:41.833457] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:10.122 EAL: No free 2048 kB hugepages reported on node 1 00:12:10.122 [2024-07-22 20:17:41.890512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:10.122 [2024-07-22 20:17:41.968843] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:10.122 [2024-07-22 20:17:41.968948] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:10.122 [2024-07-22 20:17:41.968956] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:10.122 [2024-07-22 20:17:41.968963] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:10.122 [2024-07-22 20:17:41.969002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:10.122 [2024-07-22 20:17:41.969102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:10.122 [2024-07-22 20:17:41.969126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:10.122 [2024-07-22 20:17:41.969127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:11.058 20:17:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:11.058 20:17:42 -- common/autotest_common.sh@852 -- # return 0 00:12:11.058 20:17:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:11.058 20:17:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:11.058 20:17:42 -- common/autotest_common.sh@10 -- # set +x 00:12:11.058 20:17:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:11.058 20:17:42 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:11.058 20:17:42 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode23956 00:12:11.058 [2024-07-22 20:17:42.822764] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:11.058 20:17:42 -- target/invalid.sh@40 -- # out='request: 00:12:11.058 { 00:12:11.058 "nqn": "nqn.2016-06.io.spdk:cnode23956", 00:12:11.058 "tgt_name": "foobar", 00:12:11.058 "method": "nvmf_create_subsystem", 00:12:11.058 "req_id": 1 00:12:11.058 } 00:12:11.058 Got JSON-RPC error response 00:12:11.058 response: 00:12:11.058 { 00:12:11.058 "code": -32603, 00:12:11.058 "message": "Unable to find target foobar" 00:12:11.058 }' 00:12:11.058 20:17:42 -- target/invalid.sh@41 -- # [[ request: 00:12:11.058 { 00:12:11.058 "nqn": "nqn.2016-06.io.spdk:cnode23956", 00:12:11.058 "tgt_name": "foobar", 00:12:11.058 "method": "nvmf_create_subsystem", 00:12:11.058 "req_id": 1 00:12:11.058 } 00:12:11.058 Got JSON-RPC error response 00:12:11.058 response: 00:12:11.058 { 00:12:11.058 "code": -32603, 00:12:11.058 "message": "Unable to find target foobar" 00:12:11.058 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:11.058 20:17:42 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:11.058 20:17:42 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode26720 00:12:11.318 [2024-07-22 20:17:43.007452] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26720: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:11.318 20:17:43 -- target/invalid.sh@45 -- # out='request: 00:12:11.318 { 00:12:11.318 "nqn": "nqn.2016-06.io.spdk:cnode26720", 00:12:11.318 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:11.318 "method": "nvmf_create_subsystem", 00:12:11.318 "req_id": 1 00:12:11.318 } 00:12:11.318 Got JSON-RPC error response 00:12:11.318 response: 00:12:11.318 { 00:12:11.318 "code": -32602, 00:12:11.318 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:11.318 }' 00:12:11.318 20:17:43 -- target/invalid.sh@46 -- # [[ request: 00:12:11.318 { 00:12:11.318 "nqn": "nqn.2016-06.io.spdk:cnode26720", 00:12:11.318 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:11.318 "method": "nvmf_create_subsystem", 00:12:11.318 "req_id": 1 00:12:11.318 } 00:12:11.318 Got JSON-RPC error response 00:12:11.318 response: 00:12:11.318 { 00:12:11.318 "code": -32602, 00:12:11.318 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:11.318 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:11.318 20:17:43 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:11.318 20:17:43 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode27059 00:12:11.318 [2024-07-22 20:17:43.192049] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27059: invalid model number 'SPDK_Controller' 00:12:11.318 20:17:43 -- target/invalid.sh@50 -- # out='request: 00:12:11.318 { 00:12:11.318 "nqn": "nqn.2016-06.io.spdk:cnode27059", 00:12:11.318 "model_number": "SPDK_Controller\u001f", 00:12:11.318 "method": "nvmf_create_subsystem", 00:12:11.318 "req_id": 1 00:12:11.318 } 00:12:11.318 Got JSON-RPC error response 00:12:11.318 response: 00:12:11.318 { 00:12:11.318 "code": -32602, 00:12:11.318 "message": "Invalid MN SPDK_Controller\u001f" 00:12:11.318 }' 00:12:11.318 20:17:43 -- target/invalid.sh@51 -- # [[ request: 00:12:11.318 { 00:12:11.318 "nqn": "nqn.2016-06.io.spdk:cnode27059", 00:12:11.318 "model_number": "SPDK_Controller\u001f", 00:12:11.318 "method": "nvmf_create_subsystem", 00:12:11.318 "req_id": 1 00:12:11.318 } 00:12:11.318 Got JSON-RPC error response 00:12:11.318 response: 00:12:11.318 { 00:12:11.318 "code": -32602, 00:12:11.318 "message": "Invalid MN SPDK_Controller\u001f" 00:12:11.318 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:11.318 20:17:43 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:11.318 20:17:43 -- target/invalid.sh@19 -- # local length=21 ll 00:12:11.318 20:17:43 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:11.318 20:17:43 -- target/invalid.sh@21 -- # local chars 00:12:11.318 20:17:43 -- target/invalid.sh@22 -- # local string 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # printf %x 73 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # string+=I 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # printf %x 61 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # string+== 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # printf %x 86 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # string+=V 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # printf %x 36 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # string+='$' 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # printf %x 83 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # string+=S 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.318 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # printf %x 33 00:12:11.318 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+='!' 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 51 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=3 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 44 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=, 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 82 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=R 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 34 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+='"' 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 63 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+='?' 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 57 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=9 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 79 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=O 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 54 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=6 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 116 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x74' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=t 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 106 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=j 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 124 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+='|' 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 75 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=K 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 97 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=a 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 66 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=B 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # printf %x 73 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:11.589 20:17:43 -- target/invalid.sh@25 -- # string+=I 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.589 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.589 20:17:43 -- target/invalid.sh@28 -- # [[ I == \- ]] 00:12:11.589 20:17:43 -- target/invalid.sh@31 -- # echo 'I=V$S!3,R"?9O6tj|KaBI' 00:12:11.589 20:17:43 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'I=V$S!3,R"?9O6tj|KaBI' nqn.2016-06.io.spdk:cnode585 00:12:11.589 [2024-07-22 20:17:43.501093] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode585: invalid serial number 'I=V$S!3,R"?9O6tj|KaBI' 00:12:11.849 20:17:43 -- target/invalid.sh@54 -- # out='request: 00:12:11.849 { 00:12:11.849 "nqn": "nqn.2016-06.io.spdk:cnode585", 00:12:11.849 "serial_number": "I=V$S!3,R\"?9O6tj|KaBI", 00:12:11.849 "method": "nvmf_create_subsystem", 00:12:11.849 "req_id": 1 00:12:11.849 } 00:12:11.849 Got JSON-RPC error response 00:12:11.849 response: 00:12:11.849 { 00:12:11.849 "code": -32602, 00:12:11.849 "message": "Invalid SN I=V$S!3,R\"?9O6tj|KaBI" 00:12:11.849 }' 00:12:11.849 20:17:43 -- target/invalid.sh@55 -- # [[ request: 00:12:11.849 { 00:12:11.849 "nqn": "nqn.2016-06.io.spdk:cnode585", 00:12:11.849 "serial_number": "I=V$S!3,R\"?9O6tj|KaBI", 00:12:11.849 "method": "nvmf_create_subsystem", 00:12:11.849 "req_id": 1 00:12:11.849 } 00:12:11.849 Got JSON-RPC error response 00:12:11.849 response: 00:12:11.849 { 00:12:11.849 "code": -32602, 00:12:11.849 "message": "Invalid SN I=V$S!3,R\"?9O6tj|KaBI" 00:12:11.849 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:11.849 20:17:43 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:11.849 20:17:43 -- target/invalid.sh@19 -- # local length=41 ll 00:12:11.849 20:17:43 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:11.849 20:17:43 -- target/invalid.sh@21 -- # local chars 00:12:11.849 20:17:43 -- target/invalid.sh@22 -- # local string 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 108 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=l 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 51 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=3 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 117 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=u 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 109 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=m 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 107 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=k 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 44 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=, 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 91 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+='[' 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 123 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+='{' 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 46 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=. 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 111 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=o 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 92 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+='\' 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 116 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x74' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=t 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 124 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+='|' 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 102 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=f 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 96 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+='`' 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 58 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # string+=: 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.849 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.849 20:17:43 -- target/invalid.sh@25 -- # printf %x 90 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=Z 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 38 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+='&' 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 90 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=Z 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 73 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=I 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 83 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=S 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 80 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=P 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 34 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+='"' 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 100 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=d 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 103 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=g 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 108 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=l 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 75 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=K 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 119 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=w 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 42 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+='*' 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 102 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=f 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 66 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=B 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 105 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=i 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 76 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=L 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 94 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+='^' 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 72 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=H 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 91 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+='[' 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 51 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=3 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 51 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=3 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 79 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=O 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 50 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=2 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # printf %x 101 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # echo -e '\x65' 00:12:11.850 20:17:43 -- target/invalid.sh@25 -- # string+=e 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:11.850 20:17:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:11.850 20:17:43 -- target/invalid.sh@28 -- # [[ l == \- ]] 00:12:11.850 20:17:43 -- target/invalid.sh@31 -- # echo 'l3umk,[{.o\t|f`:Z&ZISP"dglKw*fBiL^H[33O2e' 00:12:11.850 20:17:43 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'l3umk,[{.o\t|f`:Z&ZISP"dglKw*fBiL^H[33O2e' nqn.2016-06.io.spdk:cnode25723 00:12:12.109 [2024-07-22 20:17:43.934610] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25723: invalid model number 'l3umk,[{.o\t|f`:Z&ZISP"dglKw*fBiL^H[33O2e' 00:12:12.109 20:17:43 -- target/invalid.sh@58 -- # out='request: 00:12:12.109 { 00:12:12.109 "nqn": "nqn.2016-06.io.spdk:cnode25723", 00:12:12.109 "model_number": "l3umk,[{.o\\t|f`:Z&ZISP\"dglKw*fBiL^H[33O2e", 00:12:12.109 "method": "nvmf_create_subsystem", 00:12:12.109 "req_id": 1 00:12:12.109 } 00:12:12.109 Got JSON-RPC error response 00:12:12.109 response: 00:12:12.109 { 00:12:12.109 "code": -32602, 00:12:12.109 "message": "Invalid MN l3umk,[{.o\\t|f`:Z&ZISP\"dglKw*fBiL^H[33O2e" 00:12:12.109 }' 00:12:12.109 20:17:43 -- target/invalid.sh@59 -- # [[ request: 00:12:12.109 { 00:12:12.109 "nqn": "nqn.2016-06.io.spdk:cnode25723", 00:12:12.109 "model_number": "l3umk,[{.o\\t|f`:Z&ZISP\"dglKw*fBiL^H[33O2e", 00:12:12.109 "method": "nvmf_create_subsystem", 00:12:12.109 "req_id": 1 00:12:12.109 } 00:12:12.109 Got JSON-RPC error response 00:12:12.109 response: 00:12:12.109 { 00:12:12.109 "code": -32602, 00:12:12.109 "message": "Invalid MN l3umk,[{.o\\t|f`:Z&ZISP\"dglKw*fBiL^H[33O2e" 00:12:12.109 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:12.109 20:17:43 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:12.369 [2024-07-22 20:17:44.107256] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:12.369 20:17:44 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:12.628 20:17:44 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:12.628 20:17:44 -- target/invalid.sh@67 -- # echo '' 00:12:12.628 20:17:44 -- target/invalid.sh@67 -- # head -n 1 00:12:12.628 20:17:44 -- target/invalid.sh@67 -- # IP= 00:12:12.628 20:17:44 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:12.628 [2024-07-22 20:17:44.468514] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:12.628 20:17:44 -- target/invalid.sh@69 -- # out='request: 00:12:12.629 { 00:12:12.629 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:12.629 "listen_address": { 00:12:12.629 "trtype": "tcp", 00:12:12.629 "traddr": "", 00:12:12.629 "trsvcid": "4421" 00:12:12.629 }, 00:12:12.629 "method": "nvmf_subsystem_remove_listener", 00:12:12.629 "req_id": 1 00:12:12.629 } 00:12:12.629 Got JSON-RPC error response 00:12:12.629 response: 00:12:12.629 { 00:12:12.629 "code": -32602, 00:12:12.629 "message": "Invalid parameters" 00:12:12.629 }' 00:12:12.629 20:17:44 -- target/invalid.sh@70 -- # [[ request: 00:12:12.629 { 00:12:12.629 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:12.629 "listen_address": { 00:12:12.629 "trtype": "tcp", 00:12:12.629 "traddr": "", 00:12:12.629 "trsvcid": "4421" 00:12:12.629 }, 00:12:12.629 "method": "nvmf_subsystem_remove_listener", 00:12:12.629 "req_id": 1 00:12:12.629 } 00:12:12.629 Got JSON-RPC error response 00:12:12.629 response: 00:12:12.629 { 00:12:12.629 "code": -32602, 00:12:12.629 "message": "Invalid parameters" 00:12:12.629 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:12.629 20:17:44 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode32438 -i 0 00:12:12.889 [2024-07-22 20:17:44.645110] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32438: invalid cntlid range [0-65519] 00:12:12.889 20:17:44 -- target/invalid.sh@73 -- # out='request: 00:12:12.889 { 00:12:12.889 "nqn": "nqn.2016-06.io.spdk:cnode32438", 00:12:12.889 "min_cntlid": 0, 00:12:12.889 "method": "nvmf_create_subsystem", 00:12:12.889 "req_id": 1 00:12:12.889 } 00:12:12.889 Got JSON-RPC error response 00:12:12.889 response: 00:12:12.889 { 00:12:12.889 "code": -32602, 00:12:12.889 "message": "Invalid cntlid range [0-65519]" 00:12:12.889 }' 00:12:12.889 20:17:44 -- target/invalid.sh@74 -- # [[ request: 00:12:12.889 { 00:12:12.889 "nqn": "nqn.2016-06.io.spdk:cnode32438", 00:12:12.889 "min_cntlid": 0, 00:12:12.889 "method": "nvmf_create_subsystem", 00:12:12.889 "req_id": 1 00:12:12.889 } 00:12:12.889 Got JSON-RPC error response 00:12:12.889 response: 00:12:12.889 { 00:12:12.889 "code": -32602, 00:12:12.889 "message": "Invalid cntlid range [0-65519]" 00:12:12.889 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:12.889 20:17:44 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode21580 -i 65520 00:12:13.149 [2024-07-22 20:17:44.833749] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21580: invalid cntlid range [65520-65519] 00:12:13.149 20:17:44 -- target/invalid.sh@75 -- # out='request: 00:12:13.149 { 00:12:13.149 "nqn": "nqn.2016-06.io.spdk:cnode21580", 00:12:13.149 "min_cntlid": 65520, 00:12:13.149 "method": "nvmf_create_subsystem", 00:12:13.149 "req_id": 1 00:12:13.149 } 00:12:13.149 Got JSON-RPC error response 00:12:13.149 response: 00:12:13.149 { 00:12:13.149 "code": -32602, 00:12:13.149 "message": "Invalid cntlid range [65520-65519]" 00:12:13.149 }' 00:12:13.149 20:17:44 -- target/invalid.sh@76 -- # [[ request: 00:12:13.149 { 00:12:13.149 "nqn": "nqn.2016-06.io.spdk:cnode21580", 00:12:13.149 "min_cntlid": 65520, 00:12:13.149 "method": "nvmf_create_subsystem", 00:12:13.149 "req_id": 1 00:12:13.149 } 00:12:13.150 Got JSON-RPC error response 00:12:13.150 response: 00:12:13.150 { 00:12:13.150 "code": -32602, 00:12:13.150 "message": "Invalid cntlid range [65520-65519]" 00:12:13.150 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:13.150 20:17:44 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16607 -I 0 00:12:13.150 [2024-07-22 20:17:45.022430] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16607: invalid cntlid range [1-0] 00:12:13.150 20:17:45 -- target/invalid.sh@77 -- # out='request: 00:12:13.150 { 00:12:13.150 "nqn": "nqn.2016-06.io.spdk:cnode16607", 00:12:13.150 "max_cntlid": 0, 00:12:13.150 "method": "nvmf_create_subsystem", 00:12:13.150 "req_id": 1 00:12:13.150 } 00:12:13.150 Got JSON-RPC error response 00:12:13.150 response: 00:12:13.150 { 00:12:13.150 "code": -32602, 00:12:13.150 "message": "Invalid cntlid range [1-0]" 00:12:13.150 }' 00:12:13.150 20:17:45 -- target/invalid.sh@78 -- # [[ request: 00:12:13.150 { 00:12:13.150 "nqn": "nqn.2016-06.io.spdk:cnode16607", 00:12:13.150 "max_cntlid": 0, 00:12:13.150 "method": "nvmf_create_subsystem", 00:12:13.150 "req_id": 1 00:12:13.150 } 00:12:13.150 Got JSON-RPC error response 00:12:13.150 response: 00:12:13.150 { 00:12:13.150 "code": -32602, 00:12:13.150 "message": "Invalid cntlid range [1-0]" 00:12:13.150 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:13.150 20:17:45 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24843 -I 65520 00:12:13.410 [2024-07-22 20:17:45.211071] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24843: invalid cntlid range [1-65520] 00:12:13.410 20:17:45 -- target/invalid.sh@79 -- # out='request: 00:12:13.410 { 00:12:13.410 "nqn": "nqn.2016-06.io.spdk:cnode24843", 00:12:13.410 "max_cntlid": 65520, 00:12:13.410 "method": "nvmf_create_subsystem", 00:12:13.410 "req_id": 1 00:12:13.410 } 00:12:13.410 Got JSON-RPC error response 00:12:13.410 response: 00:12:13.410 { 00:12:13.410 "code": -32602, 00:12:13.410 "message": "Invalid cntlid range [1-65520]" 00:12:13.410 }' 00:12:13.410 20:17:45 -- target/invalid.sh@80 -- # [[ request: 00:12:13.410 { 00:12:13.410 "nqn": "nqn.2016-06.io.spdk:cnode24843", 00:12:13.410 "max_cntlid": 65520, 00:12:13.410 "method": "nvmf_create_subsystem", 00:12:13.410 "req_id": 1 00:12:13.410 } 00:12:13.410 Got JSON-RPC error response 00:12:13.410 response: 00:12:13.410 { 00:12:13.410 "code": -32602, 00:12:13.410 "message": "Invalid cntlid range [1-65520]" 00:12:13.410 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:13.410 20:17:45 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14840 -i 6 -I 5 00:12:13.670 [2024-07-22 20:17:45.383676] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14840: invalid cntlid range [6-5] 00:12:13.670 20:17:45 -- target/invalid.sh@83 -- # out='request: 00:12:13.670 { 00:12:13.670 "nqn": "nqn.2016-06.io.spdk:cnode14840", 00:12:13.670 "min_cntlid": 6, 00:12:13.670 "max_cntlid": 5, 00:12:13.670 "method": "nvmf_create_subsystem", 00:12:13.670 "req_id": 1 00:12:13.670 } 00:12:13.670 Got JSON-RPC error response 00:12:13.670 response: 00:12:13.670 { 00:12:13.670 "code": -32602, 00:12:13.670 "message": "Invalid cntlid range [6-5]" 00:12:13.671 }' 00:12:13.671 20:17:45 -- target/invalid.sh@84 -- # [[ request: 00:12:13.671 { 00:12:13.671 "nqn": "nqn.2016-06.io.spdk:cnode14840", 00:12:13.671 "min_cntlid": 6, 00:12:13.671 "max_cntlid": 5, 00:12:13.671 "method": "nvmf_create_subsystem", 00:12:13.671 "req_id": 1 00:12:13.671 } 00:12:13.671 Got JSON-RPC error response 00:12:13.671 response: 00:12:13.671 { 00:12:13.671 "code": -32602, 00:12:13.671 "message": "Invalid cntlid range [6-5]" 00:12:13.671 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:13.671 20:17:45 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:13.671 20:17:45 -- target/invalid.sh@87 -- # out='request: 00:12:13.671 { 00:12:13.671 "name": "foobar", 00:12:13.671 "method": "nvmf_delete_target", 00:12:13.671 "req_id": 1 00:12:13.671 } 00:12:13.671 Got JSON-RPC error response 00:12:13.671 response: 00:12:13.671 { 00:12:13.671 "code": -32602, 00:12:13.671 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:13.671 }' 00:12:13.671 20:17:45 -- target/invalid.sh@88 -- # [[ request: 00:12:13.671 { 00:12:13.671 "name": "foobar", 00:12:13.671 "method": "nvmf_delete_target", 00:12:13.671 "req_id": 1 00:12:13.671 } 00:12:13.671 Got JSON-RPC error response 00:12:13.671 response: 00:12:13.671 { 00:12:13.671 "code": -32602, 00:12:13.671 "message": "The specified target doesn't exist, cannot delete it." 00:12:13.671 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:13.671 20:17:45 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:13.671 20:17:45 -- target/invalid.sh@91 -- # nvmftestfini 00:12:13.671 20:17:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:13.671 20:17:45 -- nvmf/common.sh@116 -- # sync 00:12:13.671 20:17:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:13.671 20:17:45 -- nvmf/common.sh@119 -- # set +e 00:12:13.671 20:17:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:13.671 20:17:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:13.671 rmmod nvme_tcp 00:12:13.671 rmmod nvme_fabrics 00:12:13.671 rmmod nvme_keyring 00:12:13.671 20:17:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:13.671 20:17:45 -- nvmf/common.sh@123 -- # set -e 00:12:13.671 20:17:45 -- nvmf/common.sh@124 -- # return 0 00:12:13.671 20:17:45 -- nvmf/common.sh@477 -- # '[' -n 3328898 ']' 00:12:13.671 20:17:45 -- nvmf/common.sh@478 -- # killprocess 3328898 00:12:13.671 20:17:45 -- common/autotest_common.sh@926 -- # '[' -z 3328898 ']' 00:12:13.671 20:17:45 -- common/autotest_common.sh@930 -- # kill -0 3328898 00:12:13.671 20:17:45 -- common/autotest_common.sh@931 -- # uname 00:12:13.671 20:17:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:13.671 20:17:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3328898 00:12:13.931 20:17:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:13.931 20:17:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:13.931 20:17:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3328898' 00:12:13.931 killing process with pid 3328898 00:12:13.931 20:17:45 -- common/autotest_common.sh@945 -- # kill 3328898 00:12:13.931 20:17:45 -- common/autotest_common.sh@950 -- # wait 3328898 00:12:13.931 20:17:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:13.931 20:17:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:13.931 20:17:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:13.931 20:17:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:13.931 20:17:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:13.931 20:17:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:13.931 20:17:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:13.931 20:17:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:16.470 20:17:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:16.470 00:12:16.470 real 0m11.119s 00:12:16.470 user 0m18.845s 00:12:16.470 sys 0m4.571s 00:12:16.470 20:17:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:16.470 20:17:47 -- common/autotest_common.sh@10 -- # set +x 00:12:16.470 ************************************ 00:12:16.470 END TEST nvmf_invalid 00:12:16.470 ************************************ 00:12:16.470 20:17:47 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:16.470 20:17:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:16.470 20:17:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:16.470 20:17:47 -- common/autotest_common.sh@10 -- # set +x 00:12:16.470 ************************************ 00:12:16.470 START TEST nvmf_abort 00:12:16.470 ************************************ 00:12:16.470 20:17:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:16.470 * Looking for test storage... 00:12:16.470 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:16.470 20:17:48 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:16.470 20:17:48 -- nvmf/common.sh@7 -- # uname -s 00:12:16.470 20:17:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:16.470 20:17:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:16.470 20:17:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:16.470 20:17:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:16.470 20:17:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:16.470 20:17:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:16.470 20:17:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:16.470 20:17:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:16.470 20:17:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:16.470 20:17:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:16.470 20:17:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:12:16.470 20:17:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:12:16.470 20:17:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:16.470 20:17:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:16.470 20:17:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:16.470 20:17:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:16.471 20:17:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:16.471 20:17:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:16.471 20:17:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:16.471 20:17:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:16.471 20:17:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:16.471 20:17:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:16.471 20:17:48 -- paths/export.sh@5 -- # export PATH 00:12:16.471 20:17:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:16.471 20:17:48 -- nvmf/common.sh@46 -- # : 0 00:12:16.471 20:17:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:16.471 20:17:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:16.471 20:17:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:16.471 20:17:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:16.471 20:17:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:16.471 20:17:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:16.471 20:17:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:16.471 20:17:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:16.471 20:17:48 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:16.471 20:17:48 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:16.471 20:17:48 -- target/abort.sh@14 -- # nvmftestinit 00:12:16.471 20:17:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:16.471 20:17:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:16.471 20:17:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:16.471 20:17:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:16.471 20:17:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:16.471 20:17:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:16.471 20:17:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:16.471 20:17:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:16.471 20:17:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:16.471 20:17:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:16.471 20:17:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:16.471 20:17:48 -- common/autotest_common.sh@10 -- # set +x 00:12:21.834 20:17:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:21.834 20:17:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:21.834 20:17:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:21.834 20:17:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:21.834 20:17:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:21.834 20:17:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:21.835 20:17:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:21.835 20:17:52 -- nvmf/common.sh@294 -- # net_devs=() 00:12:21.835 20:17:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:21.835 20:17:52 -- nvmf/common.sh@295 -- # e810=() 00:12:21.835 20:17:52 -- nvmf/common.sh@295 -- # local -ga e810 00:12:21.835 20:17:52 -- nvmf/common.sh@296 -- # x722=() 00:12:21.835 20:17:52 -- nvmf/common.sh@296 -- # local -ga x722 00:12:21.835 20:17:52 -- nvmf/common.sh@297 -- # mlx=() 00:12:21.835 20:17:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:21.835 20:17:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:21.835 20:17:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:21.835 20:17:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:21.835 20:17:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:21.835 20:17:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:21.835 20:17:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:12:21.835 Found 0000:86:00.0 (0x8086 - 0x159b) 00:12:21.835 20:17:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:21.835 20:17:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:12:21.835 Found 0000:86:00.1 (0x8086 - 0x159b) 00:12:21.835 20:17:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:21.835 20:17:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:21.835 20:17:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:21.835 20:17:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:21.835 20:17:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:21.835 20:17:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:12:21.835 Found net devices under 0000:86:00.0: cvl_0_0 00:12:21.835 20:17:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:21.835 20:17:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:21.835 20:17:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:21.835 20:17:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:21.835 20:17:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:21.835 20:17:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:12:21.835 Found net devices under 0000:86:00.1: cvl_0_1 00:12:21.835 20:17:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:21.835 20:17:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:21.835 20:17:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:21.835 20:17:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:21.835 20:17:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:21.835 20:17:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:21.835 20:17:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:21.835 20:17:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:21.835 20:17:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:21.835 20:17:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:21.835 20:17:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:21.835 20:17:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:21.835 20:17:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:21.835 20:17:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:21.835 20:17:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:21.835 20:17:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:21.835 20:17:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:21.835 20:17:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:21.835 20:17:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:21.835 20:17:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:21.835 20:17:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:21.835 20:17:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:21.835 20:17:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:21.835 20:17:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:21.835 20:17:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:21.835 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:21.835 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:12:21.835 00:12:21.835 --- 10.0.0.2 ping statistics --- 00:12:21.835 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:21.835 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:12:21.835 20:17:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:21.835 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:21.835 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.300 ms 00:12:21.835 00:12:21.835 --- 10.0.0.1 ping statistics --- 00:12:21.835 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:21.835 rtt min/avg/max/mdev = 0.300/0.300/0.300/0.000 ms 00:12:21.835 20:17:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:21.835 20:17:53 -- nvmf/common.sh@410 -- # return 0 00:12:21.835 20:17:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:21.835 20:17:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:21.835 20:17:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:21.835 20:17:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:21.835 20:17:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:21.835 20:17:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:21.835 20:17:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:21.835 20:17:53 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:21.835 20:17:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:21.835 20:17:53 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:21.835 20:17:53 -- common/autotest_common.sh@10 -- # set +x 00:12:21.835 20:17:53 -- nvmf/common.sh@469 -- # nvmfpid=3333096 00:12:21.835 20:17:53 -- nvmf/common.sh@470 -- # waitforlisten 3333096 00:12:21.835 20:17:53 -- common/autotest_common.sh@819 -- # '[' -z 3333096 ']' 00:12:21.835 20:17:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:21.835 20:17:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:21.835 20:17:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:21.835 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:21.835 20:17:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:21.835 20:17:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:21.835 20:17:53 -- common/autotest_common.sh@10 -- # set +x 00:12:21.835 [2024-07-22 20:17:53.230635] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:12:21.835 [2024-07-22 20:17:53.230685] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:21.835 EAL: No free 2048 kB hugepages reported on node 1 00:12:21.835 [2024-07-22 20:17:53.290459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:21.835 [2024-07-22 20:17:53.365682] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:21.835 [2024-07-22 20:17:53.365792] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:21.835 [2024-07-22 20:17:53.365800] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:21.835 [2024-07-22 20:17:53.365807] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:21.835 [2024-07-22 20:17:53.365841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:21.835 [2024-07-22 20:17:53.365860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:21.835 [2024-07-22 20:17:53.365862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:22.095 20:17:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:22.095 20:17:54 -- common/autotest_common.sh@852 -- # return 0 00:12:22.095 20:17:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:22.095 20:17:54 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:22.095 20:17:54 -- common/autotest_common.sh@10 -- # set +x 00:12:22.355 20:17:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:22.355 20:17:54 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:22.355 20:17:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.355 20:17:54 -- common/autotest_common.sh@10 -- # set +x 00:12:22.355 [2024-07-22 20:17:54.070924] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:22.355 20:17:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.355 20:17:54 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:22.355 20:17:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.355 20:17:54 -- common/autotest_common.sh@10 -- # set +x 00:12:22.355 Malloc0 00:12:22.355 20:17:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.355 20:17:54 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:22.355 20:17:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.355 20:17:54 -- common/autotest_common.sh@10 -- # set +x 00:12:22.355 Delay0 00:12:22.355 20:17:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.355 20:17:54 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:22.355 20:17:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.355 20:17:54 -- common/autotest_common.sh@10 -- # set +x 00:12:22.355 20:17:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.355 20:17:54 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:22.355 20:17:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.355 20:17:54 -- common/autotest_common.sh@10 -- # set +x 00:12:22.355 20:17:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.355 20:17:54 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:22.355 20:17:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.355 20:17:54 -- common/autotest_common.sh@10 -- # set +x 00:12:22.355 [2024-07-22 20:17:54.130901] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.355 20:17:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.356 20:17:54 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:22.356 20:17:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.356 20:17:54 -- common/autotest_common.sh@10 -- # set +x 00:12:22.356 20:17:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.356 20:17:54 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:22.356 EAL: No free 2048 kB hugepages reported on node 1 00:12:22.356 [2024-07-22 20:17:54.236842] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:24.895 Initializing NVMe Controllers 00:12:24.895 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:24.895 controller IO queue size 128 less than required 00:12:24.895 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:24.895 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:24.896 Initialization complete. Launching workers. 00:12:24.896 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 41781 00:12:24.896 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 41842, failed to submit 62 00:12:24.896 success 41781, unsuccess 61, failed 0 00:12:24.896 20:17:56 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:24.896 20:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:24.896 20:17:56 -- common/autotest_common.sh@10 -- # set +x 00:12:24.896 20:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:24.896 20:17:56 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:24.896 20:17:56 -- target/abort.sh@38 -- # nvmftestfini 00:12:24.896 20:17:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:24.896 20:17:56 -- nvmf/common.sh@116 -- # sync 00:12:24.896 20:17:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:24.896 20:17:56 -- nvmf/common.sh@119 -- # set +e 00:12:24.896 20:17:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:24.896 20:17:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:24.896 rmmod nvme_tcp 00:12:24.896 rmmod nvme_fabrics 00:12:24.896 rmmod nvme_keyring 00:12:24.896 20:17:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:24.896 20:17:56 -- nvmf/common.sh@123 -- # set -e 00:12:24.896 20:17:56 -- nvmf/common.sh@124 -- # return 0 00:12:24.896 20:17:56 -- nvmf/common.sh@477 -- # '[' -n 3333096 ']' 00:12:24.896 20:17:56 -- nvmf/common.sh@478 -- # killprocess 3333096 00:12:24.896 20:17:56 -- common/autotest_common.sh@926 -- # '[' -z 3333096 ']' 00:12:24.896 20:17:56 -- common/autotest_common.sh@930 -- # kill -0 3333096 00:12:24.896 20:17:56 -- common/autotest_common.sh@931 -- # uname 00:12:24.896 20:17:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:24.896 20:17:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3333096 00:12:24.896 20:17:56 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:12:24.896 20:17:56 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:12:24.896 20:17:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3333096' 00:12:24.896 killing process with pid 3333096 00:12:24.896 20:17:56 -- common/autotest_common.sh@945 -- # kill 3333096 00:12:24.896 20:17:56 -- common/autotest_common.sh@950 -- # wait 3333096 00:12:24.896 20:17:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:24.896 20:17:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:24.896 20:17:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:24.896 20:17:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:24.896 20:17:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:24.896 20:17:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:24.896 20:17:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:24.896 20:17:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:26.805 20:17:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:26.805 00:12:26.805 real 0m10.787s 00:12:26.805 user 0m12.842s 00:12:26.805 sys 0m4.831s 00:12:26.805 20:17:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:26.805 20:17:58 -- common/autotest_common.sh@10 -- # set +x 00:12:26.805 ************************************ 00:12:26.805 END TEST nvmf_abort 00:12:26.805 ************************************ 00:12:27.065 20:17:58 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:27.065 20:17:58 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:27.065 20:17:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:27.065 20:17:58 -- common/autotest_common.sh@10 -- # set +x 00:12:27.065 ************************************ 00:12:27.065 START TEST nvmf_ns_hotplug_stress 00:12:27.065 ************************************ 00:12:27.065 20:17:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:27.065 * Looking for test storage... 00:12:27.065 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:27.065 20:17:58 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:27.065 20:17:58 -- nvmf/common.sh@7 -- # uname -s 00:12:27.065 20:17:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:27.065 20:17:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:27.065 20:17:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:27.065 20:17:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:27.065 20:17:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:27.065 20:17:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:27.065 20:17:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:27.065 20:17:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:27.065 20:17:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:27.065 20:17:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:27.065 20:17:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:12:27.065 20:17:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:12:27.065 20:17:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:27.065 20:17:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:27.065 20:17:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:27.065 20:17:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:27.065 20:17:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:27.065 20:17:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:27.065 20:17:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:27.065 20:17:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.065 20:17:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.065 20:17:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.065 20:17:58 -- paths/export.sh@5 -- # export PATH 00:12:27.065 20:17:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.065 20:17:58 -- nvmf/common.sh@46 -- # : 0 00:12:27.065 20:17:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:27.065 20:17:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:27.065 20:17:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:27.065 20:17:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:27.065 20:17:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:27.065 20:17:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:27.065 20:17:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:27.065 20:17:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:27.065 20:17:58 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:27.065 20:17:58 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:27.065 20:17:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:27.065 20:17:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:27.065 20:17:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:27.065 20:17:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:27.065 20:17:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:27.065 20:17:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:27.065 20:17:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:27.065 20:17:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.065 20:17:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:27.065 20:17:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:27.065 20:17:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:27.065 20:17:58 -- common/autotest_common.sh@10 -- # set +x 00:12:32.346 20:18:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:32.347 20:18:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:32.347 20:18:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:32.347 20:18:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:32.347 20:18:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:32.347 20:18:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:32.347 20:18:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:32.347 20:18:03 -- nvmf/common.sh@294 -- # net_devs=() 00:12:32.347 20:18:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:32.347 20:18:03 -- nvmf/common.sh@295 -- # e810=() 00:12:32.347 20:18:03 -- nvmf/common.sh@295 -- # local -ga e810 00:12:32.347 20:18:03 -- nvmf/common.sh@296 -- # x722=() 00:12:32.347 20:18:03 -- nvmf/common.sh@296 -- # local -ga x722 00:12:32.347 20:18:03 -- nvmf/common.sh@297 -- # mlx=() 00:12:32.347 20:18:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:32.347 20:18:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:32.347 20:18:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:32.347 20:18:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:32.347 20:18:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:32.347 20:18:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:32.347 20:18:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:12:32.347 Found 0000:86:00.0 (0x8086 - 0x159b) 00:12:32.347 20:18:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:32.347 20:18:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:12:32.347 Found 0000:86:00.1 (0x8086 - 0x159b) 00:12:32.347 20:18:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:32.347 20:18:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:32.347 20:18:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.347 20:18:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:32.347 20:18:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.347 20:18:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:12:32.347 Found net devices under 0000:86:00.0: cvl_0_0 00:12:32.347 20:18:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.347 20:18:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:32.347 20:18:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.347 20:18:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:32.347 20:18:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.347 20:18:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:12:32.347 Found net devices under 0000:86:00.1: cvl_0_1 00:12:32.347 20:18:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.347 20:18:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:32.347 20:18:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:32.347 20:18:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:32.347 20:18:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:32.347 20:18:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:32.347 20:18:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:32.347 20:18:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:32.347 20:18:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:32.347 20:18:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:32.347 20:18:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:32.347 20:18:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:32.347 20:18:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:32.347 20:18:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:32.347 20:18:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:32.347 20:18:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:32.347 20:18:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:32.347 20:18:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:32.347 20:18:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:32.347 20:18:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:32.347 20:18:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:32.347 20:18:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:32.347 20:18:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:32.347 20:18:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:32.347 20:18:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:32.347 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:32.347 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:12:32.347 00:12:32.347 --- 10.0.0.2 ping statistics --- 00:12:32.347 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:32.347 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:12:32.347 20:18:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:32.347 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:32.347 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.379 ms 00:12:32.347 00:12:32.347 --- 10.0.0.1 ping statistics --- 00:12:32.347 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:32.347 rtt min/avg/max/mdev = 0.379/0.379/0.379/0.000 ms 00:12:32.347 20:18:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:32.347 20:18:04 -- nvmf/common.sh@410 -- # return 0 00:12:32.347 20:18:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:32.347 20:18:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:32.347 20:18:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:32.347 20:18:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:32.347 20:18:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:32.347 20:18:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:32.347 20:18:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:32.347 20:18:04 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:32.347 20:18:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:32.347 20:18:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:32.347 20:18:04 -- common/autotest_common.sh@10 -- # set +x 00:12:32.607 20:18:04 -- nvmf/common.sh@469 -- # nvmfpid=3337250 00:12:32.608 20:18:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:32.608 20:18:04 -- nvmf/common.sh@470 -- # waitforlisten 3337250 00:12:32.608 20:18:04 -- common/autotest_common.sh@819 -- # '[' -z 3337250 ']' 00:12:32.608 20:18:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:32.608 20:18:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:32.608 20:18:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:32.608 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:32.608 20:18:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:32.608 20:18:04 -- common/autotest_common.sh@10 -- # set +x 00:12:32.608 [2024-07-22 20:18:04.330353] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:12:32.608 [2024-07-22 20:18:04.330399] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:32.608 EAL: No free 2048 kB hugepages reported on node 1 00:12:32.608 [2024-07-22 20:18:04.388411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:32.608 [2024-07-22 20:18:04.467024] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:32.608 [2024-07-22 20:18:04.467137] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:32.608 [2024-07-22 20:18:04.467145] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:32.608 [2024-07-22 20:18:04.467152] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:32.608 [2024-07-22 20:18:04.467184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:32.608 [2024-07-22 20:18:04.467267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:32.608 [2024-07-22 20:18:04.467269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:33.547 20:18:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:33.547 20:18:05 -- common/autotest_common.sh@852 -- # return 0 00:12:33.547 20:18:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:33.547 20:18:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:33.547 20:18:05 -- common/autotest_common.sh@10 -- # set +x 00:12:33.547 20:18:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:33.547 20:18:05 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:33.547 20:18:05 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:33.547 [2024-07-22 20:18:05.320593] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:33.547 20:18:05 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:33.807 20:18:05 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:33.807 [2024-07-22 20:18:05.685962] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:33.807 20:18:05 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:34.066 20:18:05 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:34.326 Malloc0 00:12:34.326 20:18:06 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:34.326 Delay0 00:12:34.585 20:18:06 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.585 20:18:06 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:34.845 NULL1 00:12:34.845 20:18:06 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:35.105 20:18:06 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3337743 00:12:35.105 20:18:06 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:35.105 20:18:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:35.105 20:18:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.105 EAL: No free 2048 kB hugepages reported on node 1 00:12:35.105 20:18:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.364 20:18:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:35.364 20:18:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:35.624 true 00:12:35.624 20:18:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:35.624 20:18:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.624 20:18:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.884 20:18:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:35.884 20:18:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:36.144 true 00:12:36.144 20:18:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:36.144 20:18:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.403 20:18:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.403 20:18:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:36.403 20:18:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:36.676 true 00:12:36.676 20:18:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:36.676 20:18:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.943 20:18:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.202 20:18:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:37.202 20:18:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:37.202 true 00:12:37.202 20:18:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:37.202 20:18:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.462 20:18:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.721 20:18:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:37.721 20:18:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:37.721 true 00:12:37.721 20:18:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:37.721 20:18:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.981 20:18:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.241 20:18:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:38.241 20:18:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:38.241 true 00:12:38.241 20:18:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:38.241 20:18:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.500 20:18:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.759 20:18:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:38.759 20:18:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:39.018 true 00:12:39.018 20:18:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:39.018 20:18:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.018 20:18:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.278 20:18:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:39.278 20:18:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:39.538 true 00:12:39.538 20:18:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:39.538 20:18:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.798 20:18:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.057 20:18:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:40.057 20:18:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:40.057 true 00:12:40.057 20:18:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:40.057 20:18:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.316 20:18:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.575 20:18:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:40.575 20:18:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:40.575 true 00:12:40.575 20:18:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:40.575 20:18:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.835 20:18:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.117 20:18:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:41.117 20:18:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:41.427 true 00:12:41.427 20:18:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:41.427 20:18:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.428 20:18:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.686 20:18:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:41.686 20:18:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:41.686 true 00:12:41.945 20:18:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:41.945 20:18:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.945 20:18:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.203 20:18:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:42.203 20:18:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:42.462 true 00:12:42.462 20:18:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:42.462 20:18:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.721 20:18:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.721 20:18:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:42.721 20:18:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:42.980 true 00:12:42.980 20:18:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:42.980 20:18:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.239 20:18:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.498 20:18:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:43.498 20:18:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:43.498 true 00:12:43.498 20:18:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:43.498 20:18:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.758 20:18:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.017 20:18:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:44.017 20:18:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:44.017 true 00:12:44.276 20:18:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:44.276 20:18:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.276 20:18:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.535 20:18:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:44.535 20:18:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:44.794 true 00:12:44.794 20:18:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:44.794 20:18:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.794 20:18:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.053 20:18:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:45.053 20:18:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:45.312 true 00:12:45.312 20:18:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:45.312 20:18:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.570 20:18:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.570 20:18:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:45.570 20:18:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:45.829 true 00:12:45.829 20:18:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:45.829 20:18:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.087 20:18:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.087 20:18:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:46.087 20:18:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:46.346 true 00:12:46.346 20:18:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:46.346 20:18:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.605 20:18:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.864 20:18:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:46.864 20:18:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:46.864 true 00:12:46.864 20:18:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:46.864 20:18:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.123 20:18:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.382 20:18:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:47.382 20:18:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:47.382 true 00:12:47.640 20:18:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:47.640 20:18:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.641 20:18:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.899 20:18:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:47.899 20:18:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:48.158 true 00:12:48.158 20:18:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:48.158 20:18:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.158 20:18:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.417 20:18:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:48.417 20:18:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:48.676 true 00:12:48.676 20:18:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:48.676 20:18:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.935 20:18:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.935 20:18:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:48.935 20:18:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:49.193 true 00:12:49.193 20:18:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:49.193 20:18:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.452 20:18:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.711 20:18:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:49.711 20:18:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:49.711 true 00:12:49.711 20:18:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:49.711 20:18:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.970 20:18:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.229 20:18:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:12:50.229 20:18:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:50.229 true 00:12:50.229 20:18:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:50.229 20:18:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.488 20:18:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.747 20:18:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:12:50.747 20:18:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:51.005 true 00:12:51.005 20:18:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:51.005 20:18:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.005 20:18:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.264 20:18:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:12:51.264 20:18:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:51.522 true 00:12:51.522 20:18:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:51.522 20:18:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.840 20:18:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.840 20:18:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:12:51.840 20:18:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:12:52.100 true 00:12:52.100 20:18:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:52.100 20:18:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.358 20:18:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.358 20:18:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1031 00:12:52.358 20:18:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1031 00:12:52.616 true 00:12:52.616 20:18:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:52.616 20:18:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.874 20:18:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.132 20:18:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1032 00:12:53.132 20:18:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1032 00:12:53.132 true 00:12:53.132 20:18:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:53.132 20:18:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.391 20:18:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.650 20:18:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1033 00:12:53.650 20:18:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1033 00:12:53.650 true 00:12:53.650 20:18:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:53.650 20:18:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.908 20:18:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.167 20:18:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1034 00:12:54.167 20:18:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1034 00:12:54.426 true 00:12:54.426 20:18:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:54.426 20:18:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.685 20:18:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.685 20:18:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1035 00:12:54.685 20:18:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1035 00:12:54.943 true 00:12:54.943 20:18:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:54.943 20:18:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.202 20:18:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.461 20:18:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1036 00:12:55.461 20:18:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1036 00:12:55.461 true 00:12:55.461 20:18:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:55.461 20:18:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.719 20:18:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.977 20:18:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1037 00:12:55.977 20:18:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1037 00:12:55.977 true 00:12:55.977 20:18:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:55.977 20:18:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.235 20:18:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.494 20:18:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1038 00:12:56.494 20:18:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1038 00:12:56.753 true 00:12:56.753 20:18:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:56.753 20:18:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.753 20:18:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.069 20:18:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1039 00:12:57.069 20:18:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1039 00:12:57.339 true 00:12:57.339 20:18:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:57.339 20:18:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.339 20:18:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.598 20:18:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1040 00:12:57.598 20:18:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1040 00:12:57.857 true 00:12:57.857 20:18:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:57.857 20:18:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.857 20:18:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.117 20:18:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1041 00:12:58.117 20:18:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1041 00:12:58.377 true 00:12:58.377 20:18:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:58.377 20:18:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.635 20:18:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.635 20:18:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1042 00:12:58.635 20:18:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1042 00:12:58.894 true 00:12:58.894 20:18:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:58.894 20:18:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.153 20:18:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.412 20:18:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1043 00:12:59.412 20:18:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1043 00:12:59.412 true 00:12:59.412 20:18:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:59.412 20:18:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.672 20:18:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.931 20:18:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1044 00:12:59.931 20:18:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1044 00:12:59.931 true 00:12:59.931 20:18:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:12:59.931 20:18:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.190 20:18:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.450 20:18:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1045 00:13:00.450 20:18:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1045 00:13:00.450 true 00:13:00.709 20:18:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:00.709 20:18:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.709 20:18:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.968 20:18:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1046 00:13:00.968 20:18:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1046 00:13:01.226 true 00:13:01.226 20:18:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:01.226 20:18:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.226 20:18:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.485 20:18:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1047 00:13:01.485 20:18:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1047 00:13:01.744 true 00:13:01.744 20:18:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:01.744 20:18:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.004 20:18:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.004 20:18:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1048 00:13:02.004 20:18:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1048 00:13:02.264 true 00:13:02.264 20:18:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:02.264 20:18:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.523 20:18:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.523 20:18:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1049 00:13:02.781 20:18:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1049 00:13:02.781 true 00:13:02.781 20:18:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:02.781 20:18:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.041 20:18:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.300 20:18:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1050 00:13:03.300 20:18:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1050 00:13:03.300 true 00:13:03.300 20:18:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:03.300 20:18:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.559 20:18:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.818 20:18:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1051 00:13:03.818 20:18:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1051 00:13:03.818 true 00:13:04.077 20:18:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:04.077 20:18:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.077 20:18:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.336 20:18:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1052 00:13:04.336 20:18:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1052 00:13:04.596 true 00:13:04.596 20:18:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:04.596 20:18:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.596 20:18:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.856 20:18:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1053 00:13:04.856 20:18:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1053 00:13:05.116 true 00:13:05.116 20:18:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:05.116 20:18:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.375 20:18:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.375 Initializing NVMe Controllers 00:13:05.375 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:05.375 Controller SPDK bdev Controller (SPDK00000000000001 ): Skipping inactive NS 1 00:13:05.375 Controller IO queue size 128, less than required. 00:13:05.375 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:05.375 WARNING: Some requested NVMe devices were skipped 00:13:05.375 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:05.375 Initialization complete. Launching workers. 00:13:05.375 ======================================================== 00:13:05.375 Latency(us) 00:13:05.375 Device Information : IOPS MiB/s Average min max 00:13:05.375 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 29100.17 14.21 4398.53 2049.45 10758.36 00:13:05.375 ======================================================== 00:13:05.375 Total : 29100.17 14.21 4398.53 2049.45 10758.36 00:13:05.375 00:13:05.375 20:18:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1054 00:13:05.375 20:18:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1054 00:13:05.635 true 00:13:05.635 20:18:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3337743 00:13:05.635 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3337743) - No such process 00:13:05.635 20:18:37 -- target/ns_hotplug_stress.sh@53 -- # wait 3337743 00:13:05.635 20:18:37 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.894 20:18:37 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:05.894 20:18:37 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:05.894 20:18:37 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:05.894 20:18:37 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:05.894 20:18:37 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.894 20:18:37 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:06.154 null0 00:13:06.154 20:18:37 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.154 20:18:37 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.154 20:18:37 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:06.414 null1 00:13:06.414 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.414 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.414 20:18:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:06.414 null2 00:13:06.414 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.414 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.414 20:18:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:06.673 null3 00:13:06.673 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.673 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.673 20:18:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:06.932 null4 00:13:06.932 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.932 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.932 20:18:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:06.932 null5 00:13:07.191 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.191 20:18:38 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.191 20:18:38 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:07.191 null6 00:13:07.191 20:18:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.191 20:18:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.191 20:18:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:07.451 null7 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.451 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@66 -- # wait 3343806 3343808 3343811 3343814 3343817 3343820 3343824 3343826 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.452 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.711 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:07.970 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:07.970 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.970 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:07.970 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:07.970 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:07.970 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:07.970 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:07.970 20:18:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.228 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.228 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.228 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.229 20:18:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:08.229 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:08.229 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.488 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:08.748 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.748 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:08.748 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:08.748 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:08.748 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:08.748 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:08.748 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.748 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.007 20:18:40 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.008 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.008 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.008 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.008 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:09.008 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.008 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.008 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.008 20:18:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.267 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.527 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.787 20:18:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.047 20:18:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.306 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.307 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.644 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.903 20:18:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:11.163 20:18:42 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:11.163 20:18:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:11.163 20:18:42 -- nvmf/common.sh@116 -- # sync 00:13:11.163 20:18:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:11.163 20:18:42 -- nvmf/common.sh@119 -- # set +e 00:13:11.163 20:18:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:11.163 20:18:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:11.163 rmmod nvme_tcp 00:13:11.163 rmmod nvme_fabrics 00:13:11.163 rmmod nvme_keyring 00:13:11.163 20:18:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:11.163 20:18:42 -- nvmf/common.sh@123 -- # set -e 00:13:11.163 20:18:42 -- nvmf/common.sh@124 -- # return 0 00:13:11.163 20:18:42 -- nvmf/common.sh@477 -- # '[' -n 3337250 ']' 00:13:11.163 20:18:42 -- nvmf/common.sh@478 -- # killprocess 3337250 00:13:11.163 20:18:42 -- common/autotest_common.sh@926 -- # '[' -z 3337250 ']' 00:13:11.163 20:18:42 -- common/autotest_common.sh@930 -- # kill -0 3337250 00:13:11.163 20:18:42 -- common/autotest_common.sh@931 -- # uname 00:13:11.163 20:18:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:11.163 20:18:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3337250 00:13:11.163 20:18:43 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:11.163 20:18:43 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:11.163 20:18:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3337250' 00:13:11.163 killing process with pid 3337250 00:13:11.163 20:18:43 -- common/autotest_common.sh@945 -- # kill 3337250 00:13:11.163 20:18:43 -- common/autotest_common.sh@950 -- # wait 3337250 00:13:11.422 20:18:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:11.422 20:18:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:11.422 20:18:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:11.422 20:18:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:11.422 20:18:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:11.422 20:18:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:11.422 20:18:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:11.422 20:18:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:13.971 20:18:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:13.971 00:13:13.971 real 0m46.564s 00:13:13.971 user 3m16.399s 00:13:13.971 sys 0m17.305s 00:13:13.971 20:18:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:13.971 20:18:45 -- common/autotest_common.sh@10 -- # set +x 00:13:13.971 ************************************ 00:13:13.971 END TEST nvmf_ns_hotplug_stress 00:13:13.971 ************************************ 00:13:13.971 20:18:45 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:13.971 20:18:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:13.971 20:18:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:13.971 20:18:45 -- common/autotest_common.sh@10 -- # set +x 00:13:13.971 ************************************ 00:13:13.971 START TEST nvmf_connect_stress 00:13:13.971 ************************************ 00:13:13.971 20:18:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:13.971 * Looking for test storage... 00:13:13.971 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:13.971 20:18:45 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:13.971 20:18:45 -- nvmf/common.sh@7 -- # uname -s 00:13:13.971 20:18:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:13.971 20:18:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:13.971 20:18:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:13.971 20:18:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:13.971 20:18:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:13.971 20:18:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:13.971 20:18:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:13.971 20:18:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:13.971 20:18:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:13.971 20:18:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:13.971 20:18:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:13:13.971 20:18:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:13:13.971 20:18:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:13.971 20:18:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:13.971 20:18:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:13.972 20:18:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:13.972 20:18:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:13.972 20:18:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:13.972 20:18:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:13.972 20:18:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:13.972 20:18:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:13.972 20:18:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:13.972 20:18:45 -- paths/export.sh@5 -- # export PATH 00:13:13.972 20:18:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:13.972 20:18:45 -- nvmf/common.sh@46 -- # : 0 00:13:13.972 20:18:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:13.972 20:18:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:13.972 20:18:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:13.972 20:18:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:13.972 20:18:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:13.972 20:18:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:13.972 20:18:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:13.972 20:18:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:13.972 20:18:45 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:13.972 20:18:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:13.972 20:18:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:13.972 20:18:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:13.972 20:18:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:13.972 20:18:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:13.972 20:18:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:13.972 20:18:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:13.972 20:18:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:13.972 20:18:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:13.972 20:18:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:13.972 20:18:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:13.972 20:18:45 -- common/autotest_common.sh@10 -- # set +x 00:13:18.206 20:18:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:18.206 20:18:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:18.206 20:18:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:18.206 20:18:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:18.206 20:18:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:18.206 20:18:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:18.206 20:18:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:18.206 20:18:49 -- nvmf/common.sh@294 -- # net_devs=() 00:13:18.206 20:18:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:18.206 20:18:49 -- nvmf/common.sh@295 -- # e810=() 00:13:18.206 20:18:49 -- nvmf/common.sh@295 -- # local -ga e810 00:13:18.206 20:18:49 -- nvmf/common.sh@296 -- # x722=() 00:13:18.206 20:18:49 -- nvmf/common.sh@296 -- # local -ga x722 00:13:18.206 20:18:49 -- nvmf/common.sh@297 -- # mlx=() 00:13:18.206 20:18:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:18.206 20:18:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:18.206 20:18:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:18.206 20:18:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:18.206 20:18:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:18.206 20:18:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:18.206 20:18:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:13:18.206 Found 0000:86:00.0 (0x8086 - 0x159b) 00:13:18.206 20:18:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:18.206 20:18:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:13:18.206 Found 0000:86:00.1 (0x8086 - 0x159b) 00:13:18.206 20:18:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:18.206 20:18:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:18.206 20:18:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:18.206 20:18:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:18.206 20:18:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:18.206 20:18:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:13:18.206 Found net devices under 0000:86:00.0: cvl_0_0 00:13:18.206 20:18:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:18.206 20:18:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:18.206 20:18:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:18.206 20:18:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:18.206 20:18:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:18.206 20:18:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:13:18.206 Found net devices under 0000:86:00.1: cvl_0_1 00:13:18.206 20:18:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:18.206 20:18:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:18.206 20:18:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:18.206 20:18:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:18.206 20:18:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:18.206 20:18:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:18.206 20:18:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:18.206 20:18:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:18.206 20:18:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:18.206 20:18:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:18.206 20:18:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:18.206 20:18:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:18.206 20:18:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:18.206 20:18:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:18.206 20:18:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:18.206 20:18:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:18.206 20:18:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:18.206 20:18:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:18.206 20:18:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:18.206 20:18:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:18.206 20:18:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:18.206 20:18:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:18.467 20:18:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:18.467 20:18:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:18.467 20:18:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:18.467 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:18.467 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:13:18.467 00:13:18.467 --- 10.0.0.2 ping statistics --- 00:13:18.467 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:18.467 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:13:18.467 20:18:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:18.467 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:18.467 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.301 ms 00:13:18.467 00:13:18.467 --- 10.0.0.1 ping statistics --- 00:13:18.467 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:18.467 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:13:18.467 20:18:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:18.467 20:18:50 -- nvmf/common.sh@410 -- # return 0 00:13:18.467 20:18:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:18.467 20:18:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:18.467 20:18:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:18.467 20:18:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:18.467 20:18:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:18.467 20:18:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:18.467 20:18:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:18.467 20:18:50 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:18.467 20:18:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:18.467 20:18:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:18.467 20:18:50 -- common/autotest_common.sh@10 -- # set +x 00:13:18.467 20:18:50 -- nvmf/common.sh@469 -- # nvmfpid=3347900 00:13:18.467 20:18:50 -- nvmf/common.sh@470 -- # waitforlisten 3347900 00:13:18.467 20:18:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:18.467 20:18:50 -- common/autotest_common.sh@819 -- # '[' -z 3347900 ']' 00:13:18.467 20:18:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:18.467 20:18:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:18.467 20:18:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:18.467 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:18.467 20:18:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:18.467 20:18:50 -- common/autotest_common.sh@10 -- # set +x 00:13:18.467 [2024-07-22 20:18:50.262412] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:13:18.467 [2024-07-22 20:18:50.262452] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:18.467 EAL: No free 2048 kB hugepages reported on node 1 00:13:18.467 [2024-07-22 20:18:50.320479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:18.467 [2024-07-22 20:18:50.398816] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:18.467 [2024-07-22 20:18:50.398924] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:18.467 [2024-07-22 20:18:50.398931] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:18.467 [2024-07-22 20:18:50.398938] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:18.467 [2024-07-22 20:18:50.398975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:18.467 [2024-07-22 20:18:50.399077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:18.467 [2024-07-22 20:18:50.399079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:19.406 20:18:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:19.406 20:18:51 -- common/autotest_common.sh@852 -- # return 0 00:13:19.406 20:18:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:19.406 20:18:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:19.406 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:13:19.406 20:18:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:19.406 20:18:51 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:19.406 20:18:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:19.406 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:13:19.406 [2024-07-22 20:18:51.120179] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:19.406 20:18:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:19.406 20:18:51 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:19.406 20:18:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:19.406 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:13:19.406 20:18:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:19.406 20:18:51 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:19.406 20:18:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:19.406 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:13:19.406 [2024-07-22 20:18:51.153147] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:19.406 20:18:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:19.406 20:18:51 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:19.406 20:18:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:19.406 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:13:19.406 NULL1 00:13:19.406 20:18:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:19.406 20:18:51 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:19.406 20:18:51 -- target/connect_stress.sh@21 -- # PERF_PID=3348086 00:13:19.406 20:18:51 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:19.406 20:18:51 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 EAL: No free 2048 kB hugepages reported on node 1 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.406 20:18:51 -- target/connect_stress.sh@28 -- # cat 00:13:19.406 20:18:51 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:19.406 20:18:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.406 20:18:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:19.406 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:13:19.666 20:18:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:19.666 20:18:51 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:19.666 20:18:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.666 20:18:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:19.666 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:13:20.235 20:18:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:20.235 20:18:51 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:20.235 20:18:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.235 20:18:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:20.235 20:18:51 -- common/autotest_common.sh@10 -- # set +x 00:13:20.494 20:18:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:20.494 20:18:52 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:20.494 20:18:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.494 20:18:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:20.494 20:18:52 -- common/autotest_common.sh@10 -- # set +x 00:13:20.754 20:18:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:20.754 20:18:52 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:20.754 20:18:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.754 20:18:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:20.754 20:18:52 -- common/autotest_common.sh@10 -- # set +x 00:13:21.013 20:18:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.013 20:18:52 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:21.013 20:18:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.013 20:18:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.013 20:18:52 -- common/autotest_common.sh@10 -- # set +x 00:13:21.272 20:18:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.272 20:18:53 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:21.272 20:18:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.272 20:18:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.272 20:18:53 -- common/autotest_common.sh@10 -- # set +x 00:13:21.853 20:18:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.853 20:18:53 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:21.853 20:18:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.853 20:18:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.853 20:18:53 -- common/autotest_common.sh@10 -- # set +x 00:13:22.112 20:18:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.112 20:18:53 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:22.112 20:18:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.112 20:18:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.112 20:18:53 -- common/autotest_common.sh@10 -- # set +x 00:13:22.372 20:18:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.372 20:18:54 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:22.372 20:18:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.372 20:18:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.372 20:18:54 -- common/autotest_common.sh@10 -- # set +x 00:13:22.632 20:18:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.632 20:18:54 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:22.632 20:18:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.632 20:18:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.632 20:18:54 -- common/autotest_common.sh@10 -- # set +x 00:13:22.891 20:18:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.891 20:18:54 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:22.891 20:18:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.891 20:18:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.891 20:18:54 -- common/autotest_common.sh@10 -- # set +x 00:13:23.460 20:18:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:23.460 20:18:55 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:23.460 20:18:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.460 20:18:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:23.460 20:18:55 -- common/autotest_common.sh@10 -- # set +x 00:13:23.720 20:18:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:23.720 20:18:55 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:23.720 20:18:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.720 20:18:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:23.720 20:18:55 -- common/autotest_common.sh@10 -- # set +x 00:13:23.979 20:18:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:23.979 20:18:55 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:23.979 20:18:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.979 20:18:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:23.979 20:18:55 -- common/autotest_common.sh@10 -- # set +x 00:13:24.239 20:18:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:24.239 20:18:56 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:24.239 20:18:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.239 20:18:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.239 20:18:56 -- common/autotest_common.sh@10 -- # set +x 00:13:24.498 20:18:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:24.498 20:18:56 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:24.498 20:18:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.498 20:18:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.498 20:18:56 -- common/autotest_common.sh@10 -- # set +x 00:13:25.067 20:18:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:25.067 20:18:56 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:25.067 20:18:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.067 20:18:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:25.067 20:18:56 -- common/autotest_common.sh@10 -- # set +x 00:13:25.326 20:18:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:25.326 20:18:57 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:25.326 20:18:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.326 20:18:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:25.326 20:18:57 -- common/autotest_common.sh@10 -- # set +x 00:13:25.586 20:18:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:25.586 20:18:57 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:25.586 20:18:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.586 20:18:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:25.586 20:18:57 -- common/autotest_common.sh@10 -- # set +x 00:13:25.854 20:18:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:25.854 20:18:57 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:25.854 20:18:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.854 20:18:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:25.854 20:18:57 -- common/autotest_common.sh@10 -- # set +x 00:13:26.118 20:18:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:26.118 20:18:58 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:26.118 20:18:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.118 20:18:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:26.118 20:18:58 -- common/autotest_common.sh@10 -- # set +x 00:13:26.687 20:18:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:26.687 20:18:58 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:26.687 20:18:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.687 20:18:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:26.687 20:18:58 -- common/autotest_common.sh@10 -- # set +x 00:13:26.947 20:18:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:26.947 20:18:58 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:26.947 20:18:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.947 20:18:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:26.947 20:18:58 -- common/autotest_common.sh@10 -- # set +x 00:13:27.206 20:18:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:27.206 20:18:59 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:27.206 20:18:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.206 20:18:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:27.206 20:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:27.465 20:18:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:27.465 20:18:59 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:27.465 20:18:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.465 20:18:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:27.465 20:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:28.033 20:18:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.033 20:18:59 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:28.033 20:18:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.033 20:18:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.033 20:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:28.292 20:18:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.292 20:18:59 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:28.292 20:18:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.292 20:18:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.292 20:18:59 -- common/autotest_common.sh@10 -- # set +x 00:13:28.551 20:19:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.551 20:19:00 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:28.551 20:19:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.551 20:19:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.551 20:19:00 -- common/autotest_common.sh@10 -- # set +x 00:13:28.810 20:19:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.810 20:19:00 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:28.810 20:19:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.810 20:19:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.810 20:19:00 -- common/autotest_common.sh@10 -- # set +x 00:13:29.069 20:19:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:29.069 20:19:00 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:29.069 20:19:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.069 20:19:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:29.069 20:19:00 -- common/autotest_common.sh@10 -- # set +x 00:13:29.637 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:29.637 20:19:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:29.637 20:19:01 -- target/connect_stress.sh@34 -- # kill -0 3348086 00:13:29.637 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3348086) - No such process 00:13:29.637 20:19:01 -- target/connect_stress.sh@38 -- # wait 3348086 00:13:29.637 20:19:01 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:29.637 20:19:01 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:29.637 20:19:01 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:29.637 20:19:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:29.637 20:19:01 -- nvmf/common.sh@116 -- # sync 00:13:29.637 20:19:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:29.637 20:19:01 -- nvmf/common.sh@119 -- # set +e 00:13:29.637 20:19:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:29.637 20:19:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:29.637 rmmod nvme_tcp 00:13:29.637 rmmod nvme_fabrics 00:13:29.637 rmmod nvme_keyring 00:13:29.637 20:19:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:29.637 20:19:01 -- nvmf/common.sh@123 -- # set -e 00:13:29.637 20:19:01 -- nvmf/common.sh@124 -- # return 0 00:13:29.637 20:19:01 -- nvmf/common.sh@477 -- # '[' -n 3347900 ']' 00:13:29.637 20:19:01 -- nvmf/common.sh@478 -- # killprocess 3347900 00:13:29.637 20:19:01 -- common/autotest_common.sh@926 -- # '[' -z 3347900 ']' 00:13:29.637 20:19:01 -- common/autotest_common.sh@930 -- # kill -0 3347900 00:13:29.637 20:19:01 -- common/autotest_common.sh@931 -- # uname 00:13:29.637 20:19:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:29.637 20:19:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3347900 00:13:29.637 20:19:01 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:29.637 20:19:01 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:29.637 20:19:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3347900' 00:13:29.637 killing process with pid 3347900 00:13:29.637 20:19:01 -- common/autotest_common.sh@945 -- # kill 3347900 00:13:29.637 20:19:01 -- common/autotest_common.sh@950 -- # wait 3347900 00:13:29.897 20:19:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:29.897 20:19:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:29.897 20:19:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:29.897 20:19:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:29.897 20:19:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:29.897 20:19:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.897 20:19:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.897 20:19:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:31.802 20:19:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:31.802 00:13:31.802 real 0m18.319s 00:13:31.802 user 0m40.710s 00:13:31.802 sys 0m7.413s 00:13:31.802 20:19:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:31.802 20:19:03 -- common/autotest_common.sh@10 -- # set +x 00:13:31.802 ************************************ 00:13:31.802 END TEST nvmf_connect_stress 00:13:31.802 ************************************ 00:13:31.802 20:19:03 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:31.802 20:19:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:31.802 20:19:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:31.802 20:19:03 -- common/autotest_common.sh@10 -- # set +x 00:13:31.802 ************************************ 00:13:31.802 START TEST nvmf_fused_ordering 00:13:31.802 ************************************ 00:13:31.802 20:19:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:32.062 * Looking for test storage... 00:13:32.062 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:32.062 20:19:03 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:32.062 20:19:03 -- nvmf/common.sh@7 -- # uname -s 00:13:32.062 20:19:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:32.062 20:19:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:32.062 20:19:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:32.062 20:19:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:32.062 20:19:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:32.062 20:19:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:32.062 20:19:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:32.062 20:19:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:32.062 20:19:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:32.062 20:19:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:32.062 20:19:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:13:32.062 20:19:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:13:32.062 20:19:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:32.062 20:19:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:32.062 20:19:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:32.062 20:19:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:32.062 20:19:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:32.062 20:19:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:32.062 20:19:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:32.062 20:19:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.062 20:19:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.062 20:19:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.062 20:19:03 -- paths/export.sh@5 -- # export PATH 00:13:32.062 20:19:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.062 20:19:03 -- nvmf/common.sh@46 -- # : 0 00:13:32.062 20:19:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:32.062 20:19:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:32.062 20:19:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:32.062 20:19:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:32.062 20:19:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:32.063 20:19:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:32.063 20:19:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:32.063 20:19:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:32.063 20:19:03 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:32.063 20:19:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:32.063 20:19:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:32.063 20:19:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:32.063 20:19:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:32.063 20:19:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:32.063 20:19:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:32.063 20:19:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:32.063 20:19:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.063 20:19:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:32.063 20:19:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:32.063 20:19:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:32.063 20:19:03 -- common/autotest_common.sh@10 -- # set +x 00:13:37.381 20:19:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:37.381 20:19:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:37.381 20:19:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:37.381 20:19:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:37.381 20:19:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:37.381 20:19:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:37.381 20:19:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:37.381 20:19:08 -- nvmf/common.sh@294 -- # net_devs=() 00:13:37.381 20:19:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:37.381 20:19:08 -- nvmf/common.sh@295 -- # e810=() 00:13:37.381 20:19:08 -- nvmf/common.sh@295 -- # local -ga e810 00:13:37.381 20:19:08 -- nvmf/common.sh@296 -- # x722=() 00:13:37.381 20:19:08 -- nvmf/common.sh@296 -- # local -ga x722 00:13:37.381 20:19:08 -- nvmf/common.sh@297 -- # mlx=() 00:13:37.381 20:19:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:37.381 20:19:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:37.381 20:19:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:37.381 20:19:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:37.381 20:19:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:37.381 20:19:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:37.381 20:19:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:13:37.381 Found 0000:86:00.0 (0x8086 - 0x159b) 00:13:37.381 20:19:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:37.381 20:19:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:13:37.381 Found 0000:86:00.1 (0x8086 - 0x159b) 00:13:37.381 20:19:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:37.381 20:19:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:37.381 20:19:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:37.381 20:19:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:37.381 20:19:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:37.381 20:19:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:13:37.381 Found net devices under 0000:86:00.0: cvl_0_0 00:13:37.381 20:19:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:37.381 20:19:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:37.381 20:19:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:37.381 20:19:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:37.381 20:19:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:37.381 20:19:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:13:37.381 Found net devices under 0000:86:00.1: cvl_0_1 00:13:37.381 20:19:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:37.381 20:19:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:37.381 20:19:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:37.381 20:19:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:37.381 20:19:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:37.381 20:19:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:37.381 20:19:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:37.381 20:19:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:37.381 20:19:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:37.381 20:19:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:37.381 20:19:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:37.381 20:19:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:37.381 20:19:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:37.381 20:19:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:37.381 20:19:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:37.381 20:19:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:37.381 20:19:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:37.381 20:19:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:37.381 20:19:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:37.381 20:19:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:37.381 20:19:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:37.381 20:19:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:37.381 20:19:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:37.381 20:19:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:37.381 20:19:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:37.381 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:37.381 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:13:37.381 00:13:37.381 --- 10.0.0.2 ping statistics --- 00:13:37.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:37.381 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:13:37.381 20:19:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:37.381 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:37.381 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.308 ms 00:13:37.381 00:13:37.381 --- 10.0.0.1 ping statistics --- 00:13:37.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:37.381 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:13:37.381 20:19:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:37.381 20:19:09 -- nvmf/common.sh@410 -- # return 0 00:13:37.381 20:19:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:37.381 20:19:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:37.381 20:19:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:37.381 20:19:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:37.381 20:19:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:37.381 20:19:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:37.381 20:19:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:37.381 20:19:09 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:37.381 20:19:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:37.381 20:19:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:37.381 20:19:09 -- common/autotest_common.sh@10 -- # set +x 00:13:37.381 20:19:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:37.381 20:19:09 -- nvmf/common.sh@469 -- # nvmfpid=3353276 00:13:37.381 20:19:09 -- nvmf/common.sh@470 -- # waitforlisten 3353276 00:13:37.381 20:19:09 -- common/autotest_common.sh@819 -- # '[' -z 3353276 ']' 00:13:37.381 20:19:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:37.381 20:19:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:37.381 20:19:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:37.381 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:37.381 20:19:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:37.381 20:19:09 -- common/autotest_common.sh@10 -- # set +x 00:13:37.381 [2024-07-22 20:19:09.198947] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:13:37.381 [2024-07-22 20:19:09.198985] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:37.381 EAL: No free 2048 kB hugepages reported on node 1 00:13:37.381 [2024-07-22 20:19:09.250491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:37.641 [2024-07-22 20:19:09.327454] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:37.641 [2024-07-22 20:19:09.327557] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:37.641 [2024-07-22 20:19:09.327564] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:37.641 [2024-07-22 20:19:09.327570] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:37.641 [2024-07-22 20:19:09.327585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:38.209 20:19:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:38.209 20:19:10 -- common/autotest_common.sh@852 -- # return 0 00:13:38.209 20:19:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:38.209 20:19:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:38.209 20:19:10 -- common/autotest_common.sh@10 -- # set +x 00:13:38.209 20:19:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:38.209 20:19:10 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:38.209 20:19:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.209 20:19:10 -- common/autotest_common.sh@10 -- # set +x 00:13:38.209 [2024-07-22 20:19:10.053403] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:38.209 20:19:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.209 20:19:10 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:38.209 20:19:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.209 20:19:10 -- common/autotest_common.sh@10 -- # set +x 00:13:38.209 20:19:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.209 20:19:10 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:38.209 20:19:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.209 20:19:10 -- common/autotest_common.sh@10 -- # set +x 00:13:38.209 [2024-07-22 20:19:10.073547] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:38.209 20:19:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.209 20:19:10 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:38.209 20:19:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.209 20:19:10 -- common/autotest_common.sh@10 -- # set +x 00:13:38.209 NULL1 00:13:38.209 20:19:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.209 20:19:10 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:38.209 20:19:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.209 20:19:10 -- common/autotest_common.sh@10 -- # set +x 00:13:38.209 20:19:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.209 20:19:10 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:38.209 20:19:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.209 20:19:10 -- common/autotest_common.sh@10 -- # set +x 00:13:38.209 20:19:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.209 20:19:10 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:38.209 [2024-07-22 20:19:10.126790] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:13:38.209 [2024-07-22 20:19:10.126830] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3353511 ] 00:13:38.468 EAL: No free 2048 kB hugepages reported on node 1 00:13:39.037 Attached to nqn.2016-06.io.spdk:cnode1 00:13:39.037 Namespace ID: 1 size: 1GB 00:13:39.037 fused_ordering(0) 00:13:39.037 fused_ordering(1) 00:13:39.037 fused_ordering(2) 00:13:39.037 fused_ordering(3) 00:13:39.037 fused_ordering(4) 00:13:39.037 fused_ordering(5) 00:13:39.037 fused_ordering(6) 00:13:39.037 fused_ordering(7) 00:13:39.037 fused_ordering(8) 00:13:39.037 fused_ordering(9) 00:13:39.037 fused_ordering(10) 00:13:39.037 fused_ordering(11) 00:13:39.037 fused_ordering(12) 00:13:39.037 fused_ordering(13) 00:13:39.037 fused_ordering(14) 00:13:39.037 fused_ordering(15) 00:13:39.037 fused_ordering(16) 00:13:39.037 fused_ordering(17) 00:13:39.037 fused_ordering(18) 00:13:39.037 fused_ordering(19) 00:13:39.037 fused_ordering(20) 00:13:39.037 fused_ordering(21) 00:13:39.037 fused_ordering(22) 00:13:39.037 fused_ordering(23) 00:13:39.037 fused_ordering(24) 00:13:39.037 fused_ordering(25) 00:13:39.037 fused_ordering(26) 00:13:39.037 fused_ordering(27) 00:13:39.037 fused_ordering(28) 00:13:39.037 fused_ordering(29) 00:13:39.037 fused_ordering(30) 00:13:39.037 fused_ordering(31) 00:13:39.037 fused_ordering(32) 00:13:39.037 fused_ordering(33) 00:13:39.037 fused_ordering(34) 00:13:39.037 fused_ordering(35) 00:13:39.037 fused_ordering(36) 00:13:39.037 fused_ordering(37) 00:13:39.037 fused_ordering(38) 00:13:39.037 fused_ordering(39) 00:13:39.037 fused_ordering(40) 00:13:39.037 fused_ordering(41) 00:13:39.037 fused_ordering(42) 00:13:39.037 fused_ordering(43) 00:13:39.037 fused_ordering(44) 00:13:39.037 fused_ordering(45) 00:13:39.037 fused_ordering(46) 00:13:39.037 fused_ordering(47) 00:13:39.037 fused_ordering(48) 00:13:39.037 fused_ordering(49) 00:13:39.037 fused_ordering(50) 00:13:39.037 fused_ordering(51) 00:13:39.037 fused_ordering(52) 00:13:39.037 fused_ordering(53) 00:13:39.037 fused_ordering(54) 00:13:39.037 fused_ordering(55) 00:13:39.037 fused_ordering(56) 00:13:39.037 fused_ordering(57) 00:13:39.037 fused_ordering(58) 00:13:39.037 fused_ordering(59) 00:13:39.037 fused_ordering(60) 00:13:39.037 fused_ordering(61) 00:13:39.037 fused_ordering(62) 00:13:39.037 fused_ordering(63) 00:13:39.037 fused_ordering(64) 00:13:39.037 fused_ordering(65) 00:13:39.037 fused_ordering(66) 00:13:39.037 fused_ordering(67) 00:13:39.037 fused_ordering(68) 00:13:39.037 fused_ordering(69) 00:13:39.037 fused_ordering(70) 00:13:39.037 fused_ordering(71) 00:13:39.037 fused_ordering(72) 00:13:39.037 fused_ordering(73) 00:13:39.037 fused_ordering(74) 00:13:39.037 fused_ordering(75) 00:13:39.037 fused_ordering(76) 00:13:39.037 fused_ordering(77) 00:13:39.037 fused_ordering(78) 00:13:39.037 fused_ordering(79) 00:13:39.037 fused_ordering(80) 00:13:39.037 fused_ordering(81) 00:13:39.037 fused_ordering(82) 00:13:39.037 fused_ordering(83) 00:13:39.037 fused_ordering(84) 00:13:39.037 fused_ordering(85) 00:13:39.037 fused_ordering(86) 00:13:39.037 fused_ordering(87) 00:13:39.037 fused_ordering(88) 00:13:39.037 fused_ordering(89) 00:13:39.037 fused_ordering(90) 00:13:39.037 fused_ordering(91) 00:13:39.037 fused_ordering(92) 00:13:39.037 fused_ordering(93) 00:13:39.037 fused_ordering(94) 00:13:39.037 fused_ordering(95) 00:13:39.037 fused_ordering(96) 00:13:39.037 fused_ordering(97) 00:13:39.037 fused_ordering(98) 00:13:39.037 fused_ordering(99) 00:13:39.037 fused_ordering(100) 00:13:39.037 fused_ordering(101) 00:13:39.037 fused_ordering(102) 00:13:39.037 fused_ordering(103) 00:13:39.037 fused_ordering(104) 00:13:39.037 fused_ordering(105) 00:13:39.037 fused_ordering(106) 00:13:39.037 fused_ordering(107) 00:13:39.037 fused_ordering(108) 00:13:39.037 fused_ordering(109) 00:13:39.037 fused_ordering(110) 00:13:39.037 fused_ordering(111) 00:13:39.037 fused_ordering(112) 00:13:39.037 fused_ordering(113) 00:13:39.037 fused_ordering(114) 00:13:39.037 fused_ordering(115) 00:13:39.037 fused_ordering(116) 00:13:39.037 fused_ordering(117) 00:13:39.037 fused_ordering(118) 00:13:39.037 fused_ordering(119) 00:13:39.037 fused_ordering(120) 00:13:39.037 fused_ordering(121) 00:13:39.037 fused_ordering(122) 00:13:39.037 fused_ordering(123) 00:13:39.037 fused_ordering(124) 00:13:39.037 fused_ordering(125) 00:13:39.037 fused_ordering(126) 00:13:39.037 fused_ordering(127) 00:13:39.037 fused_ordering(128) 00:13:39.037 fused_ordering(129) 00:13:39.037 fused_ordering(130) 00:13:39.037 fused_ordering(131) 00:13:39.037 fused_ordering(132) 00:13:39.037 fused_ordering(133) 00:13:39.037 fused_ordering(134) 00:13:39.037 fused_ordering(135) 00:13:39.037 fused_ordering(136) 00:13:39.037 fused_ordering(137) 00:13:39.037 fused_ordering(138) 00:13:39.037 fused_ordering(139) 00:13:39.037 fused_ordering(140) 00:13:39.037 fused_ordering(141) 00:13:39.037 fused_ordering(142) 00:13:39.037 fused_ordering(143) 00:13:39.037 fused_ordering(144) 00:13:39.037 fused_ordering(145) 00:13:39.037 fused_ordering(146) 00:13:39.037 fused_ordering(147) 00:13:39.037 fused_ordering(148) 00:13:39.037 fused_ordering(149) 00:13:39.037 fused_ordering(150) 00:13:39.037 fused_ordering(151) 00:13:39.037 fused_ordering(152) 00:13:39.037 fused_ordering(153) 00:13:39.037 fused_ordering(154) 00:13:39.037 fused_ordering(155) 00:13:39.037 fused_ordering(156) 00:13:39.037 fused_ordering(157) 00:13:39.037 fused_ordering(158) 00:13:39.037 fused_ordering(159) 00:13:39.037 fused_ordering(160) 00:13:39.037 fused_ordering(161) 00:13:39.037 fused_ordering(162) 00:13:39.037 fused_ordering(163) 00:13:39.037 fused_ordering(164) 00:13:39.037 fused_ordering(165) 00:13:39.037 fused_ordering(166) 00:13:39.037 fused_ordering(167) 00:13:39.037 fused_ordering(168) 00:13:39.037 fused_ordering(169) 00:13:39.037 fused_ordering(170) 00:13:39.037 fused_ordering(171) 00:13:39.037 fused_ordering(172) 00:13:39.037 fused_ordering(173) 00:13:39.037 fused_ordering(174) 00:13:39.037 fused_ordering(175) 00:13:39.037 fused_ordering(176) 00:13:39.037 fused_ordering(177) 00:13:39.037 fused_ordering(178) 00:13:39.037 fused_ordering(179) 00:13:39.037 fused_ordering(180) 00:13:39.037 fused_ordering(181) 00:13:39.037 fused_ordering(182) 00:13:39.037 fused_ordering(183) 00:13:39.037 fused_ordering(184) 00:13:39.037 fused_ordering(185) 00:13:39.037 fused_ordering(186) 00:13:39.037 fused_ordering(187) 00:13:39.037 fused_ordering(188) 00:13:39.037 fused_ordering(189) 00:13:39.037 fused_ordering(190) 00:13:39.037 fused_ordering(191) 00:13:39.037 fused_ordering(192) 00:13:39.037 fused_ordering(193) 00:13:39.037 fused_ordering(194) 00:13:39.037 fused_ordering(195) 00:13:39.037 fused_ordering(196) 00:13:39.037 fused_ordering(197) 00:13:39.037 fused_ordering(198) 00:13:39.037 fused_ordering(199) 00:13:39.037 fused_ordering(200) 00:13:39.037 fused_ordering(201) 00:13:39.037 fused_ordering(202) 00:13:39.037 fused_ordering(203) 00:13:39.037 fused_ordering(204) 00:13:39.037 fused_ordering(205) 00:13:39.975 fused_ordering(206) 00:13:39.975 fused_ordering(207) 00:13:39.975 fused_ordering(208) 00:13:39.975 fused_ordering(209) 00:13:39.975 fused_ordering(210) 00:13:39.975 fused_ordering(211) 00:13:39.975 fused_ordering(212) 00:13:39.975 fused_ordering(213) 00:13:39.975 fused_ordering(214) 00:13:39.975 fused_ordering(215) 00:13:39.975 fused_ordering(216) 00:13:39.975 fused_ordering(217) 00:13:39.975 fused_ordering(218) 00:13:39.975 fused_ordering(219) 00:13:39.975 fused_ordering(220) 00:13:39.975 fused_ordering(221) 00:13:39.975 fused_ordering(222) 00:13:39.975 fused_ordering(223) 00:13:39.975 fused_ordering(224) 00:13:39.975 fused_ordering(225) 00:13:39.975 fused_ordering(226) 00:13:39.975 fused_ordering(227) 00:13:39.975 fused_ordering(228) 00:13:39.975 fused_ordering(229) 00:13:39.975 fused_ordering(230) 00:13:39.975 fused_ordering(231) 00:13:39.975 fused_ordering(232) 00:13:39.975 fused_ordering(233) 00:13:39.975 fused_ordering(234) 00:13:39.975 fused_ordering(235) 00:13:39.975 fused_ordering(236) 00:13:39.975 fused_ordering(237) 00:13:39.975 fused_ordering(238) 00:13:39.975 fused_ordering(239) 00:13:39.975 fused_ordering(240) 00:13:39.975 fused_ordering(241) 00:13:39.975 fused_ordering(242) 00:13:39.975 fused_ordering(243) 00:13:39.975 fused_ordering(244) 00:13:39.975 fused_ordering(245) 00:13:39.975 fused_ordering(246) 00:13:39.975 fused_ordering(247) 00:13:39.975 fused_ordering(248) 00:13:39.975 fused_ordering(249) 00:13:39.975 fused_ordering(250) 00:13:39.975 fused_ordering(251) 00:13:39.975 fused_ordering(252) 00:13:39.975 fused_ordering(253) 00:13:39.975 fused_ordering(254) 00:13:39.975 fused_ordering(255) 00:13:39.975 fused_ordering(256) 00:13:39.975 fused_ordering(257) 00:13:39.975 fused_ordering(258) 00:13:39.975 fused_ordering(259) 00:13:39.975 fused_ordering(260) 00:13:39.975 fused_ordering(261) 00:13:39.975 fused_ordering(262) 00:13:39.975 fused_ordering(263) 00:13:39.975 fused_ordering(264) 00:13:39.975 fused_ordering(265) 00:13:39.975 fused_ordering(266) 00:13:39.975 fused_ordering(267) 00:13:39.975 fused_ordering(268) 00:13:39.975 fused_ordering(269) 00:13:39.975 fused_ordering(270) 00:13:39.975 fused_ordering(271) 00:13:39.975 fused_ordering(272) 00:13:39.975 fused_ordering(273) 00:13:39.975 fused_ordering(274) 00:13:39.975 fused_ordering(275) 00:13:39.975 fused_ordering(276) 00:13:39.975 fused_ordering(277) 00:13:39.975 fused_ordering(278) 00:13:39.975 fused_ordering(279) 00:13:39.975 fused_ordering(280) 00:13:39.975 fused_ordering(281) 00:13:39.975 fused_ordering(282) 00:13:39.975 fused_ordering(283) 00:13:39.975 fused_ordering(284) 00:13:39.975 fused_ordering(285) 00:13:39.975 fused_ordering(286) 00:13:39.975 fused_ordering(287) 00:13:39.975 fused_ordering(288) 00:13:39.975 fused_ordering(289) 00:13:39.975 fused_ordering(290) 00:13:39.975 fused_ordering(291) 00:13:39.975 fused_ordering(292) 00:13:39.975 fused_ordering(293) 00:13:39.975 fused_ordering(294) 00:13:39.975 fused_ordering(295) 00:13:39.975 fused_ordering(296) 00:13:39.975 fused_ordering(297) 00:13:39.975 fused_ordering(298) 00:13:39.975 fused_ordering(299) 00:13:39.975 fused_ordering(300) 00:13:39.975 fused_ordering(301) 00:13:39.975 fused_ordering(302) 00:13:39.975 fused_ordering(303) 00:13:39.975 fused_ordering(304) 00:13:39.975 fused_ordering(305) 00:13:39.975 fused_ordering(306) 00:13:39.975 fused_ordering(307) 00:13:39.975 fused_ordering(308) 00:13:39.975 fused_ordering(309) 00:13:39.975 fused_ordering(310) 00:13:39.975 fused_ordering(311) 00:13:39.975 fused_ordering(312) 00:13:39.975 fused_ordering(313) 00:13:39.975 fused_ordering(314) 00:13:39.975 fused_ordering(315) 00:13:39.975 fused_ordering(316) 00:13:39.975 fused_ordering(317) 00:13:39.975 fused_ordering(318) 00:13:39.975 fused_ordering(319) 00:13:39.975 fused_ordering(320) 00:13:39.975 fused_ordering(321) 00:13:39.975 fused_ordering(322) 00:13:39.975 fused_ordering(323) 00:13:39.975 fused_ordering(324) 00:13:39.975 fused_ordering(325) 00:13:39.975 fused_ordering(326) 00:13:39.975 fused_ordering(327) 00:13:39.975 fused_ordering(328) 00:13:39.975 fused_ordering(329) 00:13:39.975 fused_ordering(330) 00:13:39.975 fused_ordering(331) 00:13:39.975 fused_ordering(332) 00:13:39.975 fused_ordering(333) 00:13:39.975 fused_ordering(334) 00:13:39.975 fused_ordering(335) 00:13:39.975 fused_ordering(336) 00:13:39.975 fused_ordering(337) 00:13:39.975 fused_ordering(338) 00:13:39.975 fused_ordering(339) 00:13:39.975 fused_ordering(340) 00:13:39.975 fused_ordering(341) 00:13:39.976 fused_ordering(342) 00:13:39.976 fused_ordering(343) 00:13:39.976 fused_ordering(344) 00:13:39.976 fused_ordering(345) 00:13:39.976 fused_ordering(346) 00:13:39.976 fused_ordering(347) 00:13:39.976 fused_ordering(348) 00:13:39.976 fused_ordering(349) 00:13:39.976 fused_ordering(350) 00:13:39.976 fused_ordering(351) 00:13:39.976 fused_ordering(352) 00:13:39.976 fused_ordering(353) 00:13:39.976 fused_ordering(354) 00:13:39.976 fused_ordering(355) 00:13:39.976 fused_ordering(356) 00:13:39.976 fused_ordering(357) 00:13:39.976 fused_ordering(358) 00:13:39.976 fused_ordering(359) 00:13:39.976 fused_ordering(360) 00:13:39.976 fused_ordering(361) 00:13:39.976 fused_ordering(362) 00:13:39.976 fused_ordering(363) 00:13:39.976 fused_ordering(364) 00:13:39.976 fused_ordering(365) 00:13:39.976 fused_ordering(366) 00:13:39.976 fused_ordering(367) 00:13:39.976 fused_ordering(368) 00:13:39.976 fused_ordering(369) 00:13:39.976 fused_ordering(370) 00:13:39.976 fused_ordering(371) 00:13:39.976 fused_ordering(372) 00:13:39.976 fused_ordering(373) 00:13:39.976 fused_ordering(374) 00:13:39.976 fused_ordering(375) 00:13:39.976 fused_ordering(376) 00:13:39.976 fused_ordering(377) 00:13:39.976 fused_ordering(378) 00:13:39.976 fused_ordering(379) 00:13:39.976 fused_ordering(380) 00:13:39.976 fused_ordering(381) 00:13:39.976 fused_ordering(382) 00:13:39.976 fused_ordering(383) 00:13:39.976 fused_ordering(384) 00:13:39.976 fused_ordering(385) 00:13:39.976 fused_ordering(386) 00:13:39.976 fused_ordering(387) 00:13:39.976 fused_ordering(388) 00:13:39.976 fused_ordering(389) 00:13:39.976 fused_ordering(390) 00:13:39.976 fused_ordering(391) 00:13:39.976 fused_ordering(392) 00:13:39.976 fused_ordering(393) 00:13:39.976 fused_ordering(394) 00:13:39.976 fused_ordering(395) 00:13:39.976 fused_ordering(396) 00:13:39.976 fused_ordering(397) 00:13:39.976 fused_ordering(398) 00:13:39.976 fused_ordering(399) 00:13:39.976 fused_ordering(400) 00:13:39.976 fused_ordering(401) 00:13:39.976 fused_ordering(402) 00:13:39.976 fused_ordering(403) 00:13:39.976 fused_ordering(404) 00:13:39.976 fused_ordering(405) 00:13:39.976 fused_ordering(406) 00:13:39.976 fused_ordering(407) 00:13:39.976 fused_ordering(408) 00:13:39.976 fused_ordering(409) 00:13:39.976 fused_ordering(410) 00:13:40.545 fused_ordering(411) 00:13:40.545 fused_ordering(412) 00:13:40.545 fused_ordering(413) 00:13:40.545 fused_ordering(414) 00:13:40.545 fused_ordering(415) 00:13:40.545 fused_ordering(416) 00:13:40.545 fused_ordering(417) 00:13:40.545 fused_ordering(418) 00:13:40.545 fused_ordering(419) 00:13:40.545 fused_ordering(420) 00:13:40.545 fused_ordering(421) 00:13:40.545 fused_ordering(422) 00:13:40.545 fused_ordering(423) 00:13:40.545 fused_ordering(424) 00:13:40.545 fused_ordering(425) 00:13:40.545 fused_ordering(426) 00:13:40.545 fused_ordering(427) 00:13:40.545 fused_ordering(428) 00:13:40.545 fused_ordering(429) 00:13:40.545 fused_ordering(430) 00:13:40.545 fused_ordering(431) 00:13:40.545 fused_ordering(432) 00:13:40.545 fused_ordering(433) 00:13:40.545 fused_ordering(434) 00:13:40.545 fused_ordering(435) 00:13:40.545 fused_ordering(436) 00:13:40.545 fused_ordering(437) 00:13:40.545 fused_ordering(438) 00:13:40.545 fused_ordering(439) 00:13:40.545 fused_ordering(440) 00:13:40.545 fused_ordering(441) 00:13:40.545 fused_ordering(442) 00:13:40.545 fused_ordering(443) 00:13:40.545 fused_ordering(444) 00:13:40.545 fused_ordering(445) 00:13:40.545 fused_ordering(446) 00:13:40.545 fused_ordering(447) 00:13:40.545 fused_ordering(448) 00:13:40.545 fused_ordering(449) 00:13:40.545 fused_ordering(450) 00:13:40.545 fused_ordering(451) 00:13:40.545 fused_ordering(452) 00:13:40.545 fused_ordering(453) 00:13:40.545 fused_ordering(454) 00:13:40.545 fused_ordering(455) 00:13:40.545 fused_ordering(456) 00:13:40.545 fused_ordering(457) 00:13:40.545 fused_ordering(458) 00:13:40.545 fused_ordering(459) 00:13:40.545 fused_ordering(460) 00:13:40.545 fused_ordering(461) 00:13:40.545 fused_ordering(462) 00:13:40.545 fused_ordering(463) 00:13:40.545 fused_ordering(464) 00:13:40.545 fused_ordering(465) 00:13:40.545 fused_ordering(466) 00:13:40.545 fused_ordering(467) 00:13:40.545 fused_ordering(468) 00:13:40.545 fused_ordering(469) 00:13:40.545 fused_ordering(470) 00:13:40.545 fused_ordering(471) 00:13:40.545 fused_ordering(472) 00:13:40.545 fused_ordering(473) 00:13:40.545 fused_ordering(474) 00:13:40.545 fused_ordering(475) 00:13:40.545 fused_ordering(476) 00:13:40.545 fused_ordering(477) 00:13:40.545 fused_ordering(478) 00:13:40.545 fused_ordering(479) 00:13:40.545 fused_ordering(480) 00:13:40.545 fused_ordering(481) 00:13:40.545 fused_ordering(482) 00:13:40.545 fused_ordering(483) 00:13:40.545 fused_ordering(484) 00:13:40.545 fused_ordering(485) 00:13:40.545 fused_ordering(486) 00:13:40.545 fused_ordering(487) 00:13:40.545 fused_ordering(488) 00:13:40.545 fused_ordering(489) 00:13:40.545 fused_ordering(490) 00:13:40.545 fused_ordering(491) 00:13:40.545 fused_ordering(492) 00:13:40.545 fused_ordering(493) 00:13:40.545 fused_ordering(494) 00:13:40.545 fused_ordering(495) 00:13:40.545 fused_ordering(496) 00:13:40.545 fused_ordering(497) 00:13:40.545 fused_ordering(498) 00:13:40.545 fused_ordering(499) 00:13:40.545 fused_ordering(500) 00:13:40.545 fused_ordering(501) 00:13:40.545 fused_ordering(502) 00:13:40.545 fused_ordering(503) 00:13:40.545 fused_ordering(504) 00:13:40.545 fused_ordering(505) 00:13:40.545 fused_ordering(506) 00:13:40.545 fused_ordering(507) 00:13:40.545 fused_ordering(508) 00:13:40.545 fused_ordering(509) 00:13:40.545 fused_ordering(510) 00:13:40.545 fused_ordering(511) 00:13:40.545 fused_ordering(512) 00:13:40.545 fused_ordering(513) 00:13:40.545 fused_ordering(514) 00:13:40.545 fused_ordering(515) 00:13:40.545 fused_ordering(516) 00:13:40.545 fused_ordering(517) 00:13:40.545 fused_ordering(518) 00:13:40.545 fused_ordering(519) 00:13:40.545 fused_ordering(520) 00:13:40.545 fused_ordering(521) 00:13:40.545 fused_ordering(522) 00:13:40.545 fused_ordering(523) 00:13:40.545 fused_ordering(524) 00:13:40.545 fused_ordering(525) 00:13:40.545 fused_ordering(526) 00:13:40.545 fused_ordering(527) 00:13:40.545 fused_ordering(528) 00:13:40.545 fused_ordering(529) 00:13:40.545 fused_ordering(530) 00:13:40.545 fused_ordering(531) 00:13:40.545 fused_ordering(532) 00:13:40.545 fused_ordering(533) 00:13:40.545 fused_ordering(534) 00:13:40.545 fused_ordering(535) 00:13:40.545 fused_ordering(536) 00:13:40.545 fused_ordering(537) 00:13:40.545 fused_ordering(538) 00:13:40.545 fused_ordering(539) 00:13:40.545 fused_ordering(540) 00:13:40.545 fused_ordering(541) 00:13:40.545 fused_ordering(542) 00:13:40.545 fused_ordering(543) 00:13:40.545 fused_ordering(544) 00:13:40.545 fused_ordering(545) 00:13:40.545 fused_ordering(546) 00:13:40.545 fused_ordering(547) 00:13:40.545 fused_ordering(548) 00:13:40.545 fused_ordering(549) 00:13:40.545 fused_ordering(550) 00:13:40.545 fused_ordering(551) 00:13:40.545 fused_ordering(552) 00:13:40.545 fused_ordering(553) 00:13:40.545 fused_ordering(554) 00:13:40.545 fused_ordering(555) 00:13:40.545 fused_ordering(556) 00:13:40.545 fused_ordering(557) 00:13:40.545 fused_ordering(558) 00:13:40.545 fused_ordering(559) 00:13:40.545 fused_ordering(560) 00:13:40.545 fused_ordering(561) 00:13:40.545 fused_ordering(562) 00:13:40.545 fused_ordering(563) 00:13:40.545 fused_ordering(564) 00:13:40.545 fused_ordering(565) 00:13:40.545 fused_ordering(566) 00:13:40.545 fused_ordering(567) 00:13:40.545 fused_ordering(568) 00:13:40.545 fused_ordering(569) 00:13:40.545 fused_ordering(570) 00:13:40.545 fused_ordering(571) 00:13:40.545 fused_ordering(572) 00:13:40.545 fused_ordering(573) 00:13:40.545 fused_ordering(574) 00:13:40.545 fused_ordering(575) 00:13:40.545 fused_ordering(576) 00:13:40.545 fused_ordering(577) 00:13:40.545 fused_ordering(578) 00:13:40.545 fused_ordering(579) 00:13:40.545 fused_ordering(580) 00:13:40.545 fused_ordering(581) 00:13:40.545 fused_ordering(582) 00:13:40.545 fused_ordering(583) 00:13:40.545 fused_ordering(584) 00:13:40.545 fused_ordering(585) 00:13:40.545 fused_ordering(586) 00:13:40.545 fused_ordering(587) 00:13:40.545 fused_ordering(588) 00:13:40.545 fused_ordering(589) 00:13:40.545 fused_ordering(590) 00:13:40.545 fused_ordering(591) 00:13:40.545 fused_ordering(592) 00:13:40.545 fused_ordering(593) 00:13:40.545 fused_ordering(594) 00:13:40.545 fused_ordering(595) 00:13:40.545 fused_ordering(596) 00:13:40.545 fused_ordering(597) 00:13:40.545 fused_ordering(598) 00:13:40.545 fused_ordering(599) 00:13:40.545 fused_ordering(600) 00:13:40.545 fused_ordering(601) 00:13:40.545 fused_ordering(602) 00:13:40.545 fused_ordering(603) 00:13:40.545 fused_ordering(604) 00:13:40.545 fused_ordering(605) 00:13:40.545 fused_ordering(606) 00:13:40.545 fused_ordering(607) 00:13:40.545 fused_ordering(608) 00:13:40.545 fused_ordering(609) 00:13:40.545 fused_ordering(610) 00:13:40.545 fused_ordering(611) 00:13:40.545 fused_ordering(612) 00:13:40.545 fused_ordering(613) 00:13:40.545 fused_ordering(614) 00:13:40.545 fused_ordering(615) 00:13:41.114 fused_ordering(616) 00:13:41.115 fused_ordering(617) 00:13:41.115 fused_ordering(618) 00:13:41.115 fused_ordering(619) 00:13:41.115 fused_ordering(620) 00:13:41.115 fused_ordering(621) 00:13:41.115 fused_ordering(622) 00:13:41.115 fused_ordering(623) 00:13:41.115 fused_ordering(624) 00:13:41.115 fused_ordering(625) 00:13:41.115 fused_ordering(626) 00:13:41.115 fused_ordering(627) 00:13:41.115 fused_ordering(628) 00:13:41.115 fused_ordering(629) 00:13:41.115 fused_ordering(630) 00:13:41.115 fused_ordering(631) 00:13:41.115 fused_ordering(632) 00:13:41.115 fused_ordering(633) 00:13:41.115 fused_ordering(634) 00:13:41.115 fused_ordering(635) 00:13:41.115 fused_ordering(636) 00:13:41.115 fused_ordering(637) 00:13:41.115 fused_ordering(638) 00:13:41.115 fused_ordering(639) 00:13:41.115 fused_ordering(640) 00:13:41.115 fused_ordering(641) 00:13:41.115 fused_ordering(642) 00:13:41.115 fused_ordering(643) 00:13:41.115 fused_ordering(644) 00:13:41.115 fused_ordering(645) 00:13:41.115 fused_ordering(646) 00:13:41.115 fused_ordering(647) 00:13:41.115 fused_ordering(648) 00:13:41.115 fused_ordering(649) 00:13:41.115 fused_ordering(650) 00:13:41.115 fused_ordering(651) 00:13:41.115 fused_ordering(652) 00:13:41.115 fused_ordering(653) 00:13:41.115 fused_ordering(654) 00:13:41.115 fused_ordering(655) 00:13:41.115 fused_ordering(656) 00:13:41.115 fused_ordering(657) 00:13:41.115 fused_ordering(658) 00:13:41.115 fused_ordering(659) 00:13:41.115 fused_ordering(660) 00:13:41.115 fused_ordering(661) 00:13:41.115 fused_ordering(662) 00:13:41.115 fused_ordering(663) 00:13:41.115 fused_ordering(664) 00:13:41.115 fused_ordering(665) 00:13:41.115 fused_ordering(666) 00:13:41.115 fused_ordering(667) 00:13:41.115 fused_ordering(668) 00:13:41.115 fused_ordering(669) 00:13:41.115 fused_ordering(670) 00:13:41.115 fused_ordering(671) 00:13:41.115 fused_ordering(672) 00:13:41.115 fused_ordering(673) 00:13:41.115 fused_ordering(674) 00:13:41.115 fused_ordering(675) 00:13:41.115 fused_ordering(676) 00:13:41.115 fused_ordering(677) 00:13:41.115 fused_ordering(678) 00:13:41.115 fused_ordering(679) 00:13:41.115 fused_ordering(680) 00:13:41.115 fused_ordering(681) 00:13:41.115 fused_ordering(682) 00:13:41.115 fused_ordering(683) 00:13:41.115 fused_ordering(684) 00:13:41.115 fused_ordering(685) 00:13:41.115 fused_ordering(686) 00:13:41.115 fused_ordering(687) 00:13:41.115 fused_ordering(688) 00:13:41.115 fused_ordering(689) 00:13:41.115 fused_ordering(690) 00:13:41.115 fused_ordering(691) 00:13:41.115 fused_ordering(692) 00:13:41.115 fused_ordering(693) 00:13:41.115 fused_ordering(694) 00:13:41.115 fused_ordering(695) 00:13:41.115 fused_ordering(696) 00:13:41.115 fused_ordering(697) 00:13:41.115 fused_ordering(698) 00:13:41.115 fused_ordering(699) 00:13:41.115 fused_ordering(700) 00:13:41.115 fused_ordering(701) 00:13:41.115 fused_ordering(702) 00:13:41.115 fused_ordering(703) 00:13:41.115 fused_ordering(704) 00:13:41.115 fused_ordering(705) 00:13:41.115 fused_ordering(706) 00:13:41.115 fused_ordering(707) 00:13:41.115 fused_ordering(708) 00:13:41.115 fused_ordering(709) 00:13:41.115 fused_ordering(710) 00:13:41.115 fused_ordering(711) 00:13:41.115 fused_ordering(712) 00:13:41.115 fused_ordering(713) 00:13:41.115 fused_ordering(714) 00:13:41.115 fused_ordering(715) 00:13:41.115 fused_ordering(716) 00:13:41.115 fused_ordering(717) 00:13:41.115 fused_ordering(718) 00:13:41.115 fused_ordering(719) 00:13:41.115 fused_ordering(720) 00:13:41.115 fused_ordering(721) 00:13:41.115 fused_ordering(722) 00:13:41.115 fused_ordering(723) 00:13:41.115 fused_ordering(724) 00:13:41.115 fused_ordering(725) 00:13:41.115 fused_ordering(726) 00:13:41.115 fused_ordering(727) 00:13:41.115 fused_ordering(728) 00:13:41.115 fused_ordering(729) 00:13:41.115 fused_ordering(730) 00:13:41.115 fused_ordering(731) 00:13:41.115 fused_ordering(732) 00:13:41.115 fused_ordering(733) 00:13:41.115 fused_ordering(734) 00:13:41.115 fused_ordering(735) 00:13:41.115 fused_ordering(736) 00:13:41.115 fused_ordering(737) 00:13:41.115 fused_ordering(738) 00:13:41.115 fused_ordering(739) 00:13:41.115 fused_ordering(740) 00:13:41.115 fused_ordering(741) 00:13:41.115 fused_ordering(742) 00:13:41.115 fused_ordering(743) 00:13:41.115 fused_ordering(744) 00:13:41.115 fused_ordering(745) 00:13:41.115 fused_ordering(746) 00:13:41.115 fused_ordering(747) 00:13:41.115 fused_ordering(748) 00:13:41.115 fused_ordering(749) 00:13:41.115 fused_ordering(750) 00:13:41.115 fused_ordering(751) 00:13:41.115 fused_ordering(752) 00:13:41.115 fused_ordering(753) 00:13:41.115 fused_ordering(754) 00:13:41.115 fused_ordering(755) 00:13:41.115 fused_ordering(756) 00:13:41.115 fused_ordering(757) 00:13:41.115 fused_ordering(758) 00:13:41.115 fused_ordering(759) 00:13:41.115 fused_ordering(760) 00:13:41.115 fused_ordering(761) 00:13:41.115 fused_ordering(762) 00:13:41.115 fused_ordering(763) 00:13:41.115 fused_ordering(764) 00:13:41.115 fused_ordering(765) 00:13:41.115 fused_ordering(766) 00:13:41.115 fused_ordering(767) 00:13:41.115 fused_ordering(768) 00:13:41.115 fused_ordering(769) 00:13:41.115 fused_ordering(770) 00:13:41.115 fused_ordering(771) 00:13:41.115 fused_ordering(772) 00:13:41.115 fused_ordering(773) 00:13:41.115 fused_ordering(774) 00:13:41.115 fused_ordering(775) 00:13:41.115 fused_ordering(776) 00:13:41.115 fused_ordering(777) 00:13:41.115 fused_ordering(778) 00:13:41.115 fused_ordering(779) 00:13:41.115 fused_ordering(780) 00:13:41.115 fused_ordering(781) 00:13:41.115 fused_ordering(782) 00:13:41.115 fused_ordering(783) 00:13:41.115 fused_ordering(784) 00:13:41.115 fused_ordering(785) 00:13:41.115 fused_ordering(786) 00:13:41.115 fused_ordering(787) 00:13:41.115 fused_ordering(788) 00:13:41.115 fused_ordering(789) 00:13:41.115 fused_ordering(790) 00:13:41.115 fused_ordering(791) 00:13:41.115 fused_ordering(792) 00:13:41.115 fused_ordering(793) 00:13:41.115 fused_ordering(794) 00:13:41.115 fused_ordering(795) 00:13:41.115 fused_ordering(796) 00:13:41.115 fused_ordering(797) 00:13:41.115 fused_ordering(798) 00:13:41.115 fused_ordering(799) 00:13:41.115 fused_ordering(800) 00:13:41.115 fused_ordering(801) 00:13:41.115 fused_ordering(802) 00:13:41.115 fused_ordering(803) 00:13:41.115 fused_ordering(804) 00:13:41.115 fused_ordering(805) 00:13:41.115 fused_ordering(806) 00:13:41.115 fused_ordering(807) 00:13:41.115 fused_ordering(808) 00:13:41.115 fused_ordering(809) 00:13:41.115 fused_ordering(810) 00:13:41.115 fused_ordering(811) 00:13:41.115 fused_ordering(812) 00:13:41.115 fused_ordering(813) 00:13:41.115 fused_ordering(814) 00:13:41.115 fused_ordering(815) 00:13:41.115 fused_ordering(816) 00:13:41.115 fused_ordering(817) 00:13:41.115 fused_ordering(818) 00:13:41.115 fused_ordering(819) 00:13:41.115 fused_ordering(820) 00:13:42.053 fused_ordering(821) 00:13:42.053 fused_ordering(822) 00:13:42.053 fused_ordering(823) 00:13:42.053 fused_ordering(824) 00:13:42.053 fused_ordering(825) 00:13:42.053 fused_ordering(826) 00:13:42.053 fused_ordering(827) 00:13:42.053 fused_ordering(828) 00:13:42.053 fused_ordering(829) 00:13:42.053 fused_ordering(830) 00:13:42.053 fused_ordering(831) 00:13:42.053 fused_ordering(832) 00:13:42.053 fused_ordering(833) 00:13:42.053 fused_ordering(834) 00:13:42.053 fused_ordering(835) 00:13:42.053 fused_ordering(836) 00:13:42.053 fused_ordering(837) 00:13:42.053 fused_ordering(838) 00:13:42.053 fused_ordering(839) 00:13:42.053 fused_ordering(840) 00:13:42.053 fused_ordering(841) 00:13:42.053 fused_ordering(842) 00:13:42.053 fused_ordering(843) 00:13:42.053 fused_ordering(844) 00:13:42.053 fused_ordering(845) 00:13:42.053 fused_ordering(846) 00:13:42.053 fused_ordering(847) 00:13:42.053 fused_ordering(848) 00:13:42.053 fused_ordering(849) 00:13:42.053 fused_ordering(850) 00:13:42.053 fused_ordering(851) 00:13:42.053 fused_ordering(852) 00:13:42.053 fused_ordering(853) 00:13:42.053 fused_ordering(854) 00:13:42.053 fused_ordering(855) 00:13:42.053 fused_ordering(856) 00:13:42.053 fused_ordering(857) 00:13:42.053 fused_ordering(858) 00:13:42.053 fused_ordering(859) 00:13:42.053 fused_ordering(860) 00:13:42.053 fused_ordering(861) 00:13:42.053 fused_ordering(862) 00:13:42.053 fused_ordering(863) 00:13:42.053 fused_ordering(864) 00:13:42.053 fused_ordering(865) 00:13:42.053 fused_ordering(866) 00:13:42.053 fused_ordering(867) 00:13:42.053 fused_ordering(868) 00:13:42.053 fused_ordering(869) 00:13:42.053 fused_ordering(870) 00:13:42.053 fused_ordering(871) 00:13:42.053 fused_ordering(872) 00:13:42.053 fused_ordering(873) 00:13:42.053 fused_ordering(874) 00:13:42.053 fused_ordering(875) 00:13:42.053 fused_ordering(876) 00:13:42.053 fused_ordering(877) 00:13:42.053 fused_ordering(878) 00:13:42.053 fused_ordering(879) 00:13:42.053 fused_ordering(880) 00:13:42.053 fused_ordering(881) 00:13:42.053 fused_ordering(882) 00:13:42.053 fused_ordering(883) 00:13:42.053 fused_ordering(884) 00:13:42.053 fused_ordering(885) 00:13:42.053 fused_ordering(886) 00:13:42.053 fused_ordering(887) 00:13:42.053 fused_ordering(888) 00:13:42.053 fused_ordering(889) 00:13:42.053 fused_ordering(890) 00:13:42.053 fused_ordering(891) 00:13:42.053 fused_ordering(892) 00:13:42.053 fused_ordering(893) 00:13:42.053 fused_ordering(894) 00:13:42.053 fused_ordering(895) 00:13:42.053 fused_ordering(896) 00:13:42.053 fused_ordering(897) 00:13:42.053 fused_ordering(898) 00:13:42.053 fused_ordering(899) 00:13:42.053 fused_ordering(900) 00:13:42.053 fused_ordering(901) 00:13:42.053 fused_ordering(902) 00:13:42.053 fused_ordering(903) 00:13:42.053 fused_ordering(904) 00:13:42.053 fused_ordering(905) 00:13:42.053 fused_ordering(906) 00:13:42.053 fused_ordering(907) 00:13:42.053 fused_ordering(908) 00:13:42.053 fused_ordering(909) 00:13:42.053 fused_ordering(910) 00:13:42.053 fused_ordering(911) 00:13:42.053 fused_ordering(912) 00:13:42.053 fused_ordering(913) 00:13:42.053 fused_ordering(914) 00:13:42.053 fused_ordering(915) 00:13:42.053 fused_ordering(916) 00:13:42.053 fused_ordering(917) 00:13:42.053 fused_ordering(918) 00:13:42.053 fused_ordering(919) 00:13:42.053 fused_ordering(920) 00:13:42.053 fused_ordering(921) 00:13:42.053 fused_ordering(922) 00:13:42.053 fused_ordering(923) 00:13:42.053 fused_ordering(924) 00:13:42.053 fused_ordering(925) 00:13:42.053 fused_ordering(926) 00:13:42.053 fused_ordering(927) 00:13:42.053 fused_ordering(928) 00:13:42.053 fused_ordering(929) 00:13:42.053 fused_ordering(930) 00:13:42.053 fused_ordering(931) 00:13:42.053 fused_ordering(932) 00:13:42.053 fused_ordering(933) 00:13:42.053 fused_ordering(934) 00:13:42.053 fused_ordering(935) 00:13:42.053 fused_ordering(936) 00:13:42.053 fused_ordering(937) 00:13:42.053 fused_ordering(938) 00:13:42.053 fused_ordering(939) 00:13:42.053 fused_ordering(940) 00:13:42.053 fused_ordering(941) 00:13:42.053 fused_ordering(942) 00:13:42.053 fused_ordering(943) 00:13:42.053 fused_ordering(944) 00:13:42.053 fused_ordering(945) 00:13:42.053 fused_ordering(946) 00:13:42.053 fused_ordering(947) 00:13:42.053 fused_ordering(948) 00:13:42.053 fused_ordering(949) 00:13:42.053 fused_ordering(950) 00:13:42.053 fused_ordering(951) 00:13:42.053 fused_ordering(952) 00:13:42.053 fused_ordering(953) 00:13:42.053 fused_ordering(954) 00:13:42.053 fused_ordering(955) 00:13:42.053 fused_ordering(956) 00:13:42.053 fused_ordering(957) 00:13:42.053 fused_ordering(958) 00:13:42.053 fused_ordering(959) 00:13:42.053 fused_ordering(960) 00:13:42.053 fused_ordering(961) 00:13:42.053 fused_ordering(962) 00:13:42.053 fused_ordering(963) 00:13:42.053 fused_ordering(964) 00:13:42.053 fused_ordering(965) 00:13:42.053 fused_ordering(966) 00:13:42.053 fused_ordering(967) 00:13:42.053 fused_ordering(968) 00:13:42.053 fused_ordering(969) 00:13:42.053 fused_ordering(970) 00:13:42.053 fused_ordering(971) 00:13:42.053 fused_ordering(972) 00:13:42.053 fused_ordering(973) 00:13:42.053 fused_ordering(974) 00:13:42.054 fused_ordering(975) 00:13:42.054 fused_ordering(976) 00:13:42.054 fused_ordering(977) 00:13:42.054 fused_ordering(978) 00:13:42.054 fused_ordering(979) 00:13:42.054 fused_ordering(980) 00:13:42.054 fused_ordering(981) 00:13:42.054 fused_ordering(982) 00:13:42.054 fused_ordering(983) 00:13:42.054 fused_ordering(984) 00:13:42.054 fused_ordering(985) 00:13:42.054 fused_ordering(986) 00:13:42.054 fused_ordering(987) 00:13:42.054 fused_ordering(988) 00:13:42.054 fused_ordering(989) 00:13:42.054 fused_ordering(990) 00:13:42.054 fused_ordering(991) 00:13:42.054 fused_ordering(992) 00:13:42.054 fused_ordering(993) 00:13:42.054 fused_ordering(994) 00:13:42.054 fused_ordering(995) 00:13:42.054 fused_ordering(996) 00:13:42.054 fused_ordering(997) 00:13:42.054 fused_ordering(998) 00:13:42.054 fused_ordering(999) 00:13:42.054 fused_ordering(1000) 00:13:42.054 fused_ordering(1001) 00:13:42.054 fused_ordering(1002) 00:13:42.054 fused_ordering(1003) 00:13:42.054 fused_ordering(1004) 00:13:42.054 fused_ordering(1005) 00:13:42.054 fused_ordering(1006) 00:13:42.054 fused_ordering(1007) 00:13:42.054 fused_ordering(1008) 00:13:42.054 fused_ordering(1009) 00:13:42.054 fused_ordering(1010) 00:13:42.054 fused_ordering(1011) 00:13:42.054 fused_ordering(1012) 00:13:42.054 fused_ordering(1013) 00:13:42.054 fused_ordering(1014) 00:13:42.054 fused_ordering(1015) 00:13:42.054 fused_ordering(1016) 00:13:42.054 fused_ordering(1017) 00:13:42.054 fused_ordering(1018) 00:13:42.054 fused_ordering(1019) 00:13:42.054 fused_ordering(1020) 00:13:42.054 fused_ordering(1021) 00:13:42.054 fused_ordering(1022) 00:13:42.054 fused_ordering(1023) 00:13:42.054 20:19:13 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:42.054 20:19:13 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:42.054 20:19:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:42.054 20:19:13 -- nvmf/common.sh@116 -- # sync 00:13:42.054 20:19:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:42.054 20:19:13 -- nvmf/common.sh@119 -- # set +e 00:13:42.054 20:19:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:42.054 20:19:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:42.054 rmmod nvme_tcp 00:13:42.054 rmmod nvme_fabrics 00:13:42.054 rmmod nvme_keyring 00:13:42.054 20:19:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:42.054 20:19:13 -- nvmf/common.sh@123 -- # set -e 00:13:42.054 20:19:13 -- nvmf/common.sh@124 -- # return 0 00:13:42.054 20:19:13 -- nvmf/common.sh@477 -- # '[' -n 3353276 ']' 00:13:42.054 20:19:13 -- nvmf/common.sh@478 -- # killprocess 3353276 00:13:42.054 20:19:13 -- common/autotest_common.sh@926 -- # '[' -z 3353276 ']' 00:13:42.054 20:19:13 -- common/autotest_common.sh@930 -- # kill -0 3353276 00:13:42.054 20:19:13 -- common/autotest_common.sh@931 -- # uname 00:13:42.054 20:19:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:42.054 20:19:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3353276 00:13:42.054 20:19:13 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:42.054 20:19:13 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:42.054 20:19:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3353276' 00:13:42.054 killing process with pid 3353276 00:13:42.054 20:19:13 -- common/autotest_common.sh@945 -- # kill 3353276 00:13:42.054 20:19:13 -- common/autotest_common.sh@950 -- # wait 3353276 00:13:42.314 20:19:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:42.314 20:19:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:42.314 20:19:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:42.314 20:19:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:42.314 20:19:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:42.314 20:19:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:42.314 20:19:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:42.314 20:19:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:44.221 20:19:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:44.221 00:13:44.221 real 0m12.400s 00:13:44.221 user 0m7.915s 00:13:44.221 sys 0m6.488s 00:13:44.221 20:19:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:44.221 20:19:16 -- common/autotest_common.sh@10 -- # set +x 00:13:44.221 ************************************ 00:13:44.221 END TEST nvmf_fused_ordering 00:13:44.221 ************************************ 00:13:44.221 20:19:16 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:44.221 20:19:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:44.221 20:19:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:44.221 20:19:16 -- common/autotest_common.sh@10 -- # set +x 00:13:44.221 ************************************ 00:13:44.221 START TEST nvmf_delete_subsystem 00:13:44.221 ************************************ 00:13:44.221 20:19:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:44.481 * Looking for test storage... 00:13:44.481 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:44.481 20:19:16 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:44.481 20:19:16 -- nvmf/common.sh@7 -- # uname -s 00:13:44.481 20:19:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:44.481 20:19:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:44.481 20:19:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:44.481 20:19:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:44.481 20:19:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:44.481 20:19:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:44.481 20:19:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:44.481 20:19:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:44.481 20:19:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:44.481 20:19:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:44.481 20:19:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:13:44.481 20:19:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:13:44.481 20:19:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:44.481 20:19:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:44.481 20:19:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:44.481 20:19:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:44.481 20:19:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:44.481 20:19:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:44.481 20:19:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:44.481 20:19:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.481 20:19:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.481 20:19:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.481 20:19:16 -- paths/export.sh@5 -- # export PATH 00:13:44.481 20:19:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.481 20:19:16 -- nvmf/common.sh@46 -- # : 0 00:13:44.481 20:19:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:44.481 20:19:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:44.481 20:19:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:44.481 20:19:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:44.481 20:19:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:44.481 20:19:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:44.481 20:19:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:44.481 20:19:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:44.481 20:19:16 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:44.481 20:19:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:44.481 20:19:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:44.481 20:19:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:44.481 20:19:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:44.481 20:19:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:44.481 20:19:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.481 20:19:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.481 20:19:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:44.481 20:19:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:44.481 20:19:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:44.481 20:19:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:44.481 20:19:16 -- common/autotest_common.sh@10 -- # set +x 00:13:49.756 20:19:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:49.756 20:19:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:49.756 20:19:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:49.756 20:19:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:49.756 20:19:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:49.756 20:19:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:49.756 20:19:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:49.756 20:19:21 -- nvmf/common.sh@294 -- # net_devs=() 00:13:49.756 20:19:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:49.756 20:19:21 -- nvmf/common.sh@295 -- # e810=() 00:13:49.756 20:19:21 -- nvmf/common.sh@295 -- # local -ga e810 00:13:49.756 20:19:21 -- nvmf/common.sh@296 -- # x722=() 00:13:49.756 20:19:21 -- nvmf/common.sh@296 -- # local -ga x722 00:13:49.756 20:19:21 -- nvmf/common.sh@297 -- # mlx=() 00:13:49.756 20:19:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:49.756 20:19:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:49.756 20:19:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:49.756 20:19:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:49.756 20:19:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:49.756 20:19:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:49.756 20:19:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:13:49.756 Found 0000:86:00.0 (0x8086 - 0x159b) 00:13:49.756 20:19:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:49.756 20:19:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:13:49.756 Found 0000:86:00.1 (0x8086 - 0x159b) 00:13:49.756 20:19:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:49.756 20:19:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:49.756 20:19:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.756 20:19:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:49.756 20:19:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.756 20:19:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:13:49.756 Found net devices under 0000:86:00.0: cvl_0_0 00:13:49.756 20:19:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.756 20:19:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:49.756 20:19:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.756 20:19:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:49.756 20:19:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.756 20:19:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:13:49.756 Found net devices under 0000:86:00.1: cvl_0_1 00:13:49.756 20:19:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.756 20:19:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:49.756 20:19:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:49.756 20:19:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:49.756 20:19:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:49.756 20:19:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:49.756 20:19:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:49.756 20:19:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:49.756 20:19:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:49.756 20:19:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:49.756 20:19:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:49.756 20:19:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:49.756 20:19:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:49.756 20:19:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:49.756 20:19:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:49.756 20:19:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:49.756 20:19:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:49.756 20:19:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:49.757 20:19:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:49.757 20:19:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:49.757 20:19:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:49.757 20:19:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:49.757 20:19:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:49.757 20:19:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:49.757 20:19:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:49.757 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:49.757 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:13:49.757 00:13:49.757 --- 10.0.0.2 ping statistics --- 00:13:49.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.757 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:13:49.757 20:19:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:49.757 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:49.757 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.224 ms 00:13:49.757 00:13:49.757 --- 10.0.0.1 ping statistics --- 00:13:49.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.757 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:13:49.757 20:19:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:49.757 20:19:21 -- nvmf/common.sh@410 -- # return 0 00:13:49.757 20:19:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:49.757 20:19:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:49.757 20:19:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:49.757 20:19:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:49.757 20:19:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:49.757 20:19:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:49.757 20:19:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:49.757 20:19:21 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:49.757 20:19:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:49.757 20:19:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:49.757 20:19:21 -- common/autotest_common.sh@10 -- # set +x 00:13:49.757 20:19:21 -- nvmf/common.sh@469 -- # nvmfpid=3357531 00:13:49.757 20:19:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:49.757 20:19:21 -- nvmf/common.sh@470 -- # waitforlisten 3357531 00:13:49.757 20:19:21 -- common/autotest_common.sh@819 -- # '[' -z 3357531 ']' 00:13:49.757 20:19:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:49.757 20:19:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:49.757 20:19:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:49.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:49.757 20:19:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:49.757 20:19:21 -- common/autotest_common.sh@10 -- # set +x 00:13:49.757 [2024-07-22 20:19:21.594567] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:13:49.757 [2024-07-22 20:19:21.594614] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:49.757 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.757 [2024-07-22 20:19:21.654897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:50.017 [2024-07-22 20:19:21.732650] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:50.017 [2024-07-22 20:19:21.732763] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:50.017 [2024-07-22 20:19:21.732771] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:50.017 [2024-07-22 20:19:21.732777] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:50.017 [2024-07-22 20:19:21.732819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:50.017 [2024-07-22 20:19:21.732821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:50.585 20:19:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:50.585 20:19:22 -- common/autotest_common.sh@852 -- # return 0 00:13:50.585 20:19:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:50.585 20:19:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:50.585 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:13:50.585 20:19:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:50.585 20:19:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:50.585 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:13:50.585 [2024-07-22 20:19:22.422018] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:50.585 20:19:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:50.585 20:19:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:50.585 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:13:50.585 20:19:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:50.585 20:19:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:50.585 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:13:50.585 [2024-07-22 20:19:22.438182] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:50.585 20:19:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:50.585 20:19:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:50.585 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:13:50.585 NULL1 00:13:50.585 20:19:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:50.585 20:19:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:50.585 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:13:50.585 Delay0 00:13:50.585 20:19:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:50.585 20:19:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:50.585 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:13:50.585 20:19:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@28 -- # perf_pid=3357689 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:50.585 20:19:22 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:50.585 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.585 [2024-07-22 20:19:22.512752] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:53.122 20:19:24 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:53.122 20:19:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:53.122 20:19:24 -- common/autotest_common.sh@10 -- # set +x 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 [2024-07-22 20:19:24.682308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f08e800bf20 is same with the state(5) to be set 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 starting I/O failed: -6 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Write completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.122 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 starting I/O failed: -6 00:13:53.123 Write completed with error (sct=0, sc=8) 00:13:53.123 Write completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Write completed with error (sct=0, sc=8) 00:13:53.123 Write completed with error (sct=0, sc=8) 00:13:53.123 starting I/O failed: -6 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 starting I/O failed: -6 00:13:53.123 Write completed with error (sct=0, sc=8) 00:13:53.123 Write completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 starting I/O failed: -6 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Write completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 starting I/O failed: -6 00:13:53.123 Read completed with error (sct=0, sc=8) 00:13:53.123 starting I/O failed: -6 00:13:54.061 [2024-07-22 20:19:25.649789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172b910 is same with the state(5) to be set 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Write completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Write completed with error (sct=0, sc=8) 00:13:54.061 Write completed with error (sct=0, sc=8) 00:13:54.061 Write completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 [2024-07-22 20:19:25.682424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f08e800c1d0 is same with the state(5) to be set 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Write completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Read completed with error (sct=0, sc=8) 00:13:54.061 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 [2024-07-22 20:19:25.684853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173ce40 is same with the state(5) to be set 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 [2024-07-22 20:19:25.684998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1734640 is same with the state(5) to be set 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Read completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 Write completed with error (sct=0, sc=8) 00:13:54.062 [2024-07-22 20:19:25.685155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1734ba0 is same with the state(5) to be set 00:13:54.062 [2024-07-22 20:19:25.685689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x172b910 (9): Bad file descriptor 00:13:54.062 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:54.062 20:19:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:54.062 20:19:25 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:54.062 20:19:25 -- target/delete_subsystem.sh@35 -- # kill -0 3357689 00:13:54.062 20:19:25 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:54.062 Initializing NVMe Controllers 00:13:54.062 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:54.062 Controller IO queue size 128, less than required. 00:13:54.062 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:54.062 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:54.062 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:54.062 Initialization complete. Launching workers. 00:13:54.062 ======================================================== 00:13:54.062 Latency(us) 00:13:54.062 Device Information : IOPS MiB/s Average min max 00:13:54.062 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 188.19 0.09 970215.27 536.07 2001676.58 00:13:54.062 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 148.47 0.07 905609.52 274.18 1042905.08 00:13:54.062 ======================================================== 00:13:54.062 Total : 336.66 0.16 941723.95 274.18 2001676.58 00:13:54.062 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@35 -- # kill -0 3357689 00:13:54.322 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3357689) - No such process 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@45 -- # NOT wait 3357689 00:13:54.322 20:19:26 -- common/autotest_common.sh@640 -- # local es=0 00:13:54.322 20:19:26 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 3357689 00:13:54.322 20:19:26 -- common/autotest_common.sh@628 -- # local arg=wait 00:13:54.322 20:19:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:54.322 20:19:26 -- common/autotest_common.sh@632 -- # type -t wait 00:13:54.322 20:19:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:54.322 20:19:26 -- common/autotest_common.sh@643 -- # wait 3357689 00:13:54.322 20:19:26 -- common/autotest_common.sh@643 -- # es=1 00:13:54.322 20:19:26 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:13:54.322 20:19:26 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:13:54.322 20:19:26 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:54.322 20:19:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:54.322 20:19:26 -- common/autotest_common.sh@10 -- # set +x 00:13:54.322 20:19:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:54.322 20:19:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:54.322 20:19:26 -- common/autotest_common.sh@10 -- # set +x 00:13:54.322 [2024-07-22 20:19:26.214183] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:54.322 20:19:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:54.322 20:19:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:54.322 20:19:26 -- common/autotest_common.sh@10 -- # set +x 00:13:54.322 20:19:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@54 -- # perf_pid=3358267 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@57 -- # kill -0 3358267 00:13:54.322 20:19:26 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:54.322 EAL: No free 2048 kB hugepages reported on node 1 00:13:54.582 [2024-07-22 20:19:26.274955] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:54.841 20:19:26 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:54.841 20:19:26 -- target/delete_subsystem.sh@57 -- # kill -0 3358267 00:13:54.841 20:19:26 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:55.409 20:19:27 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:55.409 20:19:27 -- target/delete_subsystem.sh@57 -- # kill -0 3358267 00:13:55.409 20:19:27 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:55.978 20:19:27 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:55.978 20:19:27 -- target/delete_subsystem.sh@57 -- # kill -0 3358267 00:13:55.978 20:19:27 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:56.547 20:19:28 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:56.547 20:19:28 -- target/delete_subsystem.sh@57 -- # kill -0 3358267 00:13:56.547 20:19:28 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:57.115 20:19:28 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:57.115 20:19:28 -- target/delete_subsystem.sh@57 -- # kill -0 3358267 00:13:57.115 20:19:28 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:57.374 20:19:29 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:57.374 20:19:29 -- target/delete_subsystem.sh@57 -- # kill -0 3358267 00:13:57.374 20:19:29 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:57.634 Initializing NVMe Controllers 00:13:57.634 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:57.634 Controller IO queue size 128, less than required. 00:13:57.634 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:57.634 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:57.634 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:57.634 Initialization complete. Launching workers. 00:13:57.634 ======================================================== 00:13:57.634 Latency(us) 00:13:57.634 Device Information : IOPS MiB/s Average min max 00:13:57.634 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004202.97 1000321.52 1012389.94 00:13:57.634 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005981.31 1000327.94 1051512.15 00:13:57.634 ======================================================== 00:13:57.634 Total : 256.00 0.12 1005092.14 1000321.52 1051512.15 00:13:57.634 00:13:57.894 20:19:29 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:57.894 20:19:29 -- target/delete_subsystem.sh@57 -- # kill -0 3358267 00:13:57.894 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3358267) - No such process 00:13:57.894 20:19:29 -- target/delete_subsystem.sh@67 -- # wait 3358267 00:13:57.894 20:19:29 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:57.894 20:19:29 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:57.894 20:19:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:57.894 20:19:29 -- nvmf/common.sh@116 -- # sync 00:13:57.894 20:19:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:57.894 20:19:29 -- nvmf/common.sh@119 -- # set +e 00:13:57.894 20:19:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:57.894 20:19:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:57.894 rmmod nvme_tcp 00:13:57.894 rmmod nvme_fabrics 00:13:57.894 rmmod nvme_keyring 00:13:57.894 20:19:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:57.894 20:19:29 -- nvmf/common.sh@123 -- # set -e 00:13:57.894 20:19:29 -- nvmf/common.sh@124 -- # return 0 00:13:57.894 20:19:29 -- nvmf/common.sh@477 -- # '[' -n 3357531 ']' 00:13:57.894 20:19:29 -- nvmf/common.sh@478 -- # killprocess 3357531 00:13:57.894 20:19:29 -- common/autotest_common.sh@926 -- # '[' -z 3357531 ']' 00:13:57.894 20:19:29 -- common/autotest_common.sh@930 -- # kill -0 3357531 00:13:57.894 20:19:29 -- common/autotest_common.sh@931 -- # uname 00:13:57.894 20:19:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:57.894 20:19:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3357531 00:13:58.154 20:19:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:58.154 20:19:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:58.154 20:19:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3357531' 00:13:58.154 killing process with pid 3357531 00:13:58.154 20:19:29 -- common/autotest_common.sh@945 -- # kill 3357531 00:13:58.154 20:19:29 -- common/autotest_common.sh@950 -- # wait 3357531 00:13:58.154 20:19:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:58.154 20:19:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:58.154 20:19:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:58.154 20:19:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:58.154 20:19:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:58.154 20:19:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:58.154 20:19:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:58.154 20:19:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:00.728 20:19:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:00.728 00:14:00.728 real 0m15.976s 00:14:00.728 user 0m30.329s 00:14:00.728 sys 0m4.859s 00:14:00.728 20:19:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:00.728 20:19:32 -- common/autotest_common.sh@10 -- # set +x 00:14:00.728 ************************************ 00:14:00.728 END TEST nvmf_delete_subsystem 00:14:00.728 ************************************ 00:14:00.728 20:19:32 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:00.728 20:19:32 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:00.728 20:19:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:00.728 20:19:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:00.728 20:19:32 -- common/autotest_common.sh@10 -- # set +x 00:14:00.728 ************************************ 00:14:00.728 START TEST nvmf_nvme_cli 00:14:00.728 ************************************ 00:14:00.728 20:19:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:00.728 * Looking for test storage... 00:14:00.728 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:00.728 20:19:32 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:00.728 20:19:32 -- nvmf/common.sh@7 -- # uname -s 00:14:00.728 20:19:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:00.728 20:19:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:00.728 20:19:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:00.728 20:19:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:00.728 20:19:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:00.728 20:19:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:00.728 20:19:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:00.728 20:19:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:00.728 20:19:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:00.728 20:19:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:00.728 20:19:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:14:00.728 20:19:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:14:00.728 20:19:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:00.728 20:19:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:00.728 20:19:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:00.728 20:19:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:00.728 20:19:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:00.728 20:19:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:00.728 20:19:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:00.728 20:19:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:00.728 20:19:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:00.728 20:19:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:00.728 20:19:32 -- paths/export.sh@5 -- # export PATH 00:14:00.728 20:19:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:00.728 20:19:32 -- nvmf/common.sh@46 -- # : 0 00:14:00.728 20:19:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:00.728 20:19:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:00.728 20:19:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:00.728 20:19:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:00.728 20:19:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:00.728 20:19:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:00.728 20:19:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:00.728 20:19:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:00.728 20:19:32 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:00.728 20:19:32 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:00.728 20:19:32 -- target/nvme_cli.sh@14 -- # devs=() 00:14:00.728 20:19:32 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:00.728 20:19:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:00.728 20:19:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:00.728 20:19:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:00.728 20:19:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:00.728 20:19:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:00.728 20:19:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:00.728 20:19:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:00.728 20:19:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:00.728 20:19:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:00.728 20:19:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:00.728 20:19:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:00.728 20:19:32 -- common/autotest_common.sh@10 -- # set +x 00:14:06.004 20:19:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:06.004 20:19:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:06.004 20:19:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:06.004 20:19:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:06.004 20:19:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:06.004 20:19:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:06.004 20:19:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:06.004 20:19:36 -- nvmf/common.sh@294 -- # net_devs=() 00:14:06.004 20:19:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:06.004 20:19:36 -- nvmf/common.sh@295 -- # e810=() 00:14:06.004 20:19:36 -- nvmf/common.sh@295 -- # local -ga e810 00:14:06.004 20:19:36 -- nvmf/common.sh@296 -- # x722=() 00:14:06.004 20:19:36 -- nvmf/common.sh@296 -- # local -ga x722 00:14:06.004 20:19:36 -- nvmf/common.sh@297 -- # mlx=() 00:14:06.004 20:19:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:06.004 20:19:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:06.004 20:19:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:06.004 20:19:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:06.005 20:19:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:06.005 20:19:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:06.005 20:19:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:14:06.005 Found 0000:86:00.0 (0x8086 - 0x159b) 00:14:06.005 20:19:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:06.005 20:19:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:14:06.005 Found 0000:86:00.1 (0x8086 - 0x159b) 00:14:06.005 20:19:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:06.005 20:19:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:06.005 20:19:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:06.005 20:19:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:06.005 20:19:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:06.005 20:19:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:14:06.005 Found net devices under 0000:86:00.0: cvl_0_0 00:14:06.005 20:19:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:06.005 20:19:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:06.005 20:19:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:06.005 20:19:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:06.005 20:19:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:06.005 20:19:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:14:06.005 Found net devices under 0000:86:00.1: cvl_0_1 00:14:06.005 20:19:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:06.005 20:19:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:06.005 20:19:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:06.005 20:19:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:06.005 20:19:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:06.005 20:19:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:06.005 20:19:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:06.005 20:19:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:06.005 20:19:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:06.005 20:19:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:06.005 20:19:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:06.005 20:19:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:06.005 20:19:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:06.005 20:19:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:06.005 20:19:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:06.005 20:19:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:06.005 20:19:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:06.005 20:19:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:06.005 20:19:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:06.005 20:19:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:06.005 20:19:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:06.005 20:19:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:06.005 20:19:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:06.005 20:19:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:06.005 20:19:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:06.005 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:06.005 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:14:06.005 00:14:06.005 --- 10.0.0.2 ping statistics --- 00:14:06.005 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.005 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:14:06.005 20:19:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:06.005 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:06.005 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.323 ms 00:14:06.005 00:14:06.005 --- 10.0.0.1 ping statistics --- 00:14:06.005 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.005 rtt min/avg/max/mdev = 0.323/0.323/0.323/0.000 ms 00:14:06.005 20:19:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:06.005 20:19:37 -- nvmf/common.sh@410 -- # return 0 00:14:06.005 20:19:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:06.005 20:19:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:06.005 20:19:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:06.005 20:19:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:06.005 20:19:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:06.005 20:19:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:06.005 20:19:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:06.005 20:19:37 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:06.005 20:19:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:06.005 20:19:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:06.005 20:19:37 -- common/autotest_common.sh@10 -- # set +x 00:14:06.005 20:19:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:06.005 20:19:37 -- nvmf/common.sh@469 -- # nvmfpid=3362283 00:14:06.005 20:19:37 -- nvmf/common.sh@470 -- # waitforlisten 3362283 00:14:06.005 20:19:37 -- common/autotest_common.sh@819 -- # '[' -z 3362283 ']' 00:14:06.005 20:19:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:06.005 20:19:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:06.005 20:19:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:06.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:06.005 20:19:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:06.005 20:19:37 -- common/autotest_common.sh@10 -- # set +x 00:14:06.005 [2024-07-22 20:19:37.216932] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:14:06.005 [2024-07-22 20:19:37.216976] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:06.005 EAL: No free 2048 kB hugepages reported on node 1 00:14:06.005 [2024-07-22 20:19:37.274516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:06.005 [2024-07-22 20:19:37.354212] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:06.005 [2024-07-22 20:19:37.354323] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:06.005 [2024-07-22 20:19:37.354330] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:06.005 [2024-07-22 20:19:37.354337] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:06.005 [2024-07-22 20:19:37.354378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:06.005 [2024-07-22 20:19:37.354494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:06.005 [2024-07-22 20:19:37.354557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:06.005 [2024-07-22 20:19:37.354558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:06.265 20:19:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:06.265 20:19:38 -- common/autotest_common.sh@852 -- # return 0 00:14:06.265 20:19:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:06.265 20:19:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 20:19:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:06.265 20:19:38 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:06.265 20:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 [2024-07-22 20:19:38.065331] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:06.265 20:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:06.265 20:19:38 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:06.265 20:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 Malloc0 00:14:06.265 20:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:06.265 20:19:38 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:06.265 20:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 Malloc1 00:14:06.265 20:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:06.265 20:19:38 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:06.265 20:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 20:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:06.265 20:19:38 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:06.265 20:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 20:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:06.265 20:19:38 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:06.265 20:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 20:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:06.265 20:19:38 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:06.265 20:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 [2024-07-22 20:19:38.142377] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:06.265 20:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:06.265 20:19:38 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:06.265 20:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:06.265 20:19:38 -- common/autotest_common.sh@10 -- # set +x 00:14:06.265 20:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:06.265 20:19:38 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 4420 00:14:06.525 00:14:06.525 Discovery Log Number of Records 2, Generation counter 2 00:14:06.525 =====Discovery Log Entry 0====== 00:14:06.525 trtype: tcp 00:14:06.525 adrfam: ipv4 00:14:06.525 subtype: current discovery subsystem 00:14:06.525 treq: not required 00:14:06.525 portid: 0 00:14:06.525 trsvcid: 4420 00:14:06.525 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:06.525 traddr: 10.0.0.2 00:14:06.525 eflags: explicit discovery connections, duplicate discovery information 00:14:06.525 sectype: none 00:14:06.525 =====Discovery Log Entry 1====== 00:14:06.525 trtype: tcp 00:14:06.525 adrfam: ipv4 00:14:06.525 subtype: nvme subsystem 00:14:06.525 treq: not required 00:14:06.525 portid: 0 00:14:06.525 trsvcid: 4420 00:14:06.525 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:06.525 traddr: 10.0.0.2 00:14:06.525 eflags: none 00:14:06.525 sectype: none 00:14:06.525 20:19:38 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:06.525 20:19:38 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:06.525 20:19:38 -- nvmf/common.sh@510 -- # local dev _ 00:14:06.525 20:19:38 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.525 20:19:38 -- nvmf/common.sh@509 -- # nvme list 00:14:06.525 20:19:38 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:06.525 20:19:38 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.525 20:19:38 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:06.525 20:19:38 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.525 20:19:38 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:06.525 20:19:38 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:07.904 20:19:39 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:07.904 20:19:39 -- common/autotest_common.sh@1177 -- # local i=0 00:14:07.904 20:19:39 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:07.904 20:19:39 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:14:07.904 20:19:39 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:14:07.904 20:19:39 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:09.810 20:19:41 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:09.810 20:19:41 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:09.810 20:19:41 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:09.810 20:19:41 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:14:09.810 20:19:41 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:09.810 20:19:41 -- common/autotest_common.sh@1187 -- # return 0 00:14:09.810 20:19:41 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:09.810 20:19:41 -- nvmf/common.sh@510 -- # local dev _ 00:14:09.810 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.810 20:19:41 -- nvmf/common.sh@509 -- # nvme list 00:14:09.810 20:19:41 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:09.810 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.810 20:19:41 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:09.810 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.810 20:19:41 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:09.810 20:19:41 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:09.810 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.810 20:19:41 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:09.810 20:19:41 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:09.810 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.810 20:19:41 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:14:09.810 /dev/nvme0n1 ]] 00:14:09.810 20:19:41 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:09.810 20:19:41 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:09.810 20:19:41 -- nvmf/common.sh@510 -- # local dev _ 00:14:09.810 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.810 20:19:41 -- nvmf/common.sh@509 -- # nvme list 00:14:09.810 20:19:41 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:09.810 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.810 20:19:41 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:09.810 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.811 20:19:41 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:09.811 20:19:41 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:09.811 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.811 20:19:41 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:09.811 20:19:41 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:09.811 20:19:41 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.811 20:19:41 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:09.811 20:19:41 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:09.811 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:09.811 20:19:41 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:09.811 20:19:41 -- common/autotest_common.sh@1198 -- # local i=0 00:14:09.811 20:19:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:09.811 20:19:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:09.811 20:19:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:09.811 20:19:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:09.811 20:19:41 -- common/autotest_common.sh@1210 -- # return 0 00:14:09.811 20:19:41 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:09.811 20:19:41 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:09.811 20:19:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:09.811 20:19:41 -- common/autotest_common.sh@10 -- # set +x 00:14:09.811 20:19:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:09.811 20:19:41 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:09.811 20:19:41 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:09.811 20:19:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:09.811 20:19:41 -- nvmf/common.sh@116 -- # sync 00:14:09.811 20:19:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:09.811 20:19:41 -- nvmf/common.sh@119 -- # set +e 00:14:09.811 20:19:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:09.811 20:19:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:09.811 rmmod nvme_tcp 00:14:09.811 rmmod nvme_fabrics 00:14:09.811 rmmod nvme_keyring 00:14:09.811 20:19:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:09.811 20:19:41 -- nvmf/common.sh@123 -- # set -e 00:14:09.811 20:19:41 -- nvmf/common.sh@124 -- # return 0 00:14:09.811 20:19:41 -- nvmf/common.sh@477 -- # '[' -n 3362283 ']' 00:14:09.811 20:19:41 -- nvmf/common.sh@478 -- # killprocess 3362283 00:14:09.811 20:19:41 -- common/autotest_common.sh@926 -- # '[' -z 3362283 ']' 00:14:09.811 20:19:41 -- common/autotest_common.sh@930 -- # kill -0 3362283 00:14:09.811 20:19:41 -- common/autotest_common.sh@931 -- # uname 00:14:09.811 20:19:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:09.811 20:19:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3362283 00:14:09.811 20:19:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:09.811 20:19:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:09.811 20:19:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3362283' 00:14:09.811 killing process with pid 3362283 00:14:09.811 20:19:41 -- common/autotest_common.sh@945 -- # kill 3362283 00:14:09.811 20:19:41 -- common/autotest_common.sh@950 -- # wait 3362283 00:14:10.070 20:19:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:10.070 20:19:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:10.070 20:19:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:10.070 20:19:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:10.070 20:19:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:10.070 20:19:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:10.070 20:19:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:10.070 20:19:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.607 20:19:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:12.607 00:14:12.607 real 0m11.844s 00:14:12.607 user 0m19.467s 00:14:12.607 sys 0m4.186s 00:14:12.607 20:19:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:12.607 20:19:44 -- common/autotest_common.sh@10 -- # set +x 00:14:12.607 ************************************ 00:14:12.607 END TEST nvmf_nvme_cli 00:14:12.607 ************************************ 00:14:12.607 20:19:44 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:12.607 20:19:44 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:12.607 20:19:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:12.607 20:19:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:12.607 20:19:44 -- common/autotest_common.sh@10 -- # set +x 00:14:12.607 ************************************ 00:14:12.607 START TEST nvmf_host_management 00:14:12.607 ************************************ 00:14:12.607 20:19:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:12.607 * Looking for test storage... 00:14:12.607 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:12.607 20:19:44 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:12.607 20:19:44 -- nvmf/common.sh@7 -- # uname -s 00:14:12.607 20:19:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:12.607 20:19:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:12.607 20:19:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:12.607 20:19:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:12.607 20:19:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:12.607 20:19:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:12.607 20:19:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:12.607 20:19:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:12.607 20:19:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:12.607 20:19:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:12.607 20:19:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:14:12.608 20:19:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:14:12.608 20:19:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:12.608 20:19:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:12.608 20:19:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:12.608 20:19:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:12.608 20:19:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:12.608 20:19:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:12.608 20:19:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:12.608 20:19:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.608 20:19:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.608 20:19:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.608 20:19:44 -- paths/export.sh@5 -- # export PATH 00:14:12.608 20:19:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.608 20:19:44 -- nvmf/common.sh@46 -- # : 0 00:14:12.608 20:19:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:12.608 20:19:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:12.608 20:19:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:12.608 20:19:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:12.608 20:19:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:12.608 20:19:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:12.608 20:19:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:12.608 20:19:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:12.608 20:19:44 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:12.608 20:19:44 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:12.608 20:19:44 -- target/host_management.sh@104 -- # nvmftestinit 00:14:12.608 20:19:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:12.608 20:19:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:12.608 20:19:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:12.608 20:19:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:12.608 20:19:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:12.608 20:19:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:12.608 20:19:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:12.608 20:19:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.608 20:19:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:12.608 20:19:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:12.608 20:19:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:12.608 20:19:44 -- common/autotest_common.sh@10 -- # set +x 00:14:17.889 20:19:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:17.889 20:19:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:17.889 20:19:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:17.889 20:19:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:17.889 20:19:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:17.889 20:19:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:17.889 20:19:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:17.889 20:19:49 -- nvmf/common.sh@294 -- # net_devs=() 00:14:17.889 20:19:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:17.889 20:19:49 -- nvmf/common.sh@295 -- # e810=() 00:14:17.889 20:19:49 -- nvmf/common.sh@295 -- # local -ga e810 00:14:17.889 20:19:49 -- nvmf/common.sh@296 -- # x722=() 00:14:17.889 20:19:49 -- nvmf/common.sh@296 -- # local -ga x722 00:14:17.889 20:19:49 -- nvmf/common.sh@297 -- # mlx=() 00:14:17.889 20:19:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:17.889 20:19:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:17.889 20:19:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:17.889 20:19:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:17.889 20:19:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:17.889 20:19:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:17.889 20:19:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:14:17.889 Found 0000:86:00.0 (0x8086 - 0x159b) 00:14:17.889 20:19:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:17.889 20:19:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:14:17.889 Found 0000:86:00.1 (0x8086 - 0x159b) 00:14:17.889 20:19:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:17.889 20:19:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:17.889 20:19:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:17.889 20:19:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:17.889 20:19:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:17.889 20:19:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:14:17.889 Found net devices under 0000:86:00.0: cvl_0_0 00:14:17.889 20:19:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:17.889 20:19:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:17.889 20:19:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:17.889 20:19:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:17.889 20:19:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:17.889 20:19:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:14:17.889 Found net devices under 0000:86:00.1: cvl_0_1 00:14:17.889 20:19:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:17.889 20:19:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:17.889 20:19:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:17.889 20:19:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:17.889 20:19:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:17.889 20:19:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:17.889 20:19:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:17.889 20:19:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:17.889 20:19:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:17.889 20:19:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:17.889 20:19:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:17.889 20:19:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:17.889 20:19:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:17.889 20:19:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:17.889 20:19:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:17.889 20:19:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:17.889 20:19:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:17.889 20:19:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:17.889 20:19:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:17.889 20:19:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:17.889 20:19:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:17.889 20:19:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:17.889 20:19:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:17.889 20:19:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:17.889 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:17.889 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.145 ms 00:14:17.889 00:14:17.889 --- 10.0.0.2 ping statistics --- 00:14:17.889 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:17.889 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:14:17.889 20:19:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:17.889 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:17.889 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.308 ms 00:14:17.889 00:14:17.889 --- 10.0.0.1 ping statistics --- 00:14:17.889 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:17.889 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:14:17.889 20:19:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:17.889 20:19:49 -- nvmf/common.sh@410 -- # return 0 00:14:17.889 20:19:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:17.889 20:19:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:17.889 20:19:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:17.889 20:19:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:17.889 20:19:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:17.889 20:19:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:17.889 20:19:49 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:17.889 20:19:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:14:17.889 20:19:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:17.889 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:14:17.889 ************************************ 00:14:17.889 START TEST nvmf_host_management 00:14:17.889 ************************************ 00:14:17.889 20:19:49 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:14:17.889 20:19:49 -- target/host_management.sh@69 -- # starttarget 00:14:17.889 20:19:49 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:17.889 20:19:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:17.889 20:19:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:17.889 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:14:17.889 20:19:49 -- nvmf/common.sh@469 -- # nvmfpid=3366569 00:14:17.889 20:19:49 -- nvmf/common.sh@470 -- # waitforlisten 3366569 00:14:17.889 20:19:49 -- common/autotest_common.sh@819 -- # '[' -z 3366569 ']' 00:14:17.889 20:19:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:17.889 20:19:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:17.890 20:19:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:17.890 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:17.890 20:19:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:17.890 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:14:17.890 20:19:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:18.149 [2024-07-22 20:19:49.855594] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:14:18.149 [2024-07-22 20:19:49.855637] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:18.149 EAL: No free 2048 kB hugepages reported on node 1 00:14:18.149 [2024-07-22 20:19:49.913669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:18.149 [2024-07-22 20:19:49.990940] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:18.149 [2024-07-22 20:19:49.991052] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:18.149 [2024-07-22 20:19:49.991060] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:18.149 [2024-07-22 20:19:49.991067] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:18.149 [2024-07-22 20:19:49.991105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:18.149 [2024-07-22 20:19:49.991124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:18.149 [2024-07-22 20:19:49.991234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:18.149 [2024-07-22 20:19:49.991235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:19.087 20:19:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:19.087 20:19:50 -- common/autotest_common.sh@852 -- # return 0 00:14:19.087 20:19:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:19.087 20:19:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:19.087 20:19:50 -- common/autotest_common.sh@10 -- # set +x 00:14:19.087 20:19:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:19.087 20:19:50 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:19.087 20:19:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:19.087 20:19:50 -- common/autotest_common.sh@10 -- # set +x 00:14:19.087 [2024-07-22 20:19:50.709350] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:19.087 20:19:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:19.087 20:19:50 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:19.087 20:19:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:19.087 20:19:50 -- common/autotest_common.sh@10 -- # set +x 00:14:19.087 20:19:50 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:19.087 20:19:50 -- target/host_management.sh@23 -- # cat 00:14:19.087 20:19:50 -- target/host_management.sh@30 -- # rpc_cmd 00:14:19.087 20:19:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:19.087 20:19:50 -- common/autotest_common.sh@10 -- # set +x 00:14:19.087 Malloc0 00:14:19.087 [2024-07-22 20:19:50.769077] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:19.087 20:19:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:19.087 20:19:50 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:19.087 20:19:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:19.087 20:19:50 -- common/autotest_common.sh@10 -- # set +x 00:14:19.087 20:19:50 -- target/host_management.sh@73 -- # perfpid=3366836 00:14:19.087 20:19:50 -- target/host_management.sh@74 -- # waitforlisten 3366836 /var/tmp/bdevperf.sock 00:14:19.087 20:19:50 -- common/autotest_common.sh@819 -- # '[' -z 3366836 ']' 00:14:19.087 20:19:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:19.087 20:19:50 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:19.087 20:19:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:19.087 20:19:50 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:19.087 20:19:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:19.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:19.087 20:19:50 -- nvmf/common.sh@520 -- # config=() 00:14:19.087 20:19:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:19.087 20:19:50 -- nvmf/common.sh@520 -- # local subsystem config 00:14:19.087 20:19:50 -- common/autotest_common.sh@10 -- # set +x 00:14:19.087 20:19:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:19.087 20:19:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:19.087 { 00:14:19.087 "params": { 00:14:19.087 "name": "Nvme$subsystem", 00:14:19.087 "trtype": "$TEST_TRANSPORT", 00:14:19.087 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:19.087 "adrfam": "ipv4", 00:14:19.087 "trsvcid": "$NVMF_PORT", 00:14:19.087 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:19.087 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:19.087 "hdgst": ${hdgst:-false}, 00:14:19.087 "ddgst": ${ddgst:-false} 00:14:19.087 }, 00:14:19.087 "method": "bdev_nvme_attach_controller" 00:14:19.087 } 00:14:19.087 EOF 00:14:19.087 )") 00:14:19.087 20:19:50 -- nvmf/common.sh@542 -- # cat 00:14:19.087 20:19:50 -- nvmf/common.sh@544 -- # jq . 00:14:19.087 20:19:50 -- nvmf/common.sh@545 -- # IFS=, 00:14:19.087 20:19:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:19.087 "params": { 00:14:19.087 "name": "Nvme0", 00:14:19.087 "trtype": "tcp", 00:14:19.087 "traddr": "10.0.0.2", 00:14:19.087 "adrfam": "ipv4", 00:14:19.087 "trsvcid": "4420", 00:14:19.087 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:19.087 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:19.087 "hdgst": false, 00:14:19.087 "ddgst": false 00:14:19.087 }, 00:14:19.087 "method": "bdev_nvme_attach_controller" 00:14:19.087 }' 00:14:19.087 [2024-07-22 20:19:50.857739] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:14:19.087 [2024-07-22 20:19:50.857785] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3366836 ] 00:14:19.087 EAL: No free 2048 kB hugepages reported on node 1 00:14:19.087 [2024-07-22 20:19:50.913254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:19.087 [2024-07-22 20:19:50.983938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:19.346 Running I/O for 10 seconds... 00:14:19.917 20:19:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:19.917 20:19:51 -- common/autotest_common.sh@852 -- # return 0 00:14:19.917 20:19:51 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:19.917 20:19:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:19.917 20:19:51 -- common/autotest_common.sh@10 -- # set +x 00:14:19.917 20:19:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:19.917 20:19:51 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:19.917 20:19:51 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:19.917 20:19:51 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:19.917 20:19:51 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:19.917 20:19:51 -- target/host_management.sh@52 -- # local ret=1 00:14:19.917 20:19:51 -- target/host_management.sh@53 -- # local i 00:14:19.917 20:19:51 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:19.917 20:19:51 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:19.917 20:19:51 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:19.917 20:19:51 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:19.917 20:19:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:19.917 20:19:51 -- common/autotest_common.sh@10 -- # set +x 00:14:19.917 20:19:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:19.917 20:19:51 -- target/host_management.sh@55 -- # read_io_count=1121 00:14:19.917 20:19:51 -- target/host_management.sh@58 -- # '[' 1121 -ge 100 ']' 00:14:19.917 20:19:51 -- target/host_management.sh@59 -- # ret=0 00:14:19.917 20:19:51 -- target/host_management.sh@60 -- # break 00:14:19.917 20:19:51 -- target/host_management.sh@64 -- # return 0 00:14:19.917 20:19:51 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:19.917 20:19:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:19.917 20:19:51 -- common/autotest_common.sh@10 -- # set +x 00:14:19.917 [2024-07-22 20:19:51.732495] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732537] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732545] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732552] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732558] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732564] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732581] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732587] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732593] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732599] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732605] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.917 [2024-07-22 20:19:51.732611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732624] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732630] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732636] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732642] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732648] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732660] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732672] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732686] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732692] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732710] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732722] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732727] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732733] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732739] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732745] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732751] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732757] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732769] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732781] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732787] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732799] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732805] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732811] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732817] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732823] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732829] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732835] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732848] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732854] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732861] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732867] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732879] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732884] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732896] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732902] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732908] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 [2024-07-22 20:19:51.732914] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xde2a40 is same with the state(5) to be set 00:14:19.918 20:19:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:19.918 20:19:51 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:19.918 20:19:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:19.918 [2024-07-22 20:19:51.738155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.918 [2024-07-22 20:19:51.738375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.918 [2024-07-22 20:19:51.738383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c 20:19:51 -- common/autotest_common.sh@10 -- # set +x 00:14:19.919 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.919 [2024-07-22 20:19:51.738940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.919 [2024-07-22 20:19:51.738948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.738955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.738963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.738970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.738977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.738984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.738992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.738999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:19.920 [2024-07-22 20:19:51.739139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:19.920 [2024-07-22 20:19:51.739200] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1991170 was disconnected and freed. reset controller. 00:14:19.920 [2024-07-22 20:19:51.740113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:19.920 task offset: 32384 on job bdev=Nvme0n1 fails 00:14:19.920 00:14:19.920 Latency(us) 00:14:19.920 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:19.920 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:19.920 Job: Nvme0n1 ended in about 0.49 seconds with error 00:14:19.920 Verification LBA range: start 0x0 length 0x400 00:14:19.920 Nvme0n1 : 0.49 2603.23 162.70 131.91 0.00 23077.93 1346.34 44678.46 00:14:19.920 =================================================================================================================== 00:14:19.920 Total : 2603.23 162.70 131.91 0.00 23077.93 1346.34 44678.46 00:14:19.920 [2024-07-22 20:19:51.741702] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:19.920 [2024-07-22 20:19:51.741716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1993900 (9): Bad file descriptor 00:14:19.920 20:19:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:19.920 20:19:51 -- target/host_management.sh@87 -- # sleep 1 00:14:19.920 [2024-07-22 20:19:51.795855] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:20.860 20:19:52 -- target/host_management.sh@91 -- # kill -9 3366836 00:14:20.860 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3366836) - No such process 00:14:20.860 20:19:52 -- target/host_management.sh@91 -- # true 00:14:20.860 20:19:52 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:20.860 20:19:52 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:20.860 20:19:52 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:20.860 20:19:52 -- nvmf/common.sh@520 -- # config=() 00:14:20.860 20:19:52 -- nvmf/common.sh@520 -- # local subsystem config 00:14:20.860 20:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:20.860 20:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:20.860 { 00:14:20.860 "params": { 00:14:20.860 "name": "Nvme$subsystem", 00:14:20.860 "trtype": "$TEST_TRANSPORT", 00:14:20.860 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:20.860 "adrfam": "ipv4", 00:14:20.860 "trsvcid": "$NVMF_PORT", 00:14:20.860 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:20.860 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:20.860 "hdgst": ${hdgst:-false}, 00:14:20.860 "ddgst": ${ddgst:-false} 00:14:20.860 }, 00:14:20.860 "method": "bdev_nvme_attach_controller" 00:14:20.860 } 00:14:20.860 EOF 00:14:20.860 )") 00:14:20.860 20:19:52 -- nvmf/common.sh@542 -- # cat 00:14:20.860 20:19:52 -- nvmf/common.sh@544 -- # jq . 00:14:20.860 20:19:52 -- nvmf/common.sh@545 -- # IFS=, 00:14:20.860 20:19:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:20.860 "params": { 00:14:20.860 "name": "Nvme0", 00:14:20.860 "trtype": "tcp", 00:14:20.860 "traddr": "10.0.0.2", 00:14:20.860 "adrfam": "ipv4", 00:14:20.860 "trsvcid": "4420", 00:14:20.860 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:20.860 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:20.860 "hdgst": false, 00:14:20.860 "ddgst": false 00:14:20.860 }, 00:14:20.860 "method": "bdev_nvme_attach_controller" 00:14:20.860 }' 00:14:21.120 [2024-07-22 20:19:52.798897] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:14:21.120 [2024-07-22 20:19:52.798945] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3367091 ] 00:14:21.120 EAL: No free 2048 kB hugepages reported on node 1 00:14:21.120 [2024-07-22 20:19:52.853540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:21.120 [2024-07-22 20:19:52.923550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:21.379 Running I/O for 1 seconds... 00:14:22.318 00:14:22.318 Latency(us) 00:14:22.318 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:22.318 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:22.318 Verification LBA range: start 0x0 length 0x400 00:14:22.318 Nvme0n1 : 1.01 2362.24 147.64 0.00 0.00 26783.02 3105.84 45818.21 00:14:22.318 =================================================================================================================== 00:14:22.318 Total : 2362.24 147.64 0.00 0.00 26783.02 3105.84 45818.21 00:14:22.577 20:19:54 -- target/host_management.sh@101 -- # stoptarget 00:14:22.577 20:19:54 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:22.577 20:19:54 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:22.577 20:19:54 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:22.577 20:19:54 -- target/host_management.sh@40 -- # nvmftestfini 00:14:22.577 20:19:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:22.577 20:19:54 -- nvmf/common.sh@116 -- # sync 00:14:22.577 20:19:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:22.577 20:19:54 -- nvmf/common.sh@119 -- # set +e 00:14:22.577 20:19:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:22.577 20:19:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:22.577 rmmod nvme_tcp 00:14:22.577 rmmod nvme_fabrics 00:14:22.837 rmmod nvme_keyring 00:14:22.837 20:19:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:22.837 20:19:54 -- nvmf/common.sh@123 -- # set -e 00:14:22.837 20:19:54 -- nvmf/common.sh@124 -- # return 0 00:14:22.837 20:19:54 -- nvmf/common.sh@477 -- # '[' -n 3366569 ']' 00:14:22.837 20:19:54 -- nvmf/common.sh@478 -- # killprocess 3366569 00:14:22.837 20:19:54 -- common/autotest_common.sh@926 -- # '[' -z 3366569 ']' 00:14:22.837 20:19:54 -- common/autotest_common.sh@930 -- # kill -0 3366569 00:14:22.837 20:19:54 -- common/autotest_common.sh@931 -- # uname 00:14:22.837 20:19:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:22.838 20:19:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3366569 00:14:22.838 20:19:54 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:22.838 20:19:54 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:22.838 20:19:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3366569' 00:14:22.838 killing process with pid 3366569 00:14:22.838 20:19:54 -- common/autotest_common.sh@945 -- # kill 3366569 00:14:22.838 20:19:54 -- common/autotest_common.sh@950 -- # wait 3366569 00:14:23.116 [2024-07-22 20:19:54.792216] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:23.116 20:19:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:23.116 20:19:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:23.116 20:19:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:23.116 20:19:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:23.116 20:19:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:23.116 20:19:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:23.116 20:19:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:23.116 20:19:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:25.076 20:19:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:25.076 00:14:25.076 real 0m7.069s 00:14:25.076 user 0m21.763s 00:14:25.076 sys 0m1.157s 00:14:25.076 20:19:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:25.076 20:19:56 -- common/autotest_common.sh@10 -- # set +x 00:14:25.076 ************************************ 00:14:25.076 END TEST nvmf_host_management 00:14:25.076 ************************************ 00:14:25.076 20:19:56 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:25.076 00:14:25.076 real 0m12.843s 00:14:25.076 user 0m23.305s 00:14:25.076 sys 0m5.413s 00:14:25.076 20:19:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:25.076 20:19:56 -- common/autotest_common.sh@10 -- # set +x 00:14:25.076 ************************************ 00:14:25.076 END TEST nvmf_host_management 00:14:25.076 ************************************ 00:14:25.076 20:19:56 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:25.076 20:19:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:25.076 20:19:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:25.076 20:19:56 -- common/autotest_common.sh@10 -- # set +x 00:14:25.076 ************************************ 00:14:25.076 START TEST nvmf_lvol 00:14:25.076 ************************************ 00:14:25.076 20:19:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:25.335 * Looking for test storage... 00:14:25.335 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:25.335 20:19:57 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:25.335 20:19:57 -- nvmf/common.sh@7 -- # uname -s 00:14:25.335 20:19:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:25.335 20:19:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:25.335 20:19:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:25.335 20:19:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:25.335 20:19:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:25.335 20:19:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:25.335 20:19:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:25.335 20:19:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:25.335 20:19:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:25.335 20:19:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:25.335 20:19:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:14:25.335 20:19:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:14:25.335 20:19:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:25.335 20:19:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:25.335 20:19:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:25.335 20:19:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:25.335 20:19:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:25.335 20:19:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:25.335 20:19:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:25.335 20:19:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.335 20:19:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.335 20:19:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.335 20:19:57 -- paths/export.sh@5 -- # export PATH 00:14:25.336 20:19:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.336 20:19:57 -- nvmf/common.sh@46 -- # : 0 00:14:25.336 20:19:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:25.336 20:19:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:25.336 20:19:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:25.336 20:19:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:25.336 20:19:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:25.336 20:19:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:25.336 20:19:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:25.336 20:19:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:25.336 20:19:57 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:25.336 20:19:57 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:25.336 20:19:57 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:25.336 20:19:57 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:25.336 20:19:57 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:25.336 20:19:57 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:25.336 20:19:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:25.336 20:19:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:25.336 20:19:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:25.336 20:19:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:25.336 20:19:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:25.336 20:19:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:25.336 20:19:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:25.336 20:19:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:25.336 20:19:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:25.336 20:19:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:25.336 20:19:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:25.336 20:19:57 -- common/autotest_common.sh@10 -- # set +x 00:14:30.616 20:20:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:30.616 20:20:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:30.616 20:20:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:30.616 20:20:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:30.616 20:20:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:30.616 20:20:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:30.616 20:20:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:30.616 20:20:02 -- nvmf/common.sh@294 -- # net_devs=() 00:14:30.616 20:20:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:30.616 20:20:02 -- nvmf/common.sh@295 -- # e810=() 00:14:30.616 20:20:02 -- nvmf/common.sh@295 -- # local -ga e810 00:14:30.616 20:20:02 -- nvmf/common.sh@296 -- # x722=() 00:14:30.616 20:20:02 -- nvmf/common.sh@296 -- # local -ga x722 00:14:30.616 20:20:02 -- nvmf/common.sh@297 -- # mlx=() 00:14:30.616 20:20:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:30.616 20:20:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:30.616 20:20:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:30.616 20:20:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:30.616 20:20:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:30.616 20:20:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:30.616 20:20:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:14:30.616 Found 0000:86:00.0 (0x8086 - 0x159b) 00:14:30.616 20:20:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:30.616 20:20:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:14:30.616 Found 0000:86:00.1 (0x8086 - 0x159b) 00:14:30.616 20:20:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:30.616 20:20:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:30.616 20:20:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:30.616 20:20:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:30.616 20:20:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:30.616 20:20:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:14:30.616 Found net devices under 0000:86:00.0: cvl_0_0 00:14:30.616 20:20:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:30.616 20:20:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:30.616 20:20:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:30.616 20:20:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:30.616 20:20:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:30.616 20:20:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:14:30.616 Found net devices under 0000:86:00.1: cvl_0_1 00:14:30.616 20:20:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:30.616 20:20:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:30.616 20:20:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:30.616 20:20:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:30.616 20:20:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:30.616 20:20:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:30.616 20:20:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:30.616 20:20:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:30.616 20:20:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:30.616 20:20:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:30.616 20:20:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:30.616 20:20:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:30.616 20:20:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:30.616 20:20:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:30.616 20:20:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:30.616 20:20:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:30.616 20:20:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:30.616 20:20:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:30.616 20:20:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:30.616 20:20:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:30.616 20:20:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:30.616 20:20:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:30.878 20:20:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:30.879 20:20:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:30.879 20:20:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:30.879 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:30.879 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.194 ms 00:14:30.879 00:14:30.879 --- 10.0.0.2 ping statistics --- 00:14:30.879 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:30.879 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:14:30.879 20:20:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:30.879 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:30.879 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.242 ms 00:14:30.879 00:14:30.879 --- 10.0.0.1 ping statistics --- 00:14:30.879 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:30.879 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:14:30.879 20:20:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:30.879 20:20:02 -- nvmf/common.sh@410 -- # return 0 00:14:30.879 20:20:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:30.879 20:20:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:30.879 20:20:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:30.879 20:20:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:30.879 20:20:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:30.879 20:20:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:30.879 20:20:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:30.879 20:20:02 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:30.879 20:20:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:30.879 20:20:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:30.879 20:20:02 -- common/autotest_common.sh@10 -- # set +x 00:14:30.879 20:20:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:30.879 20:20:02 -- nvmf/common.sh@469 -- # nvmfpid=3370889 00:14:30.879 20:20:02 -- nvmf/common.sh@470 -- # waitforlisten 3370889 00:14:30.879 20:20:02 -- common/autotest_common.sh@819 -- # '[' -z 3370889 ']' 00:14:30.879 20:20:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:30.879 20:20:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:30.879 20:20:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:30.879 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:30.879 20:20:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:30.879 20:20:02 -- common/autotest_common.sh@10 -- # set +x 00:14:30.879 [2024-07-22 20:20:02.734475] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:14:30.879 [2024-07-22 20:20:02.734522] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:30.879 EAL: No free 2048 kB hugepages reported on node 1 00:14:30.879 [2024-07-22 20:20:02.794106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:31.140 [2024-07-22 20:20:02.872243] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:31.140 [2024-07-22 20:20:02.872350] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:31.140 [2024-07-22 20:20:02.872358] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:31.140 [2024-07-22 20:20:02.872365] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:31.140 [2024-07-22 20:20:02.872408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:31.140 [2024-07-22 20:20:02.872512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:31.140 [2024-07-22 20:20:02.872513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:31.708 20:20:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:31.708 20:20:03 -- common/autotest_common.sh@852 -- # return 0 00:14:31.708 20:20:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:31.708 20:20:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:31.708 20:20:03 -- common/autotest_common.sh@10 -- # set +x 00:14:31.708 20:20:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:31.708 20:20:03 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:31.968 [2024-07-22 20:20:03.710414] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:31.968 20:20:03 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:32.227 20:20:03 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:32.227 20:20:03 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:32.227 20:20:04 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:32.227 20:20:04 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:32.487 20:20:04 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:32.747 20:20:04 -- target/nvmf_lvol.sh@29 -- # lvs=08ec6030-15a2-4475-823c-3dc82ebcb0c2 00:14:32.747 20:20:04 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 08ec6030-15a2-4475-823c-3dc82ebcb0c2 lvol 20 00:14:32.747 20:20:04 -- target/nvmf_lvol.sh@32 -- # lvol=fcc36471-9e43-4a71-9a11-da90585962a5 00:14:32.747 20:20:04 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:33.006 20:20:04 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 fcc36471-9e43-4a71-9a11-da90585962a5 00:14:33.265 20:20:05 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:33.265 [2024-07-22 20:20:05.155667] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:33.265 20:20:05 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:33.525 20:20:05 -- target/nvmf_lvol.sh@42 -- # perf_pid=3371388 00:14:33.525 20:20:05 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:33.525 20:20:05 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:33.525 EAL: No free 2048 kB hugepages reported on node 1 00:14:34.464 20:20:06 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot fcc36471-9e43-4a71-9a11-da90585962a5 MY_SNAPSHOT 00:14:34.724 20:20:06 -- target/nvmf_lvol.sh@47 -- # snapshot=c87659ed-4370-4595-b9a5-11247ca87b24 00:14:34.724 20:20:06 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize fcc36471-9e43-4a71-9a11-da90585962a5 30 00:14:34.984 20:20:06 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone c87659ed-4370-4595-b9a5-11247ca87b24 MY_CLONE 00:14:35.243 20:20:07 -- target/nvmf_lvol.sh@49 -- # clone=fd0dbd80-df5c-492c-83c4-ed744a7fbdd1 00:14:35.243 20:20:07 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate fd0dbd80-df5c-492c-83c4-ed744a7fbdd1 00:14:35.503 20:20:07 -- target/nvmf_lvol.sh@53 -- # wait 3371388 00:14:45.491 Initializing NVMe Controllers 00:14:45.491 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:45.491 Controller IO queue size 128, less than required. 00:14:45.491 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:45.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:45.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:45.491 Initialization complete. Launching workers. 00:14:45.491 ======================================================== 00:14:45.491 Latency(us) 00:14:45.491 Device Information : IOPS MiB/s Average min max 00:14:45.491 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 11856.90 46.32 10801.84 1305.70 64519.38 00:14:45.491 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 11647.00 45.50 10994.05 3774.27 65974.41 00:14:45.491 ======================================================== 00:14:45.491 Total : 23503.90 91.81 10897.09 1305.70 65974.41 00:14:45.491 00:14:45.491 20:20:15 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:45.491 20:20:15 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete fcc36471-9e43-4a71-9a11-da90585962a5 00:14:45.491 20:20:16 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 08ec6030-15a2-4475-823c-3dc82ebcb0c2 00:14:45.491 20:20:16 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:45.491 20:20:16 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:45.491 20:20:16 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:45.491 20:20:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:45.491 20:20:16 -- nvmf/common.sh@116 -- # sync 00:14:45.491 20:20:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:45.491 20:20:16 -- nvmf/common.sh@119 -- # set +e 00:14:45.491 20:20:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:45.491 20:20:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:45.491 rmmod nvme_tcp 00:14:45.491 rmmod nvme_fabrics 00:14:45.491 rmmod nvme_keyring 00:14:45.491 20:20:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:45.491 20:20:16 -- nvmf/common.sh@123 -- # set -e 00:14:45.491 20:20:16 -- nvmf/common.sh@124 -- # return 0 00:14:45.491 20:20:16 -- nvmf/common.sh@477 -- # '[' -n 3370889 ']' 00:14:45.491 20:20:16 -- nvmf/common.sh@478 -- # killprocess 3370889 00:14:45.491 20:20:16 -- common/autotest_common.sh@926 -- # '[' -z 3370889 ']' 00:14:45.491 20:20:16 -- common/autotest_common.sh@930 -- # kill -0 3370889 00:14:45.491 20:20:16 -- common/autotest_common.sh@931 -- # uname 00:14:45.491 20:20:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:45.491 20:20:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3370889 00:14:45.491 20:20:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:45.491 20:20:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:45.491 20:20:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3370889' 00:14:45.491 killing process with pid 3370889 00:14:45.491 20:20:16 -- common/autotest_common.sh@945 -- # kill 3370889 00:14:45.491 20:20:16 -- common/autotest_common.sh@950 -- # wait 3370889 00:14:45.491 20:20:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:45.491 20:20:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:45.491 20:20:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:45.491 20:20:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:45.491 20:20:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:45.491 20:20:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:45.491 20:20:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:45.491 20:20:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:46.876 20:20:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:46.876 00:14:46.876 real 0m21.800s 00:14:46.876 user 1m3.911s 00:14:46.876 sys 0m6.879s 00:14:46.876 20:20:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:46.876 20:20:18 -- common/autotest_common.sh@10 -- # set +x 00:14:46.876 ************************************ 00:14:46.876 END TEST nvmf_lvol 00:14:46.876 ************************************ 00:14:46.876 20:20:18 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:46.876 20:20:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:46.876 20:20:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:46.876 20:20:18 -- common/autotest_common.sh@10 -- # set +x 00:14:46.876 ************************************ 00:14:46.876 START TEST nvmf_lvs_grow 00:14:46.876 ************************************ 00:14:46.876 20:20:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:47.137 * Looking for test storage... 00:14:47.137 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:47.137 20:20:18 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:47.137 20:20:18 -- nvmf/common.sh@7 -- # uname -s 00:14:47.137 20:20:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:47.137 20:20:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:47.137 20:20:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:47.137 20:20:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:47.137 20:20:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:47.137 20:20:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:47.137 20:20:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:47.137 20:20:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:47.137 20:20:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:47.137 20:20:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:47.137 20:20:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:14:47.137 20:20:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:14:47.137 20:20:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:47.137 20:20:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:47.137 20:20:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:47.137 20:20:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:47.137 20:20:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:47.137 20:20:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:47.137 20:20:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:47.137 20:20:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.137 20:20:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.137 20:20:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.137 20:20:18 -- paths/export.sh@5 -- # export PATH 00:14:47.137 20:20:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.137 20:20:18 -- nvmf/common.sh@46 -- # : 0 00:14:47.137 20:20:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:47.137 20:20:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:47.137 20:20:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:47.137 20:20:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:47.137 20:20:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:47.137 20:20:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:47.137 20:20:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:47.137 20:20:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:47.137 20:20:18 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:47.137 20:20:18 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:47.137 20:20:18 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:47.137 20:20:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:47.137 20:20:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:47.137 20:20:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:47.137 20:20:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:47.137 20:20:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:47.137 20:20:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:47.137 20:20:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:47.137 20:20:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.137 20:20:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:47.137 20:20:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:47.137 20:20:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:47.137 20:20:18 -- common/autotest_common.sh@10 -- # set +x 00:14:52.420 20:20:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:52.420 20:20:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:52.420 20:20:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:52.420 20:20:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:52.420 20:20:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:52.420 20:20:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:52.420 20:20:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:52.420 20:20:23 -- nvmf/common.sh@294 -- # net_devs=() 00:14:52.420 20:20:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:52.420 20:20:23 -- nvmf/common.sh@295 -- # e810=() 00:14:52.420 20:20:23 -- nvmf/common.sh@295 -- # local -ga e810 00:14:52.420 20:20:23 -- nvmf/common.sh@296 -- # x722=() 00:14:52.420 20:20:23 -- nvmf/common.sh@296 -- # local -ga x722 00:14:52.420 20:20:23 -- nvmf/common.sh@297 -- # mlx=() 00:14:52.420 20:20:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:52.420 20:20:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:52.420 20:20:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:52.421 20:20:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:52.421 20:20:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:52.421 20:20:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:52.421 20:20:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:52.421 20:20:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:52.421 20:20:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:14:52.421 Found 0000:86:00.0 (0x8086 - 0x159b) 00:14:52.421 20:20:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:52.421 20:20:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:14:52.421 Found 0000:86:00.1 (0x8086 - 0x159b) 00:14:52.421 20:20:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:52.421 20:20:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:52.421 20:20:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:52.421 20:20:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:52.421 20:20:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:52.421 20:20:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:14:52.421 Found net devices under 0000:86:00.0: cvl_0_0 00:14:52.421 20:20:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:52.421 20:20:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:52.421 20:20:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:52.421 20:20:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:52.421 20:20:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:52.421 20:20:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:14:52.421 Found net devices under 0000:86:00.1: cvl_0_1 00:14:52.421 20:20:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:52.421 20:20:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:52.421 20:20:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:52.421 20:20:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:52.421 20:20:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:52.421 20:20:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:52.421 20:20:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:52.421 20:20:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:52.421 20:20:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:52.421 20:20:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:52.421 20:20:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:52.421 20:20:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:52.421 20:20:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:52.421 20:20:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:52.421 20:20:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:52.421 20:20:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:52.421 20:20:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:52.421 20:20:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:52.421 20:20:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:52.421 20:20:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:52.421 20:20:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:52.421 20:20:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:52.421 20:20:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:52.421 20:20:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:52.421 20:20:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:52.421 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:52.421 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.328 ms 00:14:52.421 00:14:52.421 --- 10.0.0.2 ping statistics --- 00:14:52.421 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:52.421 rtt min/avg/max/mdev = 0.328/0.328/0.328/0.000 ms 00:14:52.421 20:20:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:52.421 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:52.421 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.319 ms 00:14:52.421 00:14:52.421 --- 10.0.0.1 ping statistics --- 00:14:52.421 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:52.421 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:14:52.421 20:20:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:52.421 20:20:24 -- nvmf/common.sh@410 -- # return 0 00:14:52.421 20:20:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:52.421 20:20:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:52.421 20:20:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:52.421 20:20:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:52.421 20:20:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:52.421 20:20:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:52.421 20:20:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:52.421 20:20:24 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:52.421 20:20:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:52.421 20:20:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:52.421 20:20:24 -- common/autotest_common.sh@10 -- # set +x 00:14:52.421 20:20:24 -- nvmf/common.sh@469 -- # nvmfpid=3376727 00:14:52.421 20:20:24 -- nvmf/common.sh@470 -- # waitforlisten 3376727 00:14:52.421 20:20:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:52.421 20:20:24 -- common/autotest_common.sh@819 -- # '[' -z 3376727 ']' 00:14:52.421 20:20:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:52.421 20:20:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:52.421 20:20:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:52.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:52.421 20:20:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:52.421 20:20:24 -- common/autotest_common.sh@10 -- # set +x 00:14:52.421 [2024-07-22 20:20:24.169379] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:14:52.421 [2024-07-22 20:20:24.169420] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:52.421 EAL: No free 2048 kB hugepages reported on node 1 00:14:52.421 [2024-07-22 20:20:24.227031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:52.421 [2024-07-22 20:20:24.304521] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:52.421 [2024-07-22 20:20:24.304626] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:52.421 [2024-07-22 20:20:24.304634] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:52.421 [2024-07-22 20:20:24.304640] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:52.421 [2024-07-22 20:20:24.304655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:53.360 20:20:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:53.360 20:20:24 -- common/autotest_common.sh@852 -- # return 0 00:14:53.360 20:20:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:53.360 20:20:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:53.360 20:20:24 -- common/autotest_common.sh@10 -- # set +x 00:14:53.360 20:20:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:53.360 [2024-07-22 20:20:25.165369] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:53.360 20:20:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:14:53.360 20:20:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:53.360 20:20:25 -- common/autotest_common.sh@10 -- # set +x 00:14:53.360 ************************************ 00:14:53.360 START TEST lvs_grow_clean 00:14:53.360 ************************************ 00:14:53.360 20:20:25 -- common/autotest_common.sh@1104 -- # lvs_grow 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:53.360 20:20:25 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:53.623 20:20:25 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:53.623 20:20:25 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:53.962 20:20:25 -- target/nvmf_lvs_grow.sh@28 -- # lvs=a2097e53-32fb-490d-952b-f420e60274d7 00:14:53.962 20:20:25 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:14:53.962 20:20:25 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:53.962 20:20:25 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:53.962 20:20:25 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:53.962 20:20:25 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u a2097e53-32fb-490d-952b-f420e60274d7 lvol 150 00:14:54.222 20:20:25 -- target/nvmf_lvs_grow.sh@33 -- # lvol=46c69401-9cfb-4910-a3db-de2100df4b26 00:14:54.222 20:20:25 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.222 20:20:25 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:54.222 [2024-07-22 20:20:26.064720] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:54.222 [2024-07-22 20:20:26.064769] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:54.222 true 00:14:54.222 20:20:26 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:14:54.222 20:20:26 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:54.482 20:20:26 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:54.482 20:20:26 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:54.482 20:20:26 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 46c69401-9cfb-4910-a3db-de2100df4b26 00:14:54.741 20:20:26 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:54.741 [2024-07-22 20:20:26.678604] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:55.001 20:20:26 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:55.001 20:20:26 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3377195 00:14:55.001 20:20:26 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:55.001 20:20:26 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:55.001 20:20:26 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3377195 /var/tmp/bdevperf.sock 00:14:55.001 20:20:26 -- common/autotest_common.sh@819 -- # '[' -z 3377195 ']' 00:14:55.001 20:20:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:55.001 20:20:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:55.001 20:20:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:55.001 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:55.001 20:20:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:55.001 20:20:26 -- common/autotest_common.sh@10 -- # set +x 00:14:55.001 [2024-07-22 20:20:26.890884] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:14:55.001 [2024-07-22 20:20:26.890933] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3377195 ] 00:14:55.001 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.261 [2024-07-22 20:20:26.942946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.261 [2024-07-22 20:20:27.020311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:55.831 20:20:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:55.831 20:20:27 -- common/autotest_common.sh@852 -- # return 0 00:14:55.831 20:20:27 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:56.090 Nvme0n1 00:14:56.090 20:20:27 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:56.350 [ 00:14:56.350 { 00:14:56.350 "name": "Nvme0n1", 00:14:56.350 "aliases": [ 00:14:56.350 "46c69401-9cfb-4910-a3db-de2100df4b26" 00:14:56.350 ], 00:14:56.350 "product_name": "NVMe disk", 00:14:56.350 "block_size": 4096, 00:14:56.350 "num_blocks": 38912, 00:14:56.350 "uuid": "46c69401-9cfb-4910-a3db-de2100df4b26", 00:14:56.350 "assigned_rate_limits": { 00:14:56.350 "rw_ios_per_sec": 0, 00:14:56.350 "rw_mbytes_per_sec": 0, 00:14:56.350 "r_mbytes_per_sec": 0, 00:14:56.350 "w_mbytes_per_sec": 0 00:14:56.350 }, 00:14:56.350 "claimed": false, 00:14:56.350 "zoned": false, 00:14:56.350 "supported_io_types": { 00:14:56.350 "read": true, 00:14:56.350 "write": true, 00:14:56.350 "unmap": true, 00:14:56.350 "write_zeroes": true, 00:14:56.350 "flush": true, 00:14:56.350 "reset": true, 00:14:56.350 "compare": true, 00:14:56.350 "compare_and_write": true, 00:14:56.350 "abort": true, 00:14:56.350 "nvme_admin": true, 00:14:56.350 "nvme_io": true 00:14:56.350 }, 00:14:56.350 "driver_specific": { 00:14:56.350 "nvme": [ 00:14:56.350 { 00:14:56.350 "trid": { 00:14:56.350 "trtype": "TCP", 00:14:56.350 "adrfam": "IPv4", 00:14:56.350 "traddr": "10.0.0.2", 00:14:56.350 "trsvcid": "4420", 00:14:56.350 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:56.350 }, 00:14:56.350 "ctrlr_data": { 00:14:56.350 "cntlid": 1, 00:14:56.350 "vendor_id": "0x8086", 00:14:56.350 "model_number": "SPDK bdev Controller", 00:14:56.350 "serial_number": "SPDK0", 00:14:56.350 "firmware_revision": "24.01.1", 00:14:56.350 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:56.350 "oacs": { 00:14:56.350 "security": 0, 00:14:56.350 "format": 0, 00:14:56.350 "firmware": 0, 00:14:56.350 "ns_manage": 0 00:14:56.350 }, 00:14:56.350 "multi_ctrlr": true, 00:14:56.350 "ana_reporting": false 00:14:56.350 }, 00:14:56.350 "vs": { 00:14:56.350 "nvme_version": "1.3" 00:14:56.350 }, 00:14:56.350 "ns_data": { 00:14:56.350 "id": 1, 00:14:56.350 "can_share": true 00:14:56.350 } 00:14:56.350 } 00:14:56.350 ], 00:14:56.350 "mp_policy": "active_passive" 00:14:56.350 } 00:14:56.350 } 00:14:56.350 ] 00:14:56.350 20:20:28 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3377348 00:14:56.350 20:20:28 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:56.350 20:20:28 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:56.350 Running I/O for 10 seconds... 00:14:57.289 Latency(us) 00:14:57.289 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.289 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.289 Nvme0n1 : 1.00 22428.00 87.61 0.00 0.00 0.00 0.00 0.00 00:14:57.289 =================================================================================================================== 00:14:57.289 Total : 22428.00 87.61 0.00 0.00 0.00 0.00 0.00 00:14:57.289 00:14:58.227 20:20:30 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u a2097e53-32fb-490d-952b-f420e60274d7 00:14:58.487 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.487 Nvme0n1 : 2.00 22454.00 87.71 0.00 0.00 0.00 0.00 0.00 00:14:58.487 =================================================================================================================== 00:14:58.487 Total : 22454.00 87.71 0.00 0.00 0.00 0.00 0.00 00:14:58.487 00:14:58.487 true 00:14:58.487 20:20:30 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:14:58.487 20:20:30 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:58.746 20:20:30 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:58.746 20:20:30 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:58.746 20:20:30 -- target/nvmf_lvs_grow.sh@65 -- # wait 3377348 00:14:59.316 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.316 Nvme0n1 : 3.00 22494.67 87.87 0.00 0.00 0.00 0.00 0.00 00:14:59.316 =================================================================================================================== 00:14:59.316 Total : 22494.67 87.87 0.00 0.00 0.00 0.00 0.00 00:14:59.316 00:15:00.696 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.696 Nvme0n1 : 4.00 22615.00 88.34 0.00 0.00 0.00 0.00 0.00 00:15:00.696 =================================================================================================================== 00:15:00.696 Total : 22615.00 88.34 0.00 0.00 0.00 0.00 0.00 00:15:00.696 00:15:01.633 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.633 Nvme0n1 : 5.00 22690.40 88.63 0.00 0.00 0.00 0.00 0.00 00:15:01.633 =================================================================================================================== 00:15:01.633 Total : 22690.40 88.63 0.00 0.00 0.00 0.00 0.00 00:15:01.633 00:15:02.571 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.571 Nvme0n1 : 6.00 22742.00 88.84 0.00 0.00 0.00 0.00 0.00 00:15:02.571 =================================================================================================================== 00:15:02.571 Total : 22742.00 88.84 0.00 0.00 0.00 0.00 0.00 00:15:02.571 00:15:03.510 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.510 Nvme0n1 : 7.00 22785.71 89.01 0.00 0.00 0.00 0.00 0.00 00:15:03.510 =================================================================================================================== 00:15:03.510 Total : 22785.71 89.01 0.00 0.00 0.00 0.00 0.00 00:15:03.510 00:15:04.449 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.449 Nvme0n1 : 8.00 22819.50 89.14 0.00 0.00 0.00 0.00 0.00 00:15:04.449 =================================================================================================================== 00:15:04.449 Total : 22819.50 89.14 0.00 0.00 0.00 0.00 0.00 00:15:04.449 00:15:05.388 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.388 Nvme0n1 : 9.00 22842.22 89.23 0.00 0.00 0.00 0.00 0.00 00:15:05.388 =================================================================================================================== 00:15:05.388 Total : 22842.22 89.23 0.00 0.00 0.00 0.00 0.00 00:15:05.388 00:15:06.326 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.326 Nvme0n1 : 10.00 22860.40 89.30 0.00 0.00 0.00 0.00 0.00 00:15:06.326 =================================================================================================================== 00:15:06.326 Total : 22860.40 89.30 0.00 0.00 0.00 0.00 0.00 00:15:06.326 00:15:06.326 00:15:06.326 Latency(us) 00:15:06.326 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.326 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.326 Nvme0n1 : 10.01 22860.39 89.30 0.00 0.00 5595.30 4017.64 17894.18 00:15:06.326 =================================================================================================================== 00:15:06.326 Total : 22860.39 89.30 0.00 0.00 5595.30 4017.64 17894.18 00:15:06.326 0 00:15:06.326 20:20:38 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3377195 00:15:06.326 20:20:38 -- common/autotest_common.sh@926 -- # '[' -z 3377195 ']' 00:15:06.326 20:20:38 -- common/autotest_common.sh@930 -- # kill -0 3377195 00:15:06.326 20:20:38 -- common/autotest_common.sh@931 -- # uname 00:15:06.326 20:20:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:06.326 20:20:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3377195 00:15:06.618 20:20:38 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:06.618 20:20:38 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:06.618 20:20:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3377195' 00:15:06.618 killing process with pid 3377195 00:15:06.618 20:20:38 -- common/autotest_common.sh@945 -- # kill 3377195 00:15:06.618 Received shutdown signal, test time was about 10.000000 seconds 00:15:06.618 00:15:06.618 Latency(us) 00:15:06.618 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.618 =================================================================================================================== 00:15:06.618 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:06.618 20:20:38 -- common/autotest_common.sh@950 -- # wait 3377195 00:15:06.618 20:20:38 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:06.877 20:20:38 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:15:06.877 20:20:38 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:07.138 20:20:38 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:07.138 20:20:38 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:07.138 20:20:38 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:07.138 [2024-07-22 20:20:38.962337] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:07.138 20:20:38 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:15:07.138 20:20:38 -- common/autotest_common.sh@640 -- # local es=0 00:15:07.138 20:20:38 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:15:07.138 20:20:38 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:07.138 20:20:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:07.138 20:20:38 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:07.138 20:20:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:07.138 20:20:38 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:07.138 20:20:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:07.138 20:20:38 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:07.138 20:20:38 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:07.138 20:20:38 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:15:07.398 request: 00:15:07.398 { 00:15:07.398 "uuid": "a2097e53-32fb-490d-952b-f420e60274d7", 00:15:07.398 "method": "bdev_lvol_get_lvstores", 00:15:07.398 "req_id": 1 00:15:07.398 } 00:15:07.398 Got JSON-RPC error response 00:15:07.398 response: 00:15:07.398 { 00:15:07.398 "code": -19, 00:15:07.398 "message": "No such device" 00:15:07.398 } 00:15:07.398 20:20:39 -- common/autotest_common.sh@643 -- # es=1 00:15:07.398 20:20:39 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:15:07.398 20:20:39 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:15:07.398 20:20:39 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:15:07.398 20:20:39 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:07.398 aio_bdev 00:15:07.398 20:20:39 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 46c69401-9cfb-4910-a3db-de2100df4b26 00:15:07.398 20:20:39 -- common/autotest_common.sh@887 -- # local bdev_name=46c69401-9cfb-4910-a3db-de2100df4b26 00:15:07.398 20:20:39 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:15:07.398 20:20:39 -- common/autotest_common.sh@889 -- # local i 00:15:07.398 20:20:39 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:15:07.398 20:20:39 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:15:07.398 20:20:39 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:07.659 20:20:39 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 46c69401-9cfb-4910-a3db-de2100df4b26 -t 2000 00:15:07.919 [ 00:15:07.919 { 00:15:07.919 "name": "46c69401-9cfb-4910-a3db-de2100df4b26", 00:15:07.919 "aliases": [ 00:15:07.919 "lvs/lvol" 00:15:07.919 ], 00:15:07.919 "product_name": "Logical Volume", 00:15:07.919 "block_size": 4096, 00:15:07.919 "num_blocks": 38912, 00:15:07.919 "uuid": "46c69401-9cfb-4910-a3db-de2100df4b26", 00:15:07.919 "assigned_rate_limits": { 00:15:07.919 "rw_ios_per_sec": 0, 00:15:07.919 "rw_mbytes_per_sec": 0, 00:15:07.919 "r_mbytes_per_sec": 0, 00:15:07.919 "w_mbytes_per_sec": 0 00:15:07.919 }, 00:15:07.919 "claimed": false, 00:15:07.919 "zoned": false, 00:15:07.919 "supported_io_types": { 00:15:07.919 "read": true, 00:15:07.919 "write": true, 00:15:07.919 "unmap": true, 00:15:07.919 "write_zeroes": true, 00:15:07.919 "flush": false, 00:15:07.919 "reset": true, 00:15:07.919 "compare": false, 00:15:07.919 "compare_and_write": false, 00:15:07.919 "abort": false, 00:15:07.919 "nvme_admin": false, 00:15:07.919 "nvme_io": false 00:15:07.919 }, 00:15:07.919 "driver_specific": { 00:15:07.919 "lvol": { 00:15:07.919 "lvol_store_uuid": "a2097e53-32fb-490d-952b-f420e60274d7", 00:15:07.919 "base_bdev": "aio_bdev", 00:15:07.919 "thin_provision": false, 00:15:07.919 "snapshot": false, 00:15:07.919 "clone": false, 00:15:07.919 "esnap_clone": false 00:15:07.919 } 00:15:07.919 } 00:15:07.919 } 00:15:07.919 ] 00:15:07.919 20:20:39 -- common/autotest_common.sh@895 -- # return 0 00:15:07.919 20:20:39 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:15:07.919 20:20:39 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:07.919 20:20:39 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:07.919 20:20:39 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a2097e53-32fb-490d-952b-f420e60274d7 00:15:07.919 20:20:39 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:08.179 20:20:39 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:08.179 20:20:39 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 46c69401-9cfb-4910-a3db-de2100df4b26 00:15:08.179 20:20:40 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u a2097e53-32fb-490d-952b-f420e60274d7 00:15:08.439 20:20:40 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:08.699 00:15:08.699 real 0m15.279s 00:15:08.699 user 0m14.955s 00:15:08.699 sys 0m1.403s 00:15:08.699 20:20:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:08.699 20:20:40 -- common/autotest_common.sh@10 -- # set +x 00:15:08.699 ************************************ 00:15:08.699 END TEST lvs_grow_clean 00:15:08.699 ************************************ 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:08.699 20:20:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:08.699 20:20:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:08.699 20:20:40 -- common/autotest_common.sh@10 -- # set +x 00:15:08.699 ************************************ 00:15:08.699 START TEST lvs_grow_dirty 00:15:08.699 ************************************ 00:15:08.699 20:20:40 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:08.699 20:20:40 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:08.959 20:20:40 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:08.959 20:20:40 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:08.959 20:20:40 -- target/nvmf_lvs_grow.sh@28 -- # lvs=fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:08.959 20:20:40 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:08.959 20:20:40 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:09.219 20:20:41 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:09.219 20:20:41 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:09.219 20:20:41 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b lvol 150 00:15:09.479 20:20:41 -- target/nvmf_lvs_grow.sh@33 -- # lvol=63b7328d-6384-46e2-a57d-0403a6872ae0 00:15:09.479 20:20:41 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:09.479 20:20:41 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:09.479 [2024-07-22 20:20:41.351493] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:09.479 [2024-07-22 20:20:41.351542] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:09.479 true 00:15:09.479 20:20:41 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:09.479 20:20:41 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:09.739 20:20:41 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:09.739 20:20:41 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:09.739 20:20:41 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 63b7328d-6384-46e2-a57d-0403a6872ae0 00:15:09.998 20:20:41 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:10.259 20:20:41 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:10.259 20:20:42 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3379743 00:15:10.259 20:20:42 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:10.259 20:20:42 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3379743 /var/tmp/bdevperf.sock 00:15:10.259 20:20:42 -- common/autotest_common.sh@819 -- # '[' -z 3379743 ']' 00:15:10.259 20:20:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:10.259 20:20:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:10.259 20:20:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:10.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:10.259 20:20:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:10.259 20:20:42 -- common/autotest_common.sh@10 -- # set +x 00:15:10.259 20:20:42 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:10.259 [2024-07-22 20:20:42.183393] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:10.259 [2024-07-22 20:20:42.183441] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3379743 ] 00:15:10.519 EAL: No free 2048 kB hugepages reported on node 1 00:15:10.519 [2024-07-22 20:20:42.236185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:10.519 [2024-07-22 20:20:42.313839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:11.088 20:20:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:11.088 20:20:42 -- common/autotest_common.sh@852 -- # return 0 00:15:11.088 20:20:42 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:11.347 Nvme0n1 00:15:11.347 20:20:43 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:11.606 [ 00:15:11.606 { 00:15:11.606 "name": "Nvme0n1", 00:15:11.606 "aliases": [ 00:15:11.606 "63b7328d-6384-46e2-a57d-0403a6872ae0" 00:15:11.606 ], 00:15:11.606 "product_name": "NVMe disk", 00:15:11.606 "block_size": 4096, 00:15:11.606 "num_blocks": 38912, 00:15:11.606 "uuid": "63b7328d-6384-46e2-a57d-0403a6872ae0", 00:15:11.606 "assigned_rate_limits": { 00:15:11.606 "rw_ios_per_sec": 0, 00:15:11.606 "rw_mbytes_per_sec": 0, 00:15:11.607 "r_mbytes_per_sec": 0, 00:15:11.607 "w_mbytes_per_sec": 0 00:15:11.607 }, 00:15:11.607 "claimed": false, 00:15:11.607 "zoned": false, 00:15:11.607 "supported_io_types": { 00:15:11.607 "read": true, 00:15:11.607 "write": true, 00:15:11.607 "unmap": true, 00:15:11.607 "write_zeroes": true, 00:15:11.607 "flush": true, 00:15:11.607 "reset": true, 00:15:11.607 "compare": true, 00:15:11.607 "compare_and_write": true, 00:15:11.607 "abort": true, 00:15:11.607 "nvme_admin": true, 00:15:11.607 "nvme_io": true 00:15:11.607 }, 00:15:11.607 "driver_specific": { 00:15:11.607 "nvme": [ 00:15:11.607 { 00:15:11.607 "trid": { 00:15:11.607 "trtype": "TCP", 00:15:11.607 "adrfam": "IPv4", 00:15:11.607 "traddr": "10.0.0.2", 00:15:11.607 "trsvcid": "4420", 00:15:11.607 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:11.607 }, 00:15:11.607 "ctrlr_data": { 00:15:11.607 "cntlid": 1, 00:15:11.607 "vendor_id": "0x8086", 00:15:11.607 "model_number": "SPDK bdev Controller", 00:15:11.607 "serial_number": "SPDK0", 00:15:11.607 "firmware_revision": "24.01.1", 00:15:11.607 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:11.607 "oacs": { 00:15:11.607 "security": 0, 00:15:11.607 "format": 0, 00:15:11.607 "firmware": 0, 00:15:11.607 "ns_manage": 0 00:15:11.607 }, 00:15:11.607 "multi_ctrlr": true, 00:15:11.607 "ana_reporting": false 00:15:11.607 }, 00:15:11.607 "vs": { 00:15:11.607 "nvme_version": "1.3" 00:15:11.607 }, 00:15:11.607 "ns_data": { 00:15:11.607 "id": 1, 00:15:11.607 "can_share": true 00:15:11.607 } 00:15:11.607 } 00:15:11.607 ], 00:15:11.607 "mp_policy": "active_passive" 00:15:11.607 } 00:15:11.607 } 00:15:11.607 ] 00:15:11.607 20:20:43 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3379954 00:15:11.607 20:20:43 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:11.607 20:20:43 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:11.607 Running I/O for 10 seconds... 00:15:12.573 Latency(us) 00:15:12.573 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:12.573 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:12.573 Nvme0n1 : 1.00 22284.00 87.05 0.00 0.00 0.00 0.00 0.00 00:15:12.573 =================================================================================================================== 00:15:12.573 Total : 22284.00 87.05 0.00 0.00 0.00 0.00 0.00 00:15:12.573 00:15:13.511 20:20:45 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:13.771 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.771 Nvme0n1 : 2.00 22542.00 88.05 0.00 0.00 0.00 0.00 0.00 00:15:13.771 =================================================================================================================== 00:15:13.771 Total : 22542.00 88.05 0.00 0.00 0.00 0.00 0.00 00:15:13.771 00:15:13.771 true 00:15:13.771 20:20:45 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:13.771 20:20:45 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:14.030 20:20:45 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:14.030 20:20:45 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:14.030 20:20:45 -- target/nvmf_lvs_grow.sh@65 -- # wait 3379954 00:15:14.598 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.598 Nvme0n1 : 3.00 22638.67 88.43 0.00 0.00 0.00 0.00 0.00 00:15:14.598 =================================================================================================================== 00:15:14.598 Total : 22638.67 88.43 0.00 0.00 0.00 0.00 0.00 00:15:14.598 00:15:15.978 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:15.978 Nvme0n1 : 4.00 22709.00 88.71 0.00 0.00 0.00 0.00 0.00 00:15:15.978 =================================================================================================================== 00:15:15.978 Total : 22709.00 88.71 0.00 0.00 0.00 0.00 0.00 00:15:15.978 00:15:16.916 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.916 Nvme0n1 : 5.00 22765.60 88.93 0.00 0.00 0.00 0.00 0.00 00:15:16.916 =================================================================================================================== 00:15:16.916 Total : 22765.60 88.93 0.00 0.00 0.00 0.00 0.00 00:15:16.916 00:15:17.852 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:17.852 Nvme0n1 : 6.00 22807.33 89.09 0.00 0.00 0.00 0.00 0.00 00:15:17.852 =================================================================================================================== 00:15:17.852 Total : 22807.33 89.09 0.00 0.00 0.00 0.00 0.00 00:15:17.852 00:15:18.789 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:18.789 Nvme0n1 : 7.00 22825.71 89.16 0.00 0.00 0.00 0.00 0.00 00:15:18.789 =================================================================================================================== 00:15:18.789 Total : 22825.71 89.16 0.00 0.00 0.00 0.00 0.00 00:15:18.789 00:15:19.726 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.726 Nvme0n1 : 8.00 22821.50 89.15 0.00 0.00 0.00 0.00 0.00 00:15:19.726 =================================================================================================================== 00:15:19.726 Total : 22821.50 89.15 0.00 0.00 0.00 0.00 0.00 00:15:19.726 00:15:20.664 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.664 Nvme0n1 : 9.00 22820.89 89.14 0.00 0.00 0.00 0.00 0.00 00:15:20.664 =================================================================================================================== 00:15:20.664 Total : 22820.89 89.14 0.00 0.00 0.00 0.00 0.00 00:15:20.664 00:15:21.602 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:21.602 Nvme0n1 : 10.00 22832.40 89.19 0.00 0.00 0.00 0.00 0.00 00:15:21.602 =================================================================================================================== 00:15:21.602 Total : 22832.40 89.19 0.00 0.00 0.00 0.00 0.00 00:15:21.602 00:15:21.602 00:15:21.602 Latency(us) 00:15:21.602 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:21.602 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:21.602 Nvme0n1 : 10.01 22832.45 89.19 0.00 0.00 5602.17 3989.15 21313.45 00:15:21.602 =================================================================================================================== 00:15:21.602 Total : 22832.45 89.19 0.00 0.00 5602.17 3989.15 21313.45 00:15:21.602 0 00:15:21.602 20:20:53 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3379743 00:15:21.602 20:20:53 -- common/autotest_common.sh@926 -- # '[' -z 3379743 ']' 00:15:21.602 20:20:53 -- common/autotest_common.sh@930 -- # kill -0 3379743 00:15:21.602 20:20:53 -- common/autotest_common.sh@931 -- # uname 00:15:21.602 20:20:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:21.861 20:20:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3379743 00:15:21.861 20:20:53 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:21.861 20:20:53 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:21.861 20:20:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3379743' 00:15:21.861 killing process with pid 3379743 00:15:21.861 20:20:53 -- common/autotest_common.sh@945 -- # kill 3379743 00:15:21.861 Received shutdown signal, test time was about 10.000000 seconds 00:15:21.861 00:15:21.861 Latency(us) 00:15:21.861 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:21.861 =================================================================================================================== 00:15:21.861 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:21.861 20:20:53 -- common/autotest_common.sh@950 -- # wait 3379743 00:15:21.861 20:20:53 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:22.120 20:20:53 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:22.120 20:20:53 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:22.379 20:20:54 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:22.379 20:20:54 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:22.379 20:20:54 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3376727 00:15:22.379 20:20:54 -- target/nvmf_lvs_grow.sh@74 -- # wait 3376727 00:15:22.379 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3376727 Killed "${NVMF_APP[@]}" "$@" 00:15:22.379 20:20:54 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:22.379 20:20:54 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:22.379 20:20:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:22.379 20:20:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:22.379 20:20:54 -- common/autotest_common.sh@10 -- # set +x 00:15:22.379 20:20:54 -- nvmf/common.sh@469 -- # nvmfpid=3381819 00:15:22.379 20:20:54 -- nvmf/common.sh@470 -- # waitforlisten 3381819 00:15:22.379 20:20:54 -- common/autotest_common.sh@819 -- # '[' -z 3381819 ']' 00:15:22.379 20:20:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:22.379 20:20:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:22.379 20:20:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:22.379 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:22.379 20:20:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:22.379 20:20:54 -- common/autotest_common.sh@10 -- # set +x 00:15:22.379 20:20:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:22.379 [2024-07-22 20:20:54.198484] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:22.379 [2024-07-22 20:20:54.198528] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:22.379 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.379 [2024-07-22 20:20:54.255493] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:22.639 [2024-07-22 20:20:54.333595] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:22.639 [2024-07-22 20:20:54.333697] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:22.639 [2024-07-22 20:20:54.333705] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:22.639 [2024-07-22 20:20:54.333711] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:22.639 [2024-07-22 20:20:54.333729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:23.208 20:20:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:23.208 20:20:54 -- common/autotest_common.sh@852 -- # return 0 00:15:23.208 20:20:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:23.208 20:20:54 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:23.208 20:20:54 -- common/autotest_common.sh@10 -- # set +x 00:15:23.208 20:20:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:23.208 20:20:55 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:23.467 [2024-07-22 20:20:55.170806] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:23.467 [2024-07-22 20:20:55.170885] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:23.467 [2024-07-22 20:20:55.170908] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:23.467 20:20:55 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:23.467 20:20:55 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 63b7328d-6384-46e2-a57d-0403a6872ae0 00:15:23.467 20:20:55 -- common/autotest_common.sh@887 -- # local bdev_name=63b7328d-6384-46e2-a57d-0403a6872ae0 00:15:23.467 20:20:55 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:15:23.467 20:20:55 -- common/autotest_common.sh@889 -- # local i 00:15:23.467 20:20:55 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:15:23.467 20:20:55 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:15:23.467 20:20:55 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:23.467 20:20:55 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 63b7328d-6384-46e2-a57d-0403a6872ae0 -t 2000 00:15:23.727 [ 00:15:23.727 { 00:15:23.727 "name": "63b7328d-6384-46e2-a57d-0403a6872ae0", 00:15:23.727 "aliases": [ 00:15:23.727 "lvs/lvol" 00:15:23.727 ], 00:15:23.727 "product_name": "Logical Volume", 00:15:23.727 "block_size": 4096, 00:15:23.727 "num_blocks": 38912, 00:15:23.727 "uuid": "63b7328d-6384-46e2-a57d-0403a6872ae0", 00:15:23.727 "assigned_rate_limits": { 00:15:23.727 "rw_ios_per_sec": 0, 00:15:23.727 "rw_mbytes_per_sec": 0, 00:15:23.727 "r_mbytes_per_sec": 0, 00:15:23.727 "w_mbytes_per_sec": 0 00:15:23.727 }, 00:15:23.727 "claimed": false, 00:15:23.727 "zoned": false, 00:15:23.727 "supported_io_types": { 00:15:23.727 "read": true, 00:15:23.727 "write": true, 00:15:23.727 "unmap": true, 00:15:23.727 "write_zeroes": true, 00:15:23.727 "flush": false, 00:15:23.727 "reset": true, 00:15:23.727 "compare": false, 00:15:23.727 "compare_and_write": false, 00:15:23.727 "abort": false, 00:15:23.727 "nvme_admin": false, 00:15:23.727 "nvme_io": false 00:15:23.727 }, 00:15:23.727 "driver_specific": { 00:15:23.727 "lvol": { 00:15:23.727 "lvol_store_uuid": "fce4fcc4-f404-48d4-905d-a6c339f2ba6b", 00:15:23.727 "base_bdev": "aio_bdev", 00:15:23.727 "thin_provision": false, 00:15:23.727 "snapshot": false, 00:15:23.727 "clone": false, 00:15:23.727 "esnap_clone": false 00:15:23.727 } 00:15:23.727 } 00:15:23.727 } 00:15:23.727 ] 00:15:23.727 20:20:55 -- common/autotest_common.sh@895 -- # return 0 00:15:23.727 20:20:55 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:23.727 20:20:55 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:23.986 20:20:55 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:23.986 20:20:55 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:23.986 20:20:55 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:23.986 20:20:55 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:23.986 20:20:55 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:24.246 [2024-07-22 20:20:55.987224] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:24.246 20:20:56 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:24.246 20:20:56 -- common/autotest_common.sh@640 -- # local es=0 00:15:24.246 20:20:56 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:24.246 20:20:56 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:24.246 20:20:56 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:24.246 20:20:56 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:24.246 20:20:56 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:24.246 20:20:56 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:24.246 20:20:56 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:24.246 20:20:56 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:24.246 20:20:56 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:24.246 20:20:56 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:24.246 request: 00:15:24.246 { 00:15:24.246 "uuid": "fce4fcc4-f404-48d4-905d-a6c339f2ba6b", 00:15:24.246 "method": "bdev_lvol_get_lvstores", 00:15:24.246 "req_id": 1 00:15:24.246 } 00:15:24.246 Got JSON-RPC error response 00:15:24.246 response: 00:15:24.246 { 00:15:24.246 "code": -19, 00:15:24.246 "message": "No such device" 00:15:24.246 } 00:15:24.506 20:20:56 -- common/autotest_common.sh@643 -- # es=1 00:15:24.506 20:20:56 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:15:24.506 20:20:56 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:15:24.506 20:20:56 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:15:24.506 20:20:56 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:24.506 aio_bdev 00:15:24.506 20:20:56 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 63b7328d-6384-46e2-a57d-0403a6872ae0 00:15:24.506 20:20:56 -- common/autotest_common.sh@887 -- # local bdev_name=63b7328d-6384-46e2-a57d-0403a6872ae0 00:15:24.506 20:20:56 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:15:24.506 20:20:56 -- common/autotest_common.sh@889 -- # local i 00:15:24.506 20:20:56 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:15:24.506 20:20:56 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:15:24.506 20:20:56 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:24.765 20:20:56 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 63b7328d-6384-46e2-a57d-0403a6872ae0 -t 2000 00:15:24.765 [ 00:15:24.765 { 00:15:24.765 "name": "63b7328d-6384-46e2-a57d-0403a6872ae0", 00:15:24.765 "aliases": [ 00:15:24.765 "lvs/lvol" 00:15:24.765 ], 00:15:24.765 "product_name": "Logical Volume", 00:15:24.766 "block_size": 4096, 00:15:24.766 "num_blocks": 38912, 00:15:24.766 "uuid": "63b7328d-6384-46e2-a57d-0403a6872ae0", 00:15:24.766 "assigned_rate_limits": { 00:15:24.766 "rw_ios_per_sec": 0, 00:15:24.766 "rw_mbytes_per_sec": 0, 00:15:24.766 "r_mbytes_per_sec": 0, 00:15:24.766 "w_mbytes_per_sec": 0 00:15:24.766 }, 00:15:24.766 "claimed": false, 00:15:24.766 "zoned": false, 00:15:24.766 "supported_io_types": { 00:15:24.766 "read": true, 00:15:24.766 "write": true, 00:15:24.766 "unmap": true, 00:15:24.766 "write_zeroes": true, 00:15:24.766 "flush": false, 00:15:24.766 "reset": true, 00:15:24.766 "compare": false, 00:15:24.766 "compare_and_write": false, 00:15:24.766 "abort": false, 00:15:24.766 "nvme_admin": false, 00:15:24.766 "nvme_io": false 00:15:24.766 }, 00:15:24.766 "driver_specific": { 00:15:24.766 "lvol": { 00:15:24.766 "lvol_store_uuid": "fce4fcc4-f404-48d4-905d-a6c339f2ba6b", 00:15:24.766 "base_bdev": "aio_bdev", 00:15:24.766 "thin_provision": false, 00:15:24.766 "snapshot": false, 00:15:24.766 "clone": false, 00:15:24.766 "esnap_clone": false 00:15:24.766 } 00:15:24.766 } 00:15:24.766 } 00:15:24.766 ] 00:15:24.766 20:20:56 -- common/autotest_common.sh@895 -- # return 0 00:15:24.766 20:20:56 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:24.766 20:20:56 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:25.025 20:20:56 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:25.025 20:20:56 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:25.025 20:20:56 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:25.285 20:20:56 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:25.285 20:20:56 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 63b7328d-6384-46e2-a57d-0403a6872ae0 00:15:25.285 20:20:57 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u fce4fcc4-f404-48d4-905d-a6c339f2ba6b 00:15:25.544 20:20:57 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:25.544 20:20:57 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:25.804 00:15:25.804 real 0m16.984s 00:15:25.804 user 0m43.191s 00:15:25.804 sys 0m4.074s 00:15:25.804 20:20:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:25.804 20:20:57 -- common/autotest_common.sh@10 -- # set +x 00:15:25.804 ************************************ 00:15:25.804 END TEST lvs_grow_dirty 00:15:25.804 ************************************ 00:15:25.804 20:20:57 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:25.804 20:20:57 -- common/autotest_common.sh@796 -- # type=--id 00:15:25.804 20:20:57 -- common/autotest_common.sh@797 -- # id=0 00:15:25.804 20:20:57 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:15:25.804 20:20:57 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:25.804 20:20:57 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:15:25.804 20:20:57 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:15:25.804 20:20:57 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:15:25.804 20:20:57 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:25.804 nvmf_trace.0 00:15:25.804 20:20:57 -- common/autotest_common.sh@811 -- # return 0 00:15:25.804 20:20:57 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:25.804 20:20:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:25.804 20:20:57 -- nvmf/common.sh@116 -- # sync 00:15:25.804 20:20:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:25.804 20:20:57 -- nvmf/common.sh@119 -- # set +e 00:15:25.804 20:20:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:25.804 20:20:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:25.804 rmmod nvme_tcp 00:15:25.804 rmmod nvme_fabrics 00:15:25.804 rmmod nvme_keyring 00:15:25.805 20:20:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:25.805 20:20:57 -- nvmf/common.sh@123 -- # set -e 00:15:25.805 20:20:57 -- nvmf/common.sh@124 -- # return 0 00:15:25.805 20:20:57 -- nvmf/common.sh@477 -- # '[' -n 3381819 ']' 00:15:25.805 20:20:57 -- nvmf/common.sh@478 -- # killprocess 3381819 00:15:25.805 20:20:57 -- common/autotest_common.sh@926 -- # '[' -z 3381819 ']' 00:15:25.805 20:20:57 -- common/autotest_common.sh@930 -- # kill -0 3381819 00:15:25.805 20:20:57 -- common/autotest_common.sh@931 -- # uname 00:15:25.805 20:20:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:25.805 20:20:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3381819 00:15:25.805 20:20:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:25.805 20:20:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:25.805 20:20:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3381819' 00:15:25.805 killing process with pid 3381819 00:15:25.805 20:20:57 -- common/autotest_common.sh@945 -- # kill 3381819 00:15:25.805 20:20:57 -- common/autotest_common.sh@950 -- # wait 3381819 00:15:26.065 20:20:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:26.065 20:20:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:26.065 20:20:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:26.065 20:20:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:26.065 20:20:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:26.065 20:20:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.065 20:20:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.065 20:20:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:27.974 20:20:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:28.234 00:15:28.234 real 0m41.128s 00:15:28.234 user 1m3.582s 00:15:28.234 sys 0m9.836s 00:15:28.234 20:20:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:28.234 20:20:59 -- common/autotest_common.sh@10 -- # set +x 00:15:28.234 ************************************ 00:15:28.234 END TEST nvmf_lvs_grow 00:15:28.234 ************************************ 00:15:28.234 20:20:59 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:28.234 20:20:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:28.234 20:20:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:28.234 20:20:59 -- common/autotest_common.sh@10 -- # set +x 00:15:28.234 ************************************ 00:15:28.234 START TEST nvmf_bdev_io_wait 00:15:28.234 ************************************ 00:15:28.234 20:20:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:28.234 * Looking for test storage... 00:15:28.234 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:28.234 20:21:00 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:28.234 20:21:00 -- nvmf/common.sh@7 -- # uname -s 00:15:28.234 20:21:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:28.234 20:21:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:28.234 20:21:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:28.234 20:21:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:28.234 20:21:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:28.234 20:21:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:28.234 20:21:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:28.234 20:21:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:28.234 20:21:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:28.234 20:21:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:28.234 20:21:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:15:28.234 20:21:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:15:28.234 20:21:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:28.234 20:21:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:28.234 20:21:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:28.234 20:21:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:28.234 20:21:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:28.234 20:21:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:28.234 20:21:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:28.234 20:21:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.234 20:21:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.234 20:21:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.234 20:21:00 -- paths/export.sh@5 -- # export PATH 00:15:28.234 20:21:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.234 20:21:00 -- nvmf/common.sh@46 -- # : 0 00:15:28.234 20:21:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:28.234 20:21:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:28.234 20:21:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:28.234 20:21:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:28.234 20:21:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:28.234 20:21:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:28.234 20:21:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:28.234 20:21:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:28.234 20:21:00 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:28.234 20:21:00 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:28.234 20:21:00 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:28.234 20:21:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:28.234 20:21:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:28.234 20:21:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:28.234 20:21:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:28.234 20:21:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:28.234 20:21:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.234 20:21:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:28.234 20:21:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:28.234 20:21:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:28.234 20:21:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:28.234 20:21:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:28.234 20:21:00 -- common/autotest_common.sh@10 -- # set +x 00:15:33.565 20:21:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:33.565 20:21:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:33.565 20:21:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:33.565 20:21:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:33.565 20:21:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:33.565 20:21:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:33.565 20:21:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:33.565 20:21:05 -- nvmf/common.sh@294 -- # net_devs=() 00:15:33.565 20:21:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:33.565 20:21:05 -- nvmf/common.sh@295 -- # e810=() 00:15:33.565 20:21:05 -- nvmf/common.sh@295 -- # local -ga e810 00:15:33.565 20:21:05 -- nvmf/common.sh@296 -- # x722=() 00:15:33.565 20:21:05 -- nvmf/common.sh@296 -- # local -ga x722 00:15:33.565 20:21:05 -- nvmf/common.sh@297 -- # mlx=() 00:15:33.565 20:21:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:33.565 20:21:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:33.565 20:21:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:33.565 20:21:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:33.565 20:21:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:33.565 20:21:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.565 20:21:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:15:33.565 Found 0000:86:00.0 (0x8086 - 0x159b) 00:15:33.565 20:21:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.565 20:21:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:15:33.565 Found 0000:86:00.1 (0x8086 - 0x159b) 00:15:33.565 20:21:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:33.565 20:21:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.565 20:21:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.565 20:21:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.565 20:21:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.565 20:21:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:15:33.565 Found net devices under 0000:86:00.0: cvl_0_0 00:15:33.565 20:21:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.565 20:21:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.565 20:21:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.565 20:21:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.565 20:21:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.565 20:21:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:15:33.565 Found net devices under 0000:86:00.1: cvl_0_1 00:15:33.565 20:21:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.565 20:21:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:33.565 20:21:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:33.565 20:21:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:33.565 20:21:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:33.565 20:21:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:33.565 20:21:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:33.565 20:21:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:33.565 20:21:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:33.565 20:21:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:33.565 20:21:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:33.565 20:21:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:33.565 20:21:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:33.565 20:21:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:33.565 20:21:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:33.565 20:21:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:33.565 20:21:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:33.565 20:21:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:33.565 20:21:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:33.565 20:21:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:33.565 20:21:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:33.565 20:21:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:33.862 20:21:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:33.862 20:21:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:33.862 20:21:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:33.862 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:33.862 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:15:33.862 00:15:33.862 --- 10.0.0.2 ping statistics --- 00:15:33.862 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.862 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:15:33.862 20:21:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:33.862 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:33.862 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.253 ms 00:15:33.862 00:15:33.862 --- 10.0.0.1 ping statistics --- 00:15:33.862 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.862 rtt min/avg/max/mdev = 0.253/0.253/0.253/0.000 ms 00:15:33.862 20:21:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:33.862 20:21:05 -- nvmf/common.sh@410 -- # return 0 00:15:33.862 20:21:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:33.862 20:21:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:33.862 20:21:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:33.862 20:21:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:33.862 20:21:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:33.862 20:21:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:33.862 20:21:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:33.862 20:21:05 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:33.862 20:21:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:33.862 20:21:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:33.862 20:21:05 -- common/autotest_common.sh@10 -- # set +x 00:15:33.862 20:21:05 -- nvmf/common.sh@469 -- # nvmfpid=3386032 00:15:33.862 20:21:05 -- nvmf/common.sh@470 -- # waitforlisten 3386032 00:15:33.862 20:21:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:33.862 20:21:05 -- common/autotest_common.sh@819 -- # '[' -z 3386032 ']' 00:15:33.862 20:21:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:33.862 20:21:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:33.862 20:21:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:33.862 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:33.862 20:21:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:33.862 20:21:05 -- common/autotest_common.sh@10 -- # set +x 00:15:33.862 [2024-07-22 20:21:05.661263] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:33.862 [2024-07-22 20:21:05.661305] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:33.862 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.862 [2024-07-22 20:21:05.719710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:33.862 [2024-07-22 20:21:05.795121] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:33.862 [2024-07-22 20:21:05.795236] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:33.862 [2024-07-22 20:21:05.795243] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:33.862 [2024-07-22 20:21:05.795250] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:33.862 [2024-07-22 20:21:05.795290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:33.862 [2024-07-22 20:21:05.795400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:33.862 [2024-07-22 20:21:05.795509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:33.862 [2024-07-22 20:21:05.795510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:34.800 20:21:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:34.800 20:21:06 -- common/autotest_common.sh@852 -- # return 0 00:15:34.800 20:21:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:34.800 20:21:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:34.800 20:21:06 -- common/autotest_common.sh@10 -- # set +x 00:15:34.800 20:21:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:34.800 20:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.800 20:21:06 -- common/autotest_common.sh@10 -- # set +x 00:15:34.800 20:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:34.800 20:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.800 20:21:06 -- common/autotest_common.sh@10 -- # set +x 00:15:34.800 20:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:34.800 20:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.800 20:21:06 -- common/autotest_common.sh@10 -- # set +x 00:15:34.800 [2024-07-22 20:21:06.574024] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:34.800 20:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:34.800 20:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.800 20:21:06 -- common/autotest_common.sh@10 -- # set +x 00:15:34.800 Malloc0 00:15:34.800 20:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:34.800 20:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.800 20:21:06 -- common/autotest_common.sh@10 -- # set +x 00:15:34.800 20:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:34.800 20:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.800 20:21:06 -- common/autotest_common.sh@10 -- # set +x 00:15:34.800 20:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:34.800 20:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:34.800 20:21:06 -- common/autotest_common.sh@10 -- # set +x 00:15:34.800 [2024-07-22 20:21:06.630880] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:34.800 20:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3386282 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@30 -- # READ_PID=3386284 00:15:34.800 20:21:06 -- nvmf/common.sh@520 -- # config=() 00:15:34.800 20:21:06 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.800 20:21:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.800 20:21:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.800 { 00:15:34.800 "params": { 00:15:34.800 "name": "Nvme$subsystem", 00:15:34.800 "trtype": "$TEST_TRANSPORT", 00:15:34.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.800 "adrfam": "ipv4", 00:15:34.800 "trsvcid": "$NVMF_PORT", 00:15:34.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.800 "hdgst": ${hdgst:-false}, 00:15:34.800 "ddgst": ${ddgst:-false} 00:15:34.800 }, 00:15:34.800 "method": "bdev_nvme_attach_controller" 00:15:34.800 } 00:15:34.800 EOF 00:15:34.800 )") 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:34.800 20:21:06 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3386286 00:15:34.800 20:21:06 -- nvmf/common.sh@520 -- # config=() 00:15:34.800 20:21:06 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.800 20:21:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.800 20:21:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.800 { 00:15:34.800 "params": { 00:15:34.800 "name": "Nvme$subsystem", 00:15:34.801 "trtype": "$TEST_TRANSPORT", 00:15:34.801 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.801 "adrfam": "ipv4", 00:15:34.801 "trsvcid": "$NVMF_PORT", 00:15:34.801 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.801 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.801 "hdgst": ${hdgst:-false}, 00:15:34.801 "ddgst": ${ddgst:-false} 00:15:34.801 }, 00:15:34.801 "method": "bdev_nvme_attach_controller" 00:15:34.801 } 00:15:34.801 EOF 00:15:34.801 )") 00:15:34.801 20:21:06 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:34.801 20:21:06 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3386289 00:15:34.801 20:21:06 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:34.801 20:21:06 -- target/bdev_io_wait.sh@35 -- # sync 00:15:34.801 20:21:06 -- nvmf/common.sh@542 -- # cat 00:15:34.801 20:21:06 -- nvmf/common.sh@520 -- # config=() 00:15:34.801 20:21:06 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.801 20:21:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.801 20:21:06 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:34.801 20:21:06 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:34.801 20:21:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.801 { 00:15:34.801 "params": { 00:15:34.801 "name": "Nvme$subsystem", 00:15:34.801 "trtype": "$TEST_TRANSPORT", 00:15:34.801 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.801 "adrfam": "ipv4", 00:15:34.801 "trsvcid": "$NVMF_PORT", 00:15:34.801 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.801 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.801 "hdgst": ${hdgst:-false}, 00:15:34.801 "ddgst": ${ddgst:-false} 00:15:34.801 }, 00:15:34.801 "method": "bdev_nvme_attach_controller" 00:15:34.801 } 00:15:34.801 EOF 00:15:34.801 )") 00:15:34.801 20:21:06 -- nvmf/common.sh@520 -- # config=() 00:15:34.801 20:21:06 -- nvmf/common.sh@542 -- # cat 00:15:34.801 20:21:06 -- nvmf/common.sh@520 -- # local subsystem config 00:15:34.801 20:21:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:34.801 20:21:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:34.801 { 00:15:34.801 "params": { 00:15:34.801 "name": "Nvme$subsystem", 00:15:34.801 "trtype": "$TEST_TRANSPORT", 00:15:34.801 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:34.801 "adrfam": "ipv4", 00:15:34.801 "trsvcid": "$NVMF_PORT", 00:15:34.801 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:34.801 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:34.801 "hdgst": ${hdgst:-false}, 00:15:34.801 "ddgst": ${ddgst:-false} 00:15:34.801 }, 00:15:34.801 "method": "bdev_nvme_attach_controller" 00:15:34.801 } 00:15:34.801 EOF 00:15:34.801 )") 00:15:34.801 20:21:06 -- nvmf/common.sh@542 -- # cat 00:15:34.801 20:21:06 -- target/bdev_io_wait.sh@37 -- # wait 3386282 00:15:34.801 20:21:06 -- nvmf/common.sh@542 -- # cat 00:15:34.801 20:21:06 -- nvmf/common.sh@544 -- # jq . 00:15:34.801 20:21:06 -- nvmf/common.sh@544 -- # jq . 00:15:34.801 20:21:06 -- nvmf/common.sh@544 -- # jq . 00:15:34.801 20:21:06 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.801 20:21:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.801 "params": { 00:15:34.801 "name": "Nvme1", 00:15:34.801 "trtype": "tcp", 00:15:34.801 "traddr": "10.0.0.2", 00:15:34.801 "adrfam": "ipv4", 00:15:34.801 "trsvcid": "4420", 00:15:34.801 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.801 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.801 "hdgst": false, 00:15:34.801 "ddgst": false 00:15:34.801 }, 00:15:34.801 "method": "bdev_nvme_attach_controller" 00:15:34.801 }' 00:15:34.801 20:21:06 -- nvmf/common.sh@544 -- # jq . 00:15:34.801 20:21:06 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.801 20:21:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.801 "params": { 00:15:34.801 "name": "Nvme1", 00:15:34.801 "trtype": "tcp", 00:15:34.801 "traddr": "10.0.0.2", 00:15:34.801 "adrfam": "ipv4", 00:15:34.801 "trsvcid": "4420", 00:15:34.801 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.801 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.801 "hdgst": false, 00:15:34.801 "ddgst": false 00:15:34.801 }, 00:15:34.801 "method": "bdev_nvme_attach_controller" 00:15:34.801 }' 00:15:34.801 20:21:06 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.801 20:21:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.801 "params": { 00:15:34.801 "name": "Nvme1", 00:15:34.801 "trtype": "tcp", 00:15:34.801 "traddr": "10.0.0.2", 00:15:34.801 "adrfam": "ipv4", 00:15:34.801 "trsvcid": "4420", 00:15:34.801 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.801 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.801 "hdgst": false, 00:15:34.801 "ddgst": false 00:15:34.801 }, 00:15:34.801 "method": "bdev_nvme_attach_controller" 00:15:34.801 }' 00:15:34.801 20:21:06 -- nvmf/common.sh@545 -- # IFS=, 00:15:34.801 20:21:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:34.801 "params": { 00:15:34.801 "name": "Nvme1", 00:15:34.801 "trtype": "tcp", 00:15:34.801 "traddr": "10.0.0.2", 00:15:34.801 "adrfam": "ipv4", 00:15:34.801 "trsvcid": "4420", 00:15:34.801 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:34.801 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:34.801 "hdgst": false, 00:15:34.801 "ddgst": false 00:15:34.801 }, 00:15:34.801 "method": "bdev_nvme_attach_controller" 00:15:34.801 }' 00:15:34.801 [2024-07-22 20:21:06.678193] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:34.801 [2024-07-22 20:21:06.678217] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:34.801 [2024-07-22 20:21:06.678245] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:34.801 [2024-07-22 20:21:06.678254] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:34.801 [2024-07-22 20:21:06.678559] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:34.801 [2024-07-22 20:21:06.678594] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:34.801 [2024-07-22 20:21:06.679991] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:34.801 [2024-07-22 20:21:06.680039] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:34.801 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.061 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.061 [2024-07-22 20:21:06.862005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:35.061 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.061 [2024-07-22 20:21:06.936417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:35.061 [2024-07-22 20:21:06.961985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:35.319 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.319 [2024-07-22 20:21:07.037899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:35.319 [2024-07-22 20:21:07.063477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:35.319 [2024-07-22 20:21:07.117089] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:35.319 [2024-07-22 20:21:07.150594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:35.319 [2024-07-22 20:21:07.190623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:35.319 Running I/O for 1 seconds... 00:15:35.319 Running I/O for 1 seconds... 00:15:35.577 Running I/O for 1 seconds... 00:15:35.577 Running I/O for 1 seconds... 00:15:36.514 00:15:36.514 Latency(us) 00:15:36.514 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.514 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:36.514 Nvme1n1 : 1.00 15691.16 61.29 0.00 0.00 8135.33 4274.09 14930.81 00:15:36.514 =================================================================================================================== 00:15:36.514 Total : 15691.16 61.29 0.00 0.00 8135.33 4274.09 14930.81 00:15:36.514 00:15:36.514 Latency(us) 00:15:36.514 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.515 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:36.515 Nvme1n1 : 1.01 7140.60 27.89 0.00 0.00 17798.22 4359.57 24276.81 00:15:36.515 =================================================================================================================== 00:15:36.515 Total : 7140.60 27.89 0.00 0.00 17798.22 4359.57 24276.81 00:15:36.515 00:15:36.515 Latency(us) 00:15:36.515 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.515 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:36.515 Nvme1n1 : 1.00 251082.74 980.79 0.00 0.00 507.47 204.80 616.18 00:15:36.515 =================================================================================================================== 00:15:36.515 Total : 251082.74 980.79 0.00 0.00 507.47 204.80 616.18 00:15:36.774 00:15:36.774 Latency(us) 00:15:36.774 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:36.774 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:36.774 Nvme1n1 : 1.00 8541.24 33.36 0.00 0.00 14955.30 3632.97 40803.28 00:15:36.774 =================================================================================================================== 00:15:36.774 Total : 8541.24 33.36 0.00 0.00 14955.30 3632.97 40803.28 00:15:36.774 20:21:08 -- target/bdev_io_wait.sh@38 -- # wait 3386284 00:15:36.774 20:21:08 -- target/bdev_io_wait.sh@39 -- # wait 3386286 00:15:36.774 20:21:08 -- target/bdev_io_wait.sh@40 -- # wait 3386289 00:15:36.774 20:21:08 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:36.774 20:21:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:36.774 20:21:08 -- common/autotest_common.sh@10 -- # set +x 00:15:36.774 20:21:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:36.774 20:21:08 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:36.774 20:21:08 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:36.774 20:21:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:36.774 20:21:08 -- nvmf/common.sh@116 -- # sync 00:15:36.774 20:21:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:36.774 20:21:08 -- nvmf/common.sh@119 -- # set +e 00:15:36.774 20:21:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:36.774 20:21:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:36.774 rmmod nvme_tcp 00:15:37.033 rmmod nvme_fabrics 00:15:37.033 rmmod nvme_keyring 00:15:37.033 20:21:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:37.033 20:21:08 -- nvmf/common.sh@123 -- # set -e 00:15:37.033 20:21:08 -- nvmf/common.sh@124 -- # return 0 00:15:37.033 20:21:08 -- nvmf/common.sh@477 -- # '[' -n 3386032 ']' 00:15:37.033 20:21:08 -- nvmf/common.sh@478 -- # killprocess 3386032 00:15:37.033 20:21:08 -- common/autotest_common.sh@926 -- # '[' -z 3386032 ']' 00:15:37.033 20:21:08 -- common/autotest_common.sh@930 -- # kill -0 3386032 00:15:37.033 20:21:08 -- common/autotest_common.sh@931 -- # uname 00:15:37.033 20:21:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:37.033 20:21:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3386032 00:15:37.033 20:21:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:37.033 20:21:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:37.033 20:21:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3386032' 00:15:37.033 killing process with pid 3386032 00:15:37.033 20:21:08 -- common/autotest_common.sh@945 -- # kill 3386032 00:15:37.033 20:21:08 -- common/autotest_common.sh@950 -- # wait 3386032 00:15:37.292 20:21:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:37.292 20:21:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:37.292 20:21:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:37.292 20:21:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:37.292 20:21:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:37.292 20:21:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:37.292 20:21:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:37.292 20:21:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:39.198 20:21:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:39.198 00:15:39.198 real 0m11.107s 00:15:39.198 user 0m19.821s 00:15:39.198 sys 0m5.775s 00:15:39.198 20:21:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:39.198 20:21:11 -- common/autotest_common.sh@10 -- # set +x 00:15:39.198 ************************************ 00:15:39.198 END TEST nvmf_bdev_io_wait 00:15:39.198 ************************************ 00:15:39.198 20:21:11 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:39.198 20:21:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:39.198 20:21:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:39.198 20:21:11 -- common/autotest_common.sh@10 -- # set +x 00:15:39.198 ************************************ 00:15:39.198 START TEST nvmf_queue_depth 00:15:39.198 ************************************ 00:15:39.198 20:21:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:39.458 * Looking for test storage... 00:15:39.458 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:39.458 20:21:11 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:39.458 20:21:11 -- nvmf/common.sh@7 -- # uname -s 00:15:39.458 20:21:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:39.458 20:21:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:39.458 20:21:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:39.458 20:21:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:39.458 20:21:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:39.458 20:21:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:39.458 20:21:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:39.458 20:21:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:39.458 20:21:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:39.458 20:21:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:39.458 20:21:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:15:39.458 20:21:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:15:39.458 20:21:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:39.458 20:21:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:39.458 20:21:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:39.458 20:21:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:39.458 20:21:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:39.458 20:21:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:39.458 20:21:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:39.458 20:21:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.458 20:21:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.458 20:21:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.458 20:21:11 -- paths/export.sh@5 -- # export PATH 00:15:39.458 20:21:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:39.458 20:21:11 -- nvmf/common.sh@46 -- # : 0 00:15:39.458 20:21:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:39.458 20:21:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:39.458 20:21:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:39.458 20:21:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:39.458 20:21:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:39.458 20:21:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:39.458 20:21:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:39.458 20:21:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:39.458 20:21:11 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:39.458 20:21:11 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:39.458 20:21:11 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:39.458 20:21:11 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:39.458 20:21:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:39.458 20:21:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:39.458 20:21:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:39.458 20:21:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:39.458 20:21:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:39.458 20:21:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:39.458 20:21:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:39.458 20:21:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:39.458 20:21:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:39.458 20:21:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:39.458 20:21:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:39.458 20:21:11 -- common/autotest_common.sh@10 -- # set +x 00:15:44.738 20:21:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:44.738 20:21:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:44.738 20:21:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:44.738 20:21:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:44.738 20:21:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:44.738 20:21:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:44.738 20:21:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:44.738 20:21:16 -- nvmf/common.sh@294 -- # net_devs=() 00:15:44.738 20:21:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:44.738 20:21:16 -- nvmf/common.sh@295 -- # e810=() 00:15:44.738 20:21:16 -- nvmf/common.sh@295 -- # local -ga e810 00:15:44.738 20:21:16 -- nvmf/common.sh@296 -- # x722=() 00:15:44.738 20:21:16 -- nvmf/common.sh@296 -- # local -ga x722 00:15:44.738 20:21:16 -- nvmf/common.sh@297 -- # mlx=() 00:15:44.738 20:21:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:44.738 20:21:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:44.738 20:21:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:44.738 20:21:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:44.738 20:21:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:44.738 20:21:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:44.738 20:21:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:15:44.738 Found 0000:86:00.0 (0x8086 - 0x159b) 00:15:44.738 20:21:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:44.738 20:21:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:15:44.738 Found 0000:86:00.1 (0x8086 - 0x159b) 00:15:44.738 20:21:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:44.738 20:21:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:44.738 20:21:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:44.738 20:21:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:44.738 20:21:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:44.738 20:21:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:44.738 20:21:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:15:44.738 Found net devices under 0000:86:00.0: cvl_0_0 00:15:44.738 20:21:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:44.738 20:21:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:44.739 20:21:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:44.739 20:21:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:44.739 20:21:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:44.739 20:21:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:15:44.739 Found net devices under 0000:86:00.1: cvl_0_1 00:15:44.739 20:21:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:44.739 20:21:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:44.739 20:21:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:44.739 20:21:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:44.739 20:21:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:44.739 20:21:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:44.739 20:21:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:44.739 20:21:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:44.739 20:21:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:44.739 20:21:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:44.739 20:21:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:44.739 20:21:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:44.739 20:21:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:44.739 20:21:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:44.739 20:21:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:44.739 20:21:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:44.739 20:21:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:44.739 20:21:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:44.739 20:21:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:44.739 20:21:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:44.739 20:21:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:44.739 20:21:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:44.739 20:21:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:44.739 20:21:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:44.739 20:21:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:44.739 20:21:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:44.739 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:44.739 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:15:44.739 00:15:44.739 --- 10.0.0.2 ping statistics --- 00:15:44.739 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:44.739 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:15:44.739 20:21:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:44.739 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:44.739 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.237 ms 00:15:44.739 00:15:44.739 --- 10.0.0.1 ping statistics --- 00:15:44.739 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:44.739 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:15:44.739 20:21:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:44.739 20:21:16 -- nvmf/common.sh@410 -- # return 0 00:15:44.739 20:21:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:44.739 20:21:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:44.739 20:21:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:44.739 20:21:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:44.739 20:21:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:44.739 20:21:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:44.739 20:21:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:44.739 20:21:16 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:44.739 20:21:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:44.739 20:21:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:44.739 20:21:16 -- common/autotest_common.sh@10 -- # set +x 00:15:44.739 20:21:16 -- nvmf/common.sh@469 -- # nvmfpid=3390474 00:15:44.739 20:21:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:44.739 20:21:16 -- nvmf/common.sh@470 -- # waitforlisten 3390474 00:15:44.739 20:21:16 -- common/autotest_common.sh@819 -- # '[' -z 3390474 ']' 00:15:44.739 20:21:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:44.739 20:21:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:44.739 20:21:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:44.739 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:44.739 20:21:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:44.739 20:21:16 -- common/autotest_common.sh@10 -- # set +x 00:15:44.739 [2024-07-22 20:21:16.418625] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:44.739 [2024-07-22 20:21:16.418667] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:44.739 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.739 [2024-07-22 20:21:16.474260] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:44.739 [2024-07-22 20:21:16.551386] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:44.739 [2024-07-22 20:21:16.551502] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:44.739 [2024-07-22 20:21:16.551514] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:44.739 [2024-07-22 20:21:16.551522] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:44.739 [2024-07-22 20:21:16.551544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:45.308 20:21:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:45.308 20:21:17 -- common/autotest_common.sh@852 -- # return 0 00:15:45.308 20:21:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:45.308 20:21:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:45.308 20:21:17 -- common/autotest_common.sh@10 -- # set +x 00:15:45.567 20:21:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:45.567 20:21:17 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:45.567 20:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.567 20:21:17 -- common/autotest_common.sh@10 -- # set +x 00:15:45.567 [2024-07-22 20:21:17.254179] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:45.567 20:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.567 20:21:17 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:45.567 20:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.567 20:21:17 -- common/autotest_common.sh@10 -- # set +x 00:15:45.567 Malloc0 00:15:45.567 20:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.567 20:21:17 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:45.567 20:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.567 20:21:17 -- common/autotest_common.sh@10 -- # set +x 00:15:45.567 20:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.567 20:21:17 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:45.567 20:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.567 20:21:17 -- common/autotest_common.sh@10 -- # set +x 00:15:45.567 20:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.567 20:21:17 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:45.567 20:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.567 20:21:17 -- common/autotest_common.sh@10 -- # set +x 00:15:45.568 [2024-07-22 20:21:17.322052] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:45.568 20:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.568 20:21:17 -- target/queue_depth.sh@30 -- # bdevperf_pid=3390636 00:15:45.568 20:21:17 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:45.568 20:21:17 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:45.568 20:21:17 -- target/queue_depth.sh@33 -- # waitforlisten 3390636 /var/tmp/bdevperf.sock 00:15:45.568 20:21:17 -- common/autotest_common.sh@819 -- # '[' -z 3390636 ']' 00:15:45.568 20:21:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:45.568 20:21:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:45.568 20:21:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:45.568 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:45.568 20:21:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:45.568 20:21:17 -- common/autotest_common.sh@10 -- # set +x 00:15:45.568 [2024-07-22 20:21:17.368674] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:15:45.568 [2024-07-22 20:21:17.368720] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3390636 ] 00:15:45.568 EAL: No free 2048 kB hugepages reported on node 1 00:15:45.568 [2024-07-22 20:21:17.423604] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:45.568 [2024-07-22 20:21:17.500732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:46.507 20:21:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:46.507 20:21:18 -- common/autotest_common.sh@852 -- # return 0 00:15:46.507 20:21:18 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:46.507 20:21:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:46.507 20:21:18 -- common/autotest_common.sh@10 -- # set +x 00:15:46.507 NVMe0n1 00:15:46.507 20:21:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:46.507 20:21:18 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:46.766 Running I/O for 10 seconds... 00:15:56.760 00:15:56.760 Latency(us) 00:15:56.760 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:56.760 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:56.760 Verification LBA range: start 0x0 length 0x4000 00:15:56.760 NVMe0n1 : 10.05 18273.84 71.38 0.00 0.00 55876.80 11682.50 49465.43 00:15:56.760 =================================================================================================================== 00:15:56.760 Total : 18273.84 71.38 0.00 0.00 55876.80 11682.50 49465.43 00:15:56.760 0 00:15:56.760 20:21:28 -- target/queue_depth.sh@39 -- # killprocess 3390636 00:15:56.760 20:21:28 -- common/autotest_common.sh@926 -- # '[' -z 3390636 ']' 00:15:56.760 20:21:28 -- common/autotest_common.sh@930 -- # kill -0 3390636 00:15:56.760 20:21:28 -- common/autotest_common.sh@931 -- # uname 00:15:56.760 20:21:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:56.760 20:21:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3390636 00:15:56.760 20:21:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:56.760 20:21:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:56.760 20:21:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3390636' 00:15:56.760 killing process with pid 3390636 00:15:56.760 20:21:28 -- common/autotest_common.sh@945 -- # kill 3390636 00:15:56.760 Received shutdown signal, test time was about 10.000000 seconds 00:15:56.760 00:15:56.760 Latency(us) 00:15:56.760 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:56.760 =================================================================================================================== 00:15:56.760 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:56.760 20:21:28 -- common/autotest_common.sh@950 -- # wait 3390636 00:15:57.019 20:21:28 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:57.019 20:21:28 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:57.019 20:21:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:57.019 20:21:28 -- nvmf/common.sh@116 -- # sync 00:15:57.019 20:21:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:57.019 20:21:28 -- nvmf/common.sh@119 -- # set +e 00:15:57.019 20:21:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:57.019 20:21:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:57.019 rmmod nvme_tcp 00:15:57.019 rmmod nvme_fabrics 00:15:57.019 rmmod nvme_keyring 00:15:57.019 20:21:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:57.019 20:21:28 -- nvmf/common.sh@123 -- # set -e 00:15:57.019 20:21:28 -- nvmf/common.sh@124 -- # return 0 00:15:57.019 20:21:28 -- nvmf/common.sh@477 -- # '[' -n 3390474 ']' 00:15:57.019 20:21:28 -- nvmf/common.sh@478 -- # killprocess 3390474 00:15:57.019 20:21:28 -- common/autotest_common.sh@926 -- # '[' -z 3390474 ']' 00:15:57.019 20:21:28 -- common/autotest_common.sh@930 -- # kill -0 3390474 00:15:57.019 20:21:28 -- common/autotest_common.sh@931 -- # uname 00:15:57.019 20:21:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:57.019 20:21:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3390474 00:15:57.019 20:21:28 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:57.019 20:21:28 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:57.019 20:21:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3390474' 00:15:57.019 killing process with pid 3390474 00:15:57.019 20:21:28 -- common/autotest_common.sh@945 -- # kill 3390474 00:15:57.019 20:21:28 -- common/autotest_common.sh@950 -- # wait 3390474 00:15:57.278 20:21:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:57.278 20:21:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:57.278 20:21:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:57.278 20:21:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:57.278 20:21:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:57.278 20:21:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:57.278 20:21:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:57.278 20:21:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:59.809 20:21:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:59.809 00:15:59.809 real 0m20.101s 00:15:59.809 user 0m24.642s 00:15:59.809 sys 0m5.627s 00:15:59.809 20:21:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:59.809 20:21:31 -- common/autotest_common.sh@10 -- # set +x 00:15:59.809 ************************************ 00:15:59.809 END TEST nvmf_queue_depth 00:15:59.809 ************************************ 00:15:59.809 20:21:31 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:59.809 20:21:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:59.809 20:21:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:59.809 20:21:31 -- common/autotest_common.sh@10 -- # set +x 00:15:59.809 ************************************ 00:15:59.809 START TEST nvmf_multipath 00:15:59.809 ************************************ 00:15:59.809 20:21:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:59.809 * Looking for test storage... 00:15:59.809 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:59.809 20:21:31 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:59.809 20:21:31 -- nvmf/common.sh@7 -- # uname -s 00:15:59.809 20:21:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:59.809 20:21:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:59.809 20:21:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:59.809 20:21:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:59.809 20:21:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:59.809 20:21:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:59.809 20:21:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:59.809 20:21:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:59.809 20:21:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:59.809 20:21:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:59.809 20:21:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:15:59.809 20:21:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:15:59.809 20:21:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:59.809 20:21:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:59.809 20:21:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:59.809 20:21:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:59.809 20:21:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:59.809 20:21:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:59.809 20:21:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:59.809 20:21:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:59.809 20:21:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:59.809 20:21:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:59.809 20:21:31 -- paths/export.sh@5 -- # export PATH 00:15:59.809 20:21:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:59.809 20:21:31 -- nvmf/common.sh@46 -- # : 0 00:15:59.809 20:21:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:59.809 20:21:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:59.809 20:21:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:59.809 20:21:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:59.809 20:21:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:59.809 20:21:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:59.809 20:21:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:59.809 20:21:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:59.809 20:21:31 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:59.809 20:21:31 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:59.809 20:21:31 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:59.809 20:21:31 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:59.809 20:21:31 -- target/multipath.sh@43 -- # nvmftestinit 00:15:59.809 20:21:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:59.809 20:21:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:59.809 20:21:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:59.809 20:21:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:59.809 20:21:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:59.809 20:21:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:59.809 20:21:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:59.809 20:21:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:59.809 20:21:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:59.809 20:21:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:59.809 20:21:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:59.809 20:21:31 -- common/autotest_common.sh@10 -- # set +x 00:16:05.134 20:21:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:05.134 20:21:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:05.134 20:21:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:05.134 20:21:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:05.134 20:21:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:05.134 20:21:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:05.134 20:21:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:05.134 20:21:36 -- nvmf/common.sh@294 -- # net_devs=() 00:16:05.134 20:21:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:05.134 20:21:36 -- nvmf/common.sh@295 -- # e810=() 00:16:05.134 20:21:36 -- nvmf/common.sh@295 -- # local -ga e810 00:16:05.134 20:21:36 -- nvmf/common.sh@296 -- # x722=() 00:16:05.134 20:21:36 -- nvmf/common.sh@296 -- # local -ga x722 00:16:05.134 20:21:36 -- nvmf/common.sh@297 -- # mlx=() 00:16:05.134 20:21:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:05.134 20:21:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:05.134 20:21:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:05.134 20:21:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:05.134 20:21:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:05.134 20:21:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:05.134 20:21:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:16:05.134 Found 0000:86:00.0 (0x8086 - 0x159b) 00:16:05.134 20:21:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:05.134 20:21:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:16:05.134 Found 0000:86:00.1 (0x8086 - 0x159b) 00:16:05.134 20:21:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:05.134 20:21:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:05.134 20:21:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:05.134 20:21:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:05.134 20:21:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:05.134 20:21:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:16:05.134 Found net devices under 0000:86:00.0: cvl_0_0 00:16:05.134 20:21:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:05.134 20:21:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:05.134 20:21:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:05.134 20:21:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:05.134 20:21:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:05.134 20:21:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:16:05.134 Found net devices under 0000:86:00.1: cvl_0_1 00:16:05.134 20:21:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:05.134 20:21:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:05.134 20:21:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:05.134 20:21:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:05.134 20:21:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:05.134 20:21:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:05.134 20:21:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:05.134 20:21:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:05.135 20:21:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:05.135 20:21:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:05.135 20:21:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:05.135 20:21:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:05.135 20:21:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:05.135 20:21:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:05.135 20:21:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:05.135 20:21:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:05.135 20:21:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:05.135 20:21:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:05.135 20:21:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:05.135 20:21:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:05.135 20:21:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:05.135 20:21:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:05.135 20:21:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:05.135 20:21:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:05.135 20:21:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:05.135 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:05.135 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.152 ms 00:16:05.135 00:16:05.135 --- 10.0.0.2 ping statistics --- 00:16:05.135 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:05.135 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:16:05.135 20:21:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:05.135 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:05.135 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.230 ms 00:16:05.135 00:16:05.135 --- 10.0.0.1 ping statistics --- 00:16:05.135 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:05.135 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:16:05.135 20:21:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:05.135 20:21:36 -- nvmf/common.sh@410 -- # return 0 00:16:05.135 20:21:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:05.135 20:21:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:05.135 20:21:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:05.135 20:21:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:05.135 20:21:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:05.135 20:21:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:05.135 20:21:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:05.135 20:21:37 -- target/multipath.sh@45 -- # '[' -z ']' 00:16:05.135 20:21:37 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:16:05.135 only one NIC for nvmf test 00:16:05.135 20:21:37 -- target/multipath.sh@47 -- # nvmftestfini 00:16:05.135 20:21:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:05.135 20:21:37 -- nvmf/common.sh@116 -- # sync 00:16:05.135 20:21:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:05.135 20:21:37 -- nvmf/common.sh@119 -- # set +e 00:16:05.135 20:21:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:05.135 20:21:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:05.135 rmmod nvme_tcp 00:16:05.135 rmmod nvme_fabrics 00:16:05.135 rmmod nvme_keyring 00:16:05.135 20:21:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:05.135 20:21:37 -- nvmf/common.sh@123 -- # set -e 00:16:05.135 20:21:37 -- nvmf/common.sh@124 -- # return 0 00:16:05.135 20:21:37 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:05.135 20:21:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:05.135 20:21:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:05.135 20:21:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:05.135 20:21:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:05.135 20:21:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:05.135 20:21:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:05.135 20:21:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:05.135 20:21:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.672 20:21:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:07.672 20:21:39 -- target/multipath.sh@48 -- # exit 0 00:16:07.672 20:21:39 -- target/multipath.sh@1 -- # nvmftestfini 00:16:07.672 20:21:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:07.672 20:21:39 -- nvmf/common.sh@116 -- # sync 00:16:07.672 20:21:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:07.672 20:21:39 -- nvmf/common.sh@119 -- # set +e 00:16:07.672 20:21:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:07.672 20:21:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:07.672 20:21:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:07.672 20:21:39 -- nvmf/common.sh@123 -- # set -e 00:16:07.672 20:21:39 -- nvmf/common.sh@124 -- # return 0 00:16:07.672 20:21:39 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:07.672 20:21:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:07.672 20:21:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:07.672 20:21:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:07.672 20:21:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:07.672 20:21:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:07.672 20:21:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:07.672 20:21:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:07.672 20:21:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.672 20:21:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:07.672 00:16:07.672 real 0m7.924s 00:16:07.672 user 0m1.637s 00:16:07.672 sys 0m4.276s 00:16:07.672 20:21:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:07.672 20:21:39 -- common/autotest_common.sh@10 -- # set +x 00:16:07.672 ************************************ 00:16:07.672 END TEST nvmf_multipath 00:16:07.672 ************************************ 00:16:07.672 20:21:39 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:07.673 20:21:39 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:07.673 20:21:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:07.673 20:21:39 -- common/autotest_common.sh@10 -- # set +x 00:16:07.673 ************************************ 00:16:07.673 START TEST nvmf_zcopy 00:16:07.673 ************************************ 00:16:07.673 20:21:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:07.673 * Looking for test storage... 00:16:07.673 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:07.673 20:21:39 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:07.673 20:21:39 -- nvmf/common.sh@7 -- # uname -s 00:16:07.673 20:21:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:07.673 20:21:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:07.673 20:21:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:07.673 20:21:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:07.673 20:21:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:07.673 20:21:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:07.673 20:21:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:07.673 20:21:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:07.673 20:21:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:07.673 20:21:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:07.673 20:21:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:16:07.673 20:21:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:16:07.673 20:21:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:07.673 20:21:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:07.673 20:21:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:07.673 20:21:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:07.673 20:21:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:07.673 20:21:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:07.673 20:21:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:07.673 20:21:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.673 20:21:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.673 20:21:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.673 20:21:39 -- paths/export.sh@5 -- # export PATH 00:16:07.673 20:21:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.673 20:21:39 -- nvmf/common.sh@46 -- # : 0 00:16:07.673 20:21:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:07.673 20:21:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:07.673 20:21:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:07.673 20:21:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:07.673 20:21:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:07.673 20:21:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:07.673 20:21:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:07.673 20:21:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:07.673 20:21:39 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:07.673 20:21:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:07.673 20:21:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:07.673 20:21:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:07.673 20:21:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:07.673 20:21:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:07.673 20:21:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:07.673 20:21:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:07.673 20:21:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.673 20:21:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:07.673 20:21:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:07.673 20:21:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:07.673 20:21:39 -- common/autotest_common.sh@10 -- # set +x 00:16:12.949 20:21:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:12.949 20:21:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:12.949 20:21:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:12.949 20:21:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:12.949 20:21:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:12.949 20:21:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:12.949 20:21:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:12.949 20:21:44 -- nvmf/common.sh@294 -- # net_devs=() 00:16:12.949 20:21:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:12.949 20:21:44 -- nvmf/common.sh@295 -- # e810=() 00:16:12.949 20:21:44 -- nvmf/common.sh@295 -- # local -ga e810 00:16:12.949 20:21:44 -- nvmf/common.sh@296 -- # x722=() 00:16:12.949 20:21:44 -- nvmf/common.sh@296 -- # local -ga x722 00:16:12.949 20:21:44 -- nvmf/common.sh@297 -- # mlx=() 00:16:12.949 20:21:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:12.949 20:21:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:12.949 20:21:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:12.949 20:21:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:12.949 20:21:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:12.949 20:21:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:12.949 20:21:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:16:12.949 Found 0000:86:00.0 (0x8086 - 0x159b) 00:16:12.949 20:21:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:12.949 20:21:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:16:12.949 Found 0000:86:00.1 (0x8086 - 0x159b) 00:16:12.949 20:21:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:12.949 20:21:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:12.949 20:21:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:12.949 20:21:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:12.949 20:21:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:12.949 20:21:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:16:12.949 Found net devices under 0000:86:00.0: cvl_0_0 00:16:12.949 20:21:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:12.949 20:21:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:12.949 20:21:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:12.949 20:21:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:12.949 20:21:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:12.949 20:21:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:16:12.949 Found net devices under 0000:86:00.1: cvl_0_1 00:16:12.949 20:21:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:12.949 20:21:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:12.949 20:21:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:12.949 20:21:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:12.949 20:21:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:12.949 20:21:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:12.949 20:21:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:12.949 20:21:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:12.949 20:21:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:12.949 20:21:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:12.949 20:21:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:12.949 20:21:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:12.949 20:21:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:12.949 20:21:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:12.949 20:21:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:12.949 20:21:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:12.949 20:21:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:12.949 20:21:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:12.949 20:21:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:12.949 20:21:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:12.949 20:21:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:12.949 20:21:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:12.949 20:21:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:12.949 20:21:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:12.949 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:12.949 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:16:12.949 00:16:12.949 --- 10.0.0.2 ping statistics --- 00:16:12.949 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:12.949 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:16:12.949 20:21:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:12.949 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:12.949 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.223 ms 00:16:12.949 00:16:12.949 --- 10.0.0.1 ping statistics --- 00:16:12.949 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:12.949 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:16:12.949 20:21:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:12.949 20:21:44 -- nvmf/common.sh@410 -- # return 0 00:16:12.949 20:21:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:12.949 20:21:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:12.949 20:21:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:12.949 20:21:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:12.949 20:21:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:12.949 20:21:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:12.949 20:21:44 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:12.949 20:21:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:12.949 20:21:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:12.949 20:21:44 -- common/autotest_common.sh@10 -- # set +x 00:16:12.949 20:21:44 -- nvmf/common.sh@469 -- # nvmfpid=3399437 00:16:12.949 20:21:44 -- nvmf/common.sh@470 -- # waitforlisten 3399437 00:16:12.949 20:21:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:12.949 20:21:44 -- common/autotest_common.sh@819 -- # '[' -z 3399437 ']' 00:16:12.949 20:21:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:12.949 20:21:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:12.949 20:21:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:12.950 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:12.950 20:21:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:12.950 20:21:44 -- common/autotest_common.sh@10 -- # set +x 00:16:12.950 [2024-07-22 20:21:44.826204] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:16:12.950 [2024-07-22 20:21:44.826247] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:12.950 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.950 [2024-07-22 20:21:44.883492] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:13.209 [2024-07-22 20:21:44.960447] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:13.209 [2024-07-22 20:21:44.960565] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:13.209 [2024-07-22 20:21:44.960577] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:13.209 [2024-07-22 20:21:44.960586] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:13.209 [2024-07-22 20:21:44.960609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:13.778 20:21:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:13.778 20:21:45 -- common/autotest_common.sh@852 -- # return 0 00:16:13.778 20:21:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:13.778 20:21:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:13.778 20:21:45 -- common/autotest_common.sh@10 -- # set +x 00:16:13.778 20:21:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:13.778 20:21:45 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:13.778 20:21:45 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:13.778 20:21:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:13.778 20:21:45 -- common/autotest_common.sh@10 -- # set +x 00:16:13.778 [2024-07-22 20:21:45.663741] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:13.778 20:21:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:13.778 20:21:45 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:13.778 20:21:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:13.778 20:21:45 -- common/autotest_common.sh@10 -- # set +x 00:16:13.778 20:21:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:13.778 20:21:45 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:13.778 20:21:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:13.778 20:21:45 -- common/autotest_common.sh@10 -- # set +x 00:16:13.778 [2024-07-22 20:21:45.679869] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:13.778 20:21:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:13.778 20:21:45 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:13.778 20:21:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:13.778 20:21:45 -- common/autotest_common.sh@10 -- # set +x 00:16:13.778 20:21:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:13.778 20:21:45 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:13.778 20:21:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:13.778 20:21:45 -- common/autotest_common.sh@10 -- # set +x 00:16:13.778 malloc0 00:16:13.778 20:21:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:13.778 20:21:45 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:13.778 20:21:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:13.778 20:21:45 -- common/autotest_common.sh@10 -- # set +x 00:16:13.778 20:21:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:13.778 20:21:45 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:13.778 20:21:45 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:13.778 20:21:45 -- nvmf/common.sh@520 -- # config=() 00:16:13.778 20:21:45 -- nvmf/common.sh@520 -- # local subsystem config 00:16:14.037 20:21:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:14.037 20:21:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:14.037 { 00:16:14.037 "params": { 00:16:14.037 "name": "Nvme$subsystem", 00:16:14.037 "trtype": "$TEST_TRANSPORT", 00:16:14.037 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:14.037 "adrfam": "ipv4", 00:16:14.037 "trsvcid": "$NVMF_PORT", 00:16:14.037 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:14.037 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:14.037 "hdgst": ${hdgst:-false}, 00:16:14.037 "ddgst": ${ddgst:-false} 00:16:14.037 }, 00:16:14.037 "method": "bdev_nvme_attach_controller" 00:16:14.037 } 00:16:14.037 EOF 00:16:14.037 )") 00:16:14.037 20:21:45 -- nvmf/common.sh@542 -- # cat 00:16:14.037 20:21:45 -- nvmf/common.sh@544 -- # jq . 00:16:14.037 20:21:45 -- nvmf/common.sh@545 -- # IFS=, 00:16:14.037 20:21:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:14.037 "params": { 00:16:14.037 "name": "Nvme1", 00:16:14.037 "trtype": "tcp", 00:16:14.037 "traddr": "10.0.0.2", 00:16:14.037 "adrfam": "ipv4", 00:16:14.037 "trsvcid": "4420", 00:16:14.037 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:14.037 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:14.037 "hdgst": false, 00:16:14.037 "ddgst": false 00:16:14.037 }, 00:16:14.037 "method": "bdev_nvme_attach_controller" 00:16:14.037 }' 00:16:14.038 [2024-07-22 20:21:45.756682] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:16:14.038 [2024-07-22 20:21:45.756724] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3399684 ] 00:16:14.038 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.038 [2024-07-22 20:21:45.809501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:14.038 [2024-07-22 20:21:45.885394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:14.296 Running I/O for 10 seconds... 00:16:26.510 00:16:26.510 Latency(us) 00:16:26.510 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:26.510 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:26.511 Verification LBA range: start 0x0 length 0x1000 00:16:26.511 Nvme1n1 : 10.01 12887.40 100.68 0.00 0.00 9908.84 1267.98 31001.38 00:16:26.511 =================================================================================================================== 00:16:26.511 Total : 12887.40 100.68 0.00 0.00 9908.84 1267.98 31001.38 00:16:26.511 20:21:56 -- target/zcopy.sh@39 -- # perfpid=3401374 00:16:26.511 20:21:56 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:26.511 20:21:56 -- common/autotest_common.sh@10 -- # set +x 00:16:26.511 20:21:56 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:26.511 20:21:56 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:26.511 20:21:56 -- nvmf/common.sh@520 -- # config=() 00:16:26.511 20:21:56 -- nvmf/common.sh@520 -- # local subsystem config 00:16:26.511 20:21:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:26.511 20:21:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:26.511 { 00:16:26.511 "params": { 00:16:26.511 "name": "Nvme$subsystem", 00:16:26.511 "trtype": "$TEST_TRANSPORT", 00:16:26.511 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:26.511 "adrfam": "ipv4", 00:16:26.511 "trsvcid": "$NVMF_PORT", 00:16:26.511 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:26.511 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:26.511 "hdgst": ${hdgst:-false}, 00:16:26.511 "ddgst": ${ddgst:-false} 00:16:26.511 }, 00:16:26.511 "method": "bdev_nvme_attach_controller" 00:16:26.511 } 00:16:26.511 EOF 00:16:26.511 )") 00:16:26.511 20:21:56 -- nvmf/common.sh@542 -- # cat 00:16:26.511 [2024-07-22 20:21:56.444678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.444708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 20:21:56 -- nvmf/common.sh@544 -- # jq . 00:16:26.511 20:21:56 -- nvmf/common.sh@545 -- # IFS=, 00:16:26.511 20:21:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:26.511 "params": { 00:16:26.511 "name": "Nvme1", 00:16:26.511 "trtype": "tcp", 00:16:26.511 "traddr": "10.0.0.2", 00:16:26.511 "adrfam": "ipv4", 00:16:26.511 "trsvcid": "4420", 00:16:26.511 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:26.511 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:26.511 "hdgst": false, 00:16:26.511 "ddgst": false 00:16:26.511 }, 00:16:26.511 "method": "bdev_nvme_attach_controller" 00:16:26.511 }' 00:16:26.511 [2024-07-22 20:21:56.452678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.452696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.460690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.460702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.468710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.468722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.476732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.476743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.478355] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:16:26.511 [2024-07-22 20:21:56.478395] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3401374 ] 00:16:26.511 [2024-07-22 20:21:56.484762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.484779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.492779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.492791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 EAL: No free 2048 kB hugepages reported on node 1 00:16:26.511 [2024-07-22 20:21:56.500799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.500810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.508822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.508833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.516843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.516854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.524866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.524877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.530169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:26.511 [2024-07-22 20:21:56.532889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.532902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.540908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.540920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.548929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.548940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.556951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.556963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.564973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.564984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.573003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.573023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.581017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.581031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.589038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.589053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.597065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.597077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.603484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:26.511 [2024-07-22 20:21:56.605103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.605116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.613125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.613140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.621129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.621145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.629149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.629162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.637171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.637184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.645191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.645202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.653211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.653223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.661234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.661246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.669254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.669265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.677276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.677286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.685295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.685306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.693324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.693342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.701344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.511 [2024-07-22 20:21:56.701359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.511 [2024-07-22 20:21:56.709366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.709380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.717390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.717404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.725409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.725420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.733428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.733439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.741451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.741461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.749473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.749483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.757498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.757512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.765519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.765532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.773545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.773559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.781563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.781574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.790117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.790134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.797610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.797622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 Running I/O for 5 seconds... 00:16:26.512 [2024-07-22 20:21:56.805630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.805641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.826346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.826365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.836734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.836753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.844979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.844998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.852978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.852997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.862357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.862375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.870998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.871016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.879964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.879982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.888409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.888428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.896767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.896785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.905593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.905611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.913962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.913980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.922291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.922309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.930634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.930652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.939679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.939697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.948793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.948815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.957480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.957499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.966178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.966197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.975094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.975112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.984059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.984078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:56.992482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:56.992501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.001762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.001780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.009914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.009933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.019113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.019132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.027694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.027713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.035691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.035709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.045003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.045022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.053529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.053547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.061889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.061907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.070239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.070256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.078868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.078887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.087557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.087578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.096139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.096163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.105093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.105112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.113689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.113711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.122681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.122699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.129254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.129271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.143256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.512 [2024-07-22 20:21:57.143275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.512 [2024-07-22 20:21:57.151883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.151901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.161060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.161078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.169889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.169907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.177923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.177941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.186686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.186704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.193871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.193889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.204326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.204345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.213259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.213277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.224432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.224450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.234753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.234771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.243107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.243125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.251842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.251860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.260871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.260889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.268460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.268478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.275461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.275479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.286353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.286374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.293317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.293335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.303764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.303783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.312554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.312572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.321980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.321998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.330931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.330949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.337632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.337650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.348184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.348202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.356918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.356937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.365666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.365684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.374444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.374462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.385787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.385806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.395574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.395593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.404859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.404879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.413522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.413541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.422582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.422601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.430284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.430302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.438896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.438919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.445591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.445609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.455735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.455755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.462672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.462690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.475550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.475569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.483376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.483394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.492907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.492926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.501752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.501772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.510474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.510493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.519285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.519304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.527584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.527603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.536087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.536105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.545244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.545262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.554468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.554487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.562477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.562495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.571600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.571619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.580096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.580114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.513 [2024-07-22 20:21:57.588480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.513 [2024-07-22 20:21:57.588498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.597277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.597295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.605777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.605795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.614635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.614657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.622843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.622861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.631702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.631720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.640276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.640305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.648744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.648762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.657865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.657884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.666901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.666920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.675275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.675293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.684388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.684406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.692737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.692755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.701137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.701155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.710137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.710155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.719650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.719669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.728329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.728347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.737284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.737303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.745982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.746001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.754981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.755000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.763390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.763409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.771864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.771883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.780818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.780837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.789953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.789972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.798486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.798505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.807676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.807695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.816094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.816114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.824872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.824890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.833865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.833884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.842674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.842692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.851561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.851580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.859812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.859830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.868604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.868623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.877585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.877604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.885916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.885934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.894387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.894405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.902741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.902759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.911344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.911363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.919843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.919862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.928910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.928928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.937958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.937976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.946953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.946971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.955177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.955196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.963514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.963533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.972674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.972693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.981187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.981206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.990325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.990345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:57.999143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:57.999162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:58.007639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:58.007658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:58.017239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.514 [2024-07-22 20:21:58.017258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.514 [2024-07-22 20:21:58.026483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.026501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.035493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.035512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.045097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.045116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.053642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.053660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.062827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.062845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.071672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.071689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.080167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.080186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.089003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.089022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.097561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.097581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.105948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.105967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.114882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.114907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.124082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.124101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.132404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.132423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.139024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.139050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.149774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.149801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.158470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.158488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.167715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.167733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.176345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.176363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.185053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.185071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.193944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.193962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.202505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.202523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.209328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.209346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.220374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.220392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.229206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.229223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.238551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.238569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.247676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.247694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.256535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.256553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.267188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.267206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.277740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.277758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.286380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.286402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.294641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.294659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.301911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.301929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.311350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.311368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.319717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.319735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.328655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.328674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.337163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.337182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.345484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.345502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.353895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.353913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.362270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.362288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.371002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.371019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.379233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.379252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.388010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.388028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.396331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.396350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.515 [2024-07-22 20:21:58.403769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.515 [2024-07-22 20:21:58.403786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.516 [2024-07-22 20:21:58.413503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.516 [2024-07-22 20:21:58.413522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.516 [2024-07-22 20:21:58.422035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.516 [2024-07-22 20:21:58.422061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.516 [2024-07-22 20:21:58.430560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.516 [2024-07-22 20:21:58.430579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.516 [2024-07-22 20:21:58.439336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.516 [2024-07-22 20:21:58.439355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.448055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.448088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.457105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.457124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.465635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.465653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.474236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.474254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.482716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.482735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.491671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.491689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.500805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.500823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.509535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.509552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.518623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.518641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.526753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.526771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.535601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.535623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.544076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.544093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.553153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.553171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.561569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.561586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.570429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.570447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.578630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.578648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.586358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.586376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.595822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.595841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.604619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.604638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.613595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.613617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.621861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.621879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.630754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.630771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.642112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.642130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.650687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.650705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.660476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.660494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.667884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.667902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.677408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.677426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.683959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.683976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.694792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.694810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.775 [2024-07-22 20:21:58.703733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:26.775 [2024-07-22 20:21:58.703751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.712644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.712662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.720612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.720629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.727590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.727608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.737674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.737693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.746213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.746231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.754899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.754918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.764068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.764085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.772943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.772961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.781691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.781709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.791851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.791869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.799719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.799737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.808511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.808529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.034 [2024-07-22 20:21:58.817509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.034 [2024-07-22 20:21:58.817527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.826701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.826719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.835723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.835741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.843958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.843976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.852499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.852518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.860931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.860950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.873412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.873431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.881515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.881534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.889803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.889821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.898418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.898436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.907249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.907267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.916169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.916187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.926292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.926310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.933791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.933809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.944179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.944197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.953794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.953812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.961871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.961888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.035 [2024-07-22 20:21:58.969315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.035 [2024-07-22 20:21:58.969333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:58.979741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:58.979759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:58.988047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:58.988066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:58.996576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:58.996593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.005599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.005617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.012838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.012856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.022425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.022443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.031389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.031407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.039899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.039917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.048117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.048135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.057349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.057366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.066155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.066173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.073768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.073785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.084266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.084284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.092193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.092211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.101600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.101618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.109936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.109953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.118374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.118393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.127178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.127197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.136136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.136155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.144365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.144383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.152275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.152294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.161228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.161247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.169913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.169932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.178032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.178057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.186633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.186651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.195620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.195639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.203996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.204014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.212962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.212981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.221472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.221490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.295 [2024-07-22 20:21:59.230041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.295 [2024-07-22 20:21:59.230065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.239308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.239327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.248108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.248127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.257355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.257374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.265436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.265454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.274732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.274750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.283327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.283345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.291832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.291851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.300786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.300805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.309704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.309723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.318160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.318179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.326654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.326673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.335424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.335442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.554 [2024-07-22 20:21:59.344656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.554 [2024-07-22 20:21:59.344674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.353416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.353435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.361928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.361947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.370574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.370593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.378944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.378962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.387912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.387930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.396399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.396418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.405475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.405494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.412114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.412132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.423093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.423113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.431563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.431582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.439818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.439842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.448686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.448704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.457103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.457122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.466037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.466066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.475385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.475405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.555 [2024-07-22 20:21:59.484012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.555 [2024-07-22 20:21:59.484030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.493069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.493092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.501756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.501774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.510540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.510559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.519110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.519129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.528052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.528071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.536585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.536603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.545193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.545211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.553942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.553961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.563386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.563405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.571990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.572008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.581351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.581369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.589715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.589733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.598538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.598557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.607547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.607570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.615916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.615933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.624200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.624218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.633105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.633123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.641893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.641912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.650969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.650987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.659887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.659905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.668741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.668760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.677503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.677521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.685870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.685888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.694908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.694926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.703439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.703458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.712646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.712664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.721050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.814 [2024-07-22 20:21:59.721067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.814 [2024-07-22 20:21:59.729794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.815 [2024-07-22 20:21:59.729812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.815 [2024-07-22 20:21:59.738455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.815 [2024-07-22 20:21:59.738472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:27.815 [2024-07-22 20:21:59.746781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:27.815 [2024-07-22 20:21:59.746799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.755122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.755140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.764169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.764187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.773133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.773154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.781577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.781596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.790239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.790258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.798956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.798975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.808251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.808270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.817558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.817576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.826699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.826717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.835445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.835463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.844387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.844406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.853363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.853382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.861918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.861936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.871535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.871554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.880146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.880164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.888901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.888920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.897341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.897359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.905793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.905811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.914077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.914095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.922539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.922557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.932059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.932094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.940804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.940827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.949203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.949222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.957557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.957576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.966565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.966584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.975161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.975179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.984023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.984041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:21:59.993098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:21:59.993116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:22:00.001698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:22:00.001716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.074 [2024-07-22 20:22:00.009997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.074 [2024-07-22 20:22:00.010016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.018930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.018949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.028594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.028614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.037230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.037249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.046233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.046252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.052964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.052981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.063833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.063852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.073074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.073093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.082929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.082948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.091794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.091813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.099516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.099534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.106310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.106328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.116953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.116972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.125598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.125615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.133573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.133591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.142614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.142632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.151505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.151523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.158478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.158496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.167474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.167493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.176296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.176314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.377 [2024-07-22 20:22:00.185625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.377 [2024-07-22 20:22:00.185643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.194753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.194772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.203781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.203799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.212251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.212269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.220602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.220619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.229090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.229108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.237786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.237804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.246259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.246277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.254720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.254738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.263546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.263564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.271000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.271018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.280059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.280077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.286686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.286704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.297655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.297673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.305113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.305131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.378 [2024-07-22 20:22:00.313709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.378 [2024-07-22 20:22:00.313727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.639 [2024-07-22 20:22:00.325493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.639 [2024-07-22 20:22:00.325511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.639 [2024-07-22 20:22:00.333621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.639 [2024-07-22 20:22:00.333639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.639 [2024-07-22 20:22:00.343858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.639 [2024-07-22 20:22:00.343876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.639 [2024-07-22 20:22:00.352295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.639 [2024-07-22 20:22:00.352313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.361077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.361096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.370054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.370073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.376612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.376630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.386890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.386908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.398033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.398056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.407939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.407958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.416831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.416849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.424860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.424878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.439615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.439634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.446346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.446365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.456497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.456516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.465399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.465418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.473608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.473626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.482624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.482642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.492180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.492198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.501235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.501252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.509578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.509596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.518972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.518991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.527621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.527639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.535716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.535735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.544184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.544203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.551408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.551426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.560993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.561012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.569720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.569741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.640 [2024-07-22 20:22:00.576452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.640 [2024-07-22 20:22:00.576471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.900 [2024-07-22 20:22:00.587439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.900 [2024-07-22 20:22:00.587458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.900 [2024-07-22 20:22:00.595878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.900 [2024-07-22 20:22:00.595897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.900 [2024-07-22 20:22:00.604651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.900 [2024-07-22 20:22:00.604671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.900 [2024-07-22 20:22:00.613535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.900 [2024-07-22 20:22:00.613553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.900 [2024-07-22 20:22:00.621886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.900 [2024-07-22 20:22:00.621904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.900 [2024-07-22 20:22:00.630772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.900 [2024-07-22 20:22:00.630792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.639770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.639789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.648660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.648678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.657474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.657492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.666555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.666574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.675945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.675964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.684545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.684564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.693561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.693579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.702091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.702110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.710982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.711001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.719633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.719653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.728863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.728881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.735653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.735671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.746343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.746361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.755059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.755078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.764258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.764277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.772770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.772793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.781251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.781271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.789741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.789760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.798839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.798859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.807559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.807577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.815975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.815993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.825375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.825394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.901 [2024-07-22 20:22:00.834091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:28.901 [2024-07-22 20:22:00.834110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.842768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.842786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.851928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.851946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.860628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.860651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.869751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.869769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.879051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.879069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.887527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.887545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.897068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.897088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.905393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.905411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.913748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.913766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.922749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.922767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.932031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.932057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.940690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.940712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.949546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.949564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.956172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.956190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.966741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.966760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.975488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.975506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.984659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.984677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:00.993013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:00.993031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.001903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.001922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.008841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.008858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.018898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.018918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.027862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.027880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.036402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.036421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.044991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.045009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.054118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.054137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.062891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.062909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.071265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.071283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.080185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.080203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.088526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.088544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.160 [2024-07-22 20:22:01.096894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.160 [2024-07-22 20:22:01.096914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.106334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.106356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.114656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.114675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.123551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.123570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.132659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.132677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.141128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.141145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.149892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.149910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.159087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.159105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.167766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.167784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.176760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.176778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.185935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.185953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.194328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.194345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.203352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.203371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.212249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.212268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.221099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.221118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.229171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.229189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.237532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.237550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.245914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.245931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.254383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.254401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.263419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.263437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.272296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.272317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.280976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.280994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.289644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.289662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.298202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.298220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.307221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.307239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.315737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.315755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.324476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.324493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.333782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.333800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.342593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.342611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.419 [2024-07-22 20:22:01.351315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.419 [2024-07-22 20:22:01.351333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.678 [2024-07-22 20:22:01.359668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.678 [2024-07-22 20:22:01.359686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.368945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.368963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.378238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.378256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.387291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.387309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.396351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.396369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.404614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.404631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.413073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.413091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.421248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.421266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.429559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.429577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.438278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.438296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.447232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.447251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.456278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.456296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.464768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.464787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.473635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.473655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.482162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.482181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.491415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.491434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.500013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.500031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.509676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.509695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.518006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.518024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.526487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.526505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.534767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.534785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.544178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.544196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.552749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.552767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.561633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.561651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.570053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.570071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.578450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.578468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.587280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.587298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.596190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.596208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.605295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.605314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.679 [2024-07-22 20:22:01.614258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.679 [2024-07-22 20:22:01.614276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.623371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.623389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.632010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.632027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.640578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.640595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.649549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.649567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.657756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.657774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.666624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.666642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.676114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.676132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.685102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.685121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.693662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.693680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.702152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.702170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.711209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.711228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.719875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.719893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.729134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.729153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.737878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.737896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.746851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.746870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.756267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.756296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.764119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.764137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.771659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.771677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.781627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.781646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.790605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.790624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.799105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.799124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.807650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.807668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.816555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.816573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.825971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.825989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 00:16:29.939 Latency(us) 00:16:29.939 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:29.939 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:29.939 Nvme1n1 : 5.01 16584.38 129.57 0.00 0.00 7711.98 2065.81 27354.16 00:16:29.939 =================================================================================================================== 00:16:29.939 Total : 16584.38 129.57 0.00 0.00 7711.98 2065.81 27354.16 00:16:29.939 [2024-07-22 20:22:01.830824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.830839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.838843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.838859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.846863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.846874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.854891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.854905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.862913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.862930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.939 [2024-07-22 20:22:01.870928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:29.939 [2024-07-22 20:22:01.870941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.878953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.878964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.886972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.886985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.894994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.895007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.903018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.903034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.911034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.911048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.919062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.919074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.927097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.927109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.935116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.935126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.943139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.943150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.951159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.951170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.959178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.959189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.967201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.967213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.975220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.975233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.983239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.983252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.991260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.991271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:01.999283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:01.999294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:02.007303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:02.007314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:02.015326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:02.015338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:02.023350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:02.023362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 [2024-07-22 20:22:02.031373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:30.198 [2024-07-22 20:22:02.031385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:30.198 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3401374) - No such process 00:16:30.198 20:22:02 -- target/zcopy.sh@49 -- # wait 3401374 00:16:30.198 20:22:02 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:30.198 20:22:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:30.198 20:22:02 -- common/autotest_common.sh@10 -- # set +x 00:16:30.198 20:22:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:30.198 20:22:02 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:30.198 20:22:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:30.198 20:22:02 -- common/autotest_common.sh@10 -- # set +x 00:16:30.198 delay0 00:16:30.198 20:22:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:30.198 20:22:02 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:30.198 20:22:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:30.198 20:22:02 -- common/autotest_common.sh@10 -- # set +x 00:16:30.198 20:22:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:30.198 20:22:02 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:30.198 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.457 [2024-07-22 20:22:02.160214] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:37.043 Initializing NVMe Controllers 00:16:37.043 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:37.043 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:37.043 Initialization complete. Launching workers. 00:16:37.043 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 89 00:16:37.043 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 376, failed to submit 33 00:16:37.044 success 156, unsuccess 220, failed 0 00:16:37.044 20:22:08 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:37.044 20:22:08 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:37.044 20:22:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:37.044 20:22:08 -- nvmf/common.sh@116 -- # sync 00:16:37.044 20:22:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:37.044 20:22:08 -- nvmf/common.sh@119 -- # set +e 00:16:37.044 20:22:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:37.044 20:22:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:37.044 rmmod nvme_tcp 00:16:37.044 rmmod nvme_fabrics 00:16:37.044 rmmod nvme_keyring 00:16:37.044 20:22:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:37.044 20:22:08 -- nvmf/common.sh@123 -- # set -e 00:16:37.044 20:22:08 -- nvmf/common.sh@124 -- # return 0 00:16:37.044 20:22:08 -- nvmf/common.sh@477 -- # '[' -n 3399437 ']' 00:16:37.044 20:22:08 -- nvmf/common.sh@478 -- # killprocess 3399437 00:16:37.044 20:22:08 -- common/autotest_common.sh@926 -- # '[' -z 3399437 ']' 00:16:37.044 20:22:08 -- common/autotest_common.sh@930 -- # kill -0 3399437 00:16:37.044 20:22:08 -- common/autotest_common.sh@931 -- # uname 00:16:37.044 20:22:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:37.044 20:22:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3399437 00:16:37.044 20:22:08 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:37.044 20:22:08 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:37.044 20:22:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3399437' 00:16:37.044 killing process with pid 3399437 00:16:37.044 20:22:08 -- common/autotest_common.sh@945 -- # kill 3399437 00:16:37.044 20:22:08 -- common/autotest_common.sh@950 -- # wait 3399437 00:16:37.044 20:22:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:37.044 20:22:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:37.044 20:22:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:37.044 20:22:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:37.044 20:22:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:37.044 20:22:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:37.044 20:22:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:37.044 20:22:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:38.992 20:22:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:38.992 00:16:38.992 real 0m31.551s 00:16:38.992 user 0m43.236s 00:16:38.992 sys 0m10.487s 00:16:38.992 20:22:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:38.992 20:22:10 -- common/autotest_common.sh@10 -- # set +x 00:16:38.992 ************************************ 00:16:38.992 END TEST nvmf_zcopy 00:16:38.992 ************************************ 00:16:38.992 20:22:10 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:38.992 20:22:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:38.992 20:22:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:38.992 20:22:10 -- common/autotest_common.sh@10 -- # set +x 00:16:38.992 ************************************ 00:16:38.992 START TEST nvmf_nmic 00:16:38.992 ************************************ 00:16:38.992 20:22:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:38.992 * Looking for test storage... 00:16:38.992 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:38.992 20:22:10 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:38.992 20:22:10 -- nvmf/common.sh@7 -- # uname -s 00:16:38.992 20:22:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:38.992 20:22:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:38.992 20:22:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:38.992 20:22:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:38.992 20:22:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:38.992 20:22:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:38.992 20:22:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:38.992 20:22:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:38.992 20:22:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:38.992 20:22:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:38.992 20:22:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:16:38.992 20:22:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:16:38.992 20:22:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:38.992 20:22:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:38.992 20:22:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:38.992 20:22:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:38.992 20:22:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:38.992 20:22:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:38.992 20:22:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:38.992 20:22:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:38.992 20:22:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:38.992 20:22:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:38.992 20:22:10 -- paths/export.sh@5 -- # export PATH 00:16:38.992 20:22:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:38.992 20:22:10 -- nvmf/common.sh@46 -- # : 0 00:16:38.992 20:22:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:38.992 20:22:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:38.992 20:22:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:38.992 20:22:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:38.992 20:22:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:38.992 20:22:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:38.992 20:22:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:38.992 20:22:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:38.992 20:22:10 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:38.992 20:22:10 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:38.992 20:22:10 -- target/nmic.sh@14 -- # nvmftestinit 00:16:38.992 20:22:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:38.992 20:22:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:38.992 20:22:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:38.992 20:22:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:38.992 20:22:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:38.992 20:22:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:38.992 20:22:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:38.992 20:22:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:38.992 20:22:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:38.992 20:22:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:38.992 20:22:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:38.992 20:22:10 -- common/autotest_common.sh@10 -- # set +x 00:16:44.274 20:22:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:44.274 20:22:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:44.274 20:22:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:44.275 20:22:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:44.275 20:22:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:44.275 20:22:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:44.275 20:22:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:44.275 20:22:15 -- nvmf/common.sh@294 -- # net_devs=() 00:16:44.275 20:22:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:44.275 20:22:15 -- nvmf/common.sh@295 -- # e810=() 00:16:44.275 20:22:15 -- nvmf/common.sh@295 -- # local -ga e810 00:16:44.275 20:22:15 -- nvmf/common.sh@296 -- # x722=() 00:16:44.275 20:22:15 -- nvmf/common.sh@296 -- # local -ga x722 00:16:44.275 20:22:15 -- nvmf/common.sh@297 -- # mlx=() 00:16:44.275 20:22:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:44.275 20:22:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:44.275 20:22:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:44.275 20:22:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:44.275 20:22:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:44.275 20:22:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:44.275 20:22:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:16:44.275 Found 0000:86:00.0 (0x8086 - 0x159b) 00:16:44.275 20:22:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:44.275 20:22:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:16:44.275 Found 0000:86:00.1 (0x8086 - 0x159b) 00:16:44.275 20:22:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:44.275 20:22:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:44.275 20:22:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:44.275 20:22:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:44.275 20:22:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:44.275 20:22:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:16:44.275 Found net devices under 0000:86:00.0: cvl_0_0 00:16:44.275 20:22:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:44.275 20:22:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:44.275 20:22:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:44.275 20:22:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:44.275 20:22:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:44.275 20:22:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:16:44.275 Found net devices under 0000:86:00.1: cvl_0_1 00:16:44.275 20:22:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:44.275 20:22:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:44.275 20:22:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:44.275 20:22:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:44.275 20:22:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:44.275 20:22:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:44.275 20:22:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:44.275 20:22:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:44.275 20:22:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:44.275 20:22:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:44.275 20:22:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:44.275 20:22:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:44.275 20:22:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:44.275 20:22:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:44.275 20:22:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:44.275 20:22:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:44.275 20:22:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:44.275 20:22:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:44.275 20:22:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:44.275 20:22:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:44.275 20:22:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:44.275 20:22:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:44.275 20:22:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:44.275 20:22:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:44.275 20:22:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:44.275 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:44.275 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:16:44.275 00:16:44.275 --- 10.0.0.2 ping statistics --- 00:16:44.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:44.275 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:16:44.275 20:22:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:44.275 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:44.275 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.268 ms 00:16:44.275 00:16:44.275 --- 10.0.0.1 ping statistics --- 00:16:44.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:44.275 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:16:44.275 20:22:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:44.275 20:22:16 -- nvmf/common.sh@410 -- # return 0 00:16:44.275 20:22:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:44.275 20:22:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:44.275 20:22:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:44.275 20:22:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:44.275 20:22:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:44.275 20:22:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:44.275 20:22:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:44.275 20:22:16 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:44.275 20:22:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:44.275 20:22:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:44.275 20:22:16 -- common/autotest_common.sh@10 -- # set +x 00:16:44.275 20:22:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:44.275 20:22:16 -- nvmf/common.sh@469 -- # nvmfpid=3406785 00:16:44.275 20:22:16 -- nvmf/common.sh@470 -- # waitforlisten 3406785 00:16:44.275 20:22:16 -- common/autotest_common.sh@819 -- # '[' -z 3406785 ']' 00:16:44.275 20:22:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:44.275 20:22:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:44.275 20:22:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:44.275 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:44.275 20:22:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:44.275 20:22:16 -- common/autotest_common.sh@10 -- # set +x 00:16:44.275 [2024-07-22 20:22:16.133101] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:16:44.275 [2024-07-22 20:22:16.133142] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:44.275 EAL: No free 2048 kB hugepages reported on node 1 00:16:44.275 [2024-07-22 20:22:16.185418] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:44.535 [2024-07-22 20:22:16.265907] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:44.535 [2024-07-22 20:22:16.266014] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:44.535 [2024-07-22 20:22:16.266022] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:44.535 [2024-07-22 20:22:16.266028] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:44.535 [2024-07-22 20:22:16.266075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:44.535 [2024-07-22 20:22:16.266165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:44.535 [2024-07-22 20:22:16.266255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:44.535 [2024-07-22 20:22:16.266256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:45.103 20:22:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:45.103 20:22:16 -- common/autotest_common.sh@852 -- # return 0 00:16:45.103 20:22:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:45.104 20:22:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:45.104 20:22:16 -- common/autotest_common.sh@10 -- # set +x 00:16:45.104 20:22:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:45.104 20:22:16 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:45.104 20:22:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.104 20:22:16 -- common/autotest_common.sh@10 -- # set +x 00:16:45.104 [2024-07-22 20:22:16.997382] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:45.104 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.104 20:22:17 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:45.104 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.104 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:16:45.104 Malloc0 00:16:45.104 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.104 20:22:17 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:45.104 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.104 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:16:45.104 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.104 20:22:17 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:45.104 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.104 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:16:45.363 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.363 20:22:17 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:45.363 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.363 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:16:45.363 [2024-07-22 20:22:17.048919] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:45.363 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.363 20:22:17 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:45.363 test case1: single bdev can't be used in multiple subsystems 00:16:45.363 20:22:17 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:45.363 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.363 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:16:45.363 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.363 20:22:17 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:45.363 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.363 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:16:45.363 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.363 20:22:17 -- target/nmic.sh@28 -- # nmic_status=0 00:16:45.363 20:22:17 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:45.363 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.363 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:16:45.363 [2024-07-22 20:22:17.076854] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:45.363 [2024-07-22 20:22:17.076871] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:45.363 [2024-07-22 20:22:17.076878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:45.363 request: 00:16:45.363 { 00:16:45.363 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:45.363 "namespace": { 00:16:45.363 "bdev_name": "Malloc0" 00:16:45.363 }, 00:16:45.363 "method": "nvmf_subsystem_add_ns", 00:16:45.363 "req_id": 1 00:16:45.363 } 00:16:45.363 Got JSON-RPC error response 00:16:45.363 response: 00:16:45.363 { 00:16:45.363 "code": -32602, 00:16:45.363 "message": "Invalid parameters" 00:16:45.363 } 00:16:45.363 20:22:17 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:16:45.363 20:22:17 -- target/nmic.sh@29 -- # nmic_status=1 00:16:45.363 20:22:17 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:45.363 20:22:17 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:45.363 Adding namespace failed - expected result. 00:16:45.363 20:22:17 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:45.363 test case2: host connect to nvmf target in multiple paths 00:16:45.363 20:22:17 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:45.363 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.363 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:16:45.363 [2024-07-22 20:22:17.088970] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:45.363 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.363 20:22:17 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:46.300 20:22:18 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:47.678 20:22:19 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:47.678 20:22:19 -- common/autotest_common.sh@1177 -- # local i=0 00:16:47.678 20:22:19 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:16:47.678 20:22:19 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:16:47.678 20:22:19 -- common/autotest_common.sh@1184 -- # sleep 2 00:16:49.582 20:22:21 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:16:49.582 20:22:21 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:16:49.582 20:22:21 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:16:49.582 20:22:21 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:16:49.582 20:22:21 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:16:49.582 20:22:21 -- common/autotest_common.sh@1187 -- # return 0 00:16:49.582 20:22:21 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:49.582 [global] 00:16:49.582 thread=1 00:16:49.582 invalidate=1 00:16:49.582 rw=write 00:16:49.582 time_based=1 00:16:49.582 runtime=1 00:16:49.582 ioengine=libaio 00:16:49.582 direct=1 00:16:49.582 bs=4096 00:16:49.582 iodepth=1 00:16:49.582 norandommap=0 00:16:49.582 numjobs=1 00:16:49.582 00:16:49.582 verify_dump=1 00:16:49.582 verify_backlog=512 00:16:49.582 verify_state_save=0 00:16:49.582 do_verify=1 00:16:49.582 verify=crc32c-intel 00:16:49.582 [job0] 00:16:49.582 filename=/dev/nvme0n1 00:16:49.582 Could not set queue depth (nvme0n1) 00:16:49.841 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.841 fio-3.35 00:16:49.841 Starting 1 thread 00:16:51.263 00:16:51.263 job0: (groupid=0, jobs=1): err= 0: pid=3407832: Mon Jul 22 20:22:22 2024 00:16:51.263 read: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec) 00:16:51.263 slat (nsec): min=7124, max=39308, avg=8180.24, stdev=1622.14 00:16:51.263 clat (usec): min=291, max=42320, avg=605.95, stdev=2232.60 00:16:51.263 lat (usec): min=299, max=42331, avg=614.13, stdev=2233.24 00:16:51.263 clat percentiles (usec): 00:16:51.263 | 1.00th=[ 318], 5.00th=[ 371], 10.00th=[ 441], 20.00th=[ 478], 00:16:51.263 | 30.00th=[ 486], 40.00th=[ 490], 50.00th=[ 494], 60.00th=[ 494], 00:16:51.263 | 70.00th=[ 498], 80.00th=[ 502], 90.00th=[ 519], 95.00th=[ 553], 00:16:51.263 | 99.00th=[ 578], 99.50th=[ 586], 99.90th=[41681], 99.95th=[42206], 00:16:51.263 | 99.99th=[42206] 00:16:51.263 write: IOPS=1270, BW=5083KiB/s (5205kB/s)(5088KiB/1001msec); 0 zone resets 00:16:51.263 slat (usec): min=10, max=24605, avg=31.37, stdev=689.58 00:16:51.263 clat (usec): min=188, max=663, avg=254.75, stdev=64.44 00:16:51.263 lat (usec): min=203, max=25269, avg=286.11, stdev=703.95 00:16:51.263 clat percentiles (usec): 00:16:51.263 | 1.00th=[ 200], 5.00th=[ 204], 10.00th=[ 206], 20.00th=[ 210], 00:16:51.263 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 225], 60.00th=[ 241], 00:16:51.263 | 70.00th=[ 269], 80.00th=[ 289], 90.00th=[ 359], 95.00th=[ 416], 00:16:51.263 | 99.00th=[ 437], 99.50th=[ 449], 99.90th=[ 652], 99.95th=[ 660], 00:16:51.263 | 99.99th=[ 660] 00:16:51.263 bw ( KiB/s): min= 4096, max= 4096, per=80.58%, avg=4096.00, stdev= 0.00, samples=1 00:16:51.263 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:51.263 lat (usec) : 250=35.41%, 500=52.74%, 750=11.72% 00:16:51.263 lat (msec) : 50=0.13% 00:16:51.263 cpu : usr=1.90%, sys=3.90%, ctx=2299, majf=0, minf=2 00:16:51.263 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:51.263 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:51.263 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:51.263 issued rwts: total=1024,1272,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:51.263 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:51.263 00:16:51.263 Run status group 0 (all jobs): 00:16:51.263 READ: bw=4092KiB/s (4190kB/s), 4092KiB/s-4092KiB/s (4190kB/s-4190kB/s), io=4096KiB (4194kB), run=1001-1001msec 00:16:51.263 WRITE: bw=5083KiB/s (5205kB/s), 5083KiB/s-5083KiB/s (5205kB/s-5205kB/s), io=5088KiB (5210kB), run=1001-1001msec 00:16:51.263 00:16:51.263 Disk stats (read/write): 00:16:51.263 nvme0n1: ios=981/1024, merge=0/0, ticks=1575/257, in_queue=1832, util=98.40% 00:16:51.263 20:22:22 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:51.263 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:51.263 20:22:22 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:51.263 20:22:22 -- common/autotest_common.sh@1198 -- # local i=0 00:16:51.263 20:22:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:16:51.263 20:22:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:51.263 20:22:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:16:51.263 20:22:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:51.263 20:22:22 -- common/autotest_common.sh@1210 -- # return 0 00:16:51.263 20:22:22 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:51.263 20:22:22 -- target/nmic.sh@53 -- # nvmftestfini 00:16:51.263 20:22:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:51.263 20:22:22 -- nvmf/common.sh@116 -- # sync 00:16:51.263 20:22:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:51.263 20:22:22 -- nvmf/common.sh@119 -- # set +e 00:16:51.263 20:22:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:51.263 20:22:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:51.263 rmmod nvme_tcp 00:16:51.263 rmmod nvme_fabrics 00:16:51.263 rmmod nvme_keyring 00:16:51.263 20:22:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:51.263 20:22:23 -- nvmf/common.sh@123 -- # set -e 00:16:51.263 20:22:23 -- nvmf/common.sh@124 -- # return 0 00:16:51.263 20:22:23 -- nvmf/common.sh@477 -- # '[' -n 3406785 ']' 00:16:51.263 20:22:23 -- nvmf/common.sh@478 -- # killprocess 3406785 00:16:51.263 20:22:23 -- common/autotest_common.sh@926 -- # '[' -z 3406785 ']' 00:16:51.263 20:22:23 -- common/autotest_common.sh@930 -- # kill -0 3406785 00:16:51.263 20:22:23 -- common/autotest_common.sh@931 -- # uname 00:16:51.263 20:22:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:51.263 20:22:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3406785 00:16:51.263 20:22:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:51.263 20:22:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:51.263 20:22:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3406785' 00:16:51.263 killing process with pid 3406785 00:16:51.263 20:22:23 -- common/autotest_common.sh@945 -- # kill 3406785 00:16:51.263 20:22:23 -- common/autotest_common.sh@950 -- # wait 3406785 00:16:51.522 20:22:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:51.522 20:22:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:51.522 20:22:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:51.522 20:22:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:51.522 20:22:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:51.522 20:22:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:51.522 20:22:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:51.522 20:22:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:54.059 20:22:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:54.059 00:16:54.059 real 0m14.574s 00:16:54.059 user 0m35.346s 00:16:54.059 sys 0m4.533s 00:16:54.059 20:22:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:54.059 20:22:25 -- common/autotest_common.sh@10 -- # set +x 00:16:54.059 ************************************ 00:16:54.059 END TEST nvmf_nmic 00:16:54.059 ************************************ 00:16:54.059 20:22:25 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:54.059 20:22:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:54.059 20:22:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:54.059 20:22:25 -- common/autotest_common.sh@10 -- # set +x 00:16:54.059 ************************************ 00:16:54.059 START TEST nvmf_fio_target 00:16:54.059 ************************************ 00:16:54.059 20:22:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:54.059 * Looking for test storage... 00:16:54.059 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:54.059 20:22:25 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:54.059 20:22:25 -- nvmf/common.sh@7 -- # uname -s 00:16:54.059 20:22:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:54.059 20:22:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:54.059 20:22:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:54.059 20:22:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:54.059 20:22:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:54.059 20:22:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:54.059 20:22:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:54.059 20:22:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:54.059 20:22:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:54.059 20:22:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:54.059 20:22:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:16:54.059 20:22:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:16:54.059 20:22:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:54.059 20:22:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:54.059 20:22:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:54.059 20:22:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:54.059 20:22:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:54.059 20:22:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:54.059 20:22:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:54.059 20:22:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:54.059 20:22:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:54.059 20:22:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:54.059 20:22:25 -- paths/export.sh@5 -- # export PATH 00:16:54.059 20:22:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:54.059 20:22:25 -- nvmf/common.sh@46 -- # : 0 00:16:54.059 20:22:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:54.059 20:22:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:54.059 20:22:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:54.059 20:22:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:54.059 20:22:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:54.059 20:22:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:54.059 20:22:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:54.059 20:22:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:54.059 20:22:25 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:54.059 20:22:25 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:54.059 20:22:25 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:54.059 20:22:25 -- target/fio.sh@16 -- # nvmftestinit 00:16:54.059 20:22:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:54.059 20:22:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:54.059 20:22:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:54.059 20:22:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:54.059 20:22:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:54.059 20:22:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:54.059 20:22:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:54.059 20:22:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:54.059 20:22:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:54.059 20:22:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:54.059 20:22:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:54.059 20:22:25 -- common/autotest_common.sh@10 -- # set +x 00:16:59.325 20:22:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:59.325 20:22:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:59.325 20:22:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:59.325 20:22:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:59.325 20:22:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:59.325 20:22:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:59.325 20:22:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:59.325 20:22:30 -- nvmf/common.sh@294 -- # net_devs=() 00:16:59.325 20:22:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:59.325 20:22:30 -- nvmf/common.sh@295 -- # e810=() 00:16:59.325 20:22:30 -- nvmf/common.sh@295 -- # local -ga e810 00:16:59.325 20:22:30 -- nvmf/common.sh@296 -- # x722=() 00:16:59.325 20:22:30 -- nvmf/common.sh@296 -- # local -ga x722 00:16:59.325 20:22:30 -- nvmf/common.sh@297 -- # mlx=() 00:16:59.325 20:22:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:59.325 20:22:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:59.325 20:22:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:59.325 20:22:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:59.325 20:22:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:59.325 20:22:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:59.325 20:22:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:16:59.325 Found 0000:86:00.0 (0x8086 - 0x159b) 00:16:59.325 20:22:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:59.325 20:22:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:16:59.325 Found 0000:86:00.1 (0x8086 - 0x159b) 00:16:59.325 20:22:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:59.325 20:22:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:59.325 20:22:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:59.325 20:22:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:59.325 20:22:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:59.325 20:22:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:16:59.325 Found net devices under 0000:86:00.0: cvl_0_0 00:16:59.325 20:22:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:59.325 20:22:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:59.325 20:22:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:59.325 20:22:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:59.325 20:22:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:59.325 20:22:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:16:59.325 Found net devices under 0000:86:00.1: cvl_0_1 00:16:59.325 20:22:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:59.325 20:22:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:59.325 20:22:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:59.325 20:22:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:59.325 20:22:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:59.325 20:22:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:59.325 20:22:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:59.325 20:22:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:59.325 20:22:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:59.325 20:22:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:59.325 20:22:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:59.325 20:22:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:59.325 20:22:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:59.325 20:22:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:59.325 20:22:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:59.325 20:22:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:59.325 20:22:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:59.325 20:22:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:59.325 20:22:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:59.325 20:22:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:59.325 20:22:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:59.325 20:22:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:59.325 20:22:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:59.325 20:22:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:59.325 20:22:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:59.325 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:59.325 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:16:59.325 00:16:59.325 --- 10.0.0.2 ping statistics --- 00:16:59.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:59.325 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:16:59.325 20:22:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:59.325 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:59.325 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.308 ms 00:16:59.325 00:16:59.325 --- 10.0.0.1 ping statistics --- 00:16:59.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:59.325 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:16:59.325 20:22:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:59.325 20:22:30 -- nvmf/common.sh@410 -- # return 0 00:16:59.325 20:22:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:59.326 20:22:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:59.326 20:22:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:59.326 20:22:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:59.326 20:22:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:59.326 20:22:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:59.326 20:22:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:59.326 20:22:30 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:59.326 20:22:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:59.326 20:22:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:59.326 20:22:30 -- common/autotest_common.sh@10 -- # set +x 00:16:59.326 20:22:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:59.326 20:22:30 -- nvmf/common.sh@469 -- # nvmfpid=3411591 00:16:59.326 20:22:30 -- nvmf/common.sh@470 -- # waitforlisten 3411591 00:16:59.326 20:22:30 -- common/autotest_common.sh@819 -- # '[' -z 3411591 ']' 00:16:59.326 20:22:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:59.326 20:22:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:59.326 20:22:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:59.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:59.326 20:22:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:59.326 20:22:30 -- common/autotest_common.sh@10 -- # set +x 00:16:59.326 [2024-07-22 20:22:30.698510] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:16:59.326 [2024-07-22 20:22:30.698552] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:59.326 EAL: No free 2048 kB hugepages reported on node 1 00:16:59.326 [2024-07-22 20:22:30.755598] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:59.326 [2024-07-22 20:22:30.832988] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:59.326 [2024-07-22 20:22:30.833099] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:59.326 [2024-07-22 20:22:30.833107] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:59.326 [2024-07-22 20:22:30.833113] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:59.326 [2024-07-22 20:22:30.833145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:59.326 [2024-07-22 20:22:30.833239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:59.326 [2024-07-22 20:22:30.833262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:59.326 [2024-07-22 20:22:30.833263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:59.583 20:22:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:59.583 20:22:31 -- common/autotest_common.sh@852 -- # return 0 00:16:59.583 20:22:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:59.583 20:22:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:59.583 20:22:31 -- common/autotest_common.sh@10 -- # set +x 00:16:59.839 20:22:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:59.839 20:22:31 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:59.839 [2024-07-22 20:22:31.691829] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:59.840 20:22:31 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:00.097 20:22:31 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:17:00.097 20:22:31 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:00.355 20:22:32 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:17:00.355 20:22:32 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:00.614 20:22:32 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:17:00.614 20:22:32 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:00.614 20:22:32 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:17:00.614 20:22:32 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:17:00.872 20:22:32 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:01.130 20:22:32 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:17:01.130 20:22:32 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:01.130 20:22:33 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:17:01.130 20:22:33 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:01.388 20:22:33 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:17:01.388 20:22:33 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:17:01.646 20:22:33 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:17:01.906 20:22:33 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:17:01.906 20:22:33 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:01.906 20:22:33 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:17:01.906 20:22:33 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:17:02.196 20:22:33 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:02.196 [2024-07-22 20:22:34.105573] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:02.196 20:22:34 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:17:02.453 20:22:34 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:17:02.711 20:22:34 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:17:03.654 20:22:35 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:17:03.654 20:22:35 -- common/autotest_common.sh@1177 -- # local i=0 00:17:03.654 20:22:35 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:17:03.654 20:22:35 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:17:03.654 20:22:35 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:17:03.654 20:22:35 -- common/autotest_common.sh@1184 -- # sleep 2 00:17:06.232 20:22:37 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:17:06.232 20:22:37 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:17:06.232 20:22:37 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:17:06.232 20:22:37 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:17:06.232 20:22:37 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:17:06.232 20:22:37 -- common/autotest_common.sh@1187 -- # return 0 00:17:06.232 20:22:37 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:17:06.232 [global] 00:17:06.232 thread=1 00:17:06.232 invalidate=1 00:17:06.232 rw=write 00:17:06.232 time_based=1 00:17:06.232 runtime=1 00:17:06.232 ioengine=libaio 00:17:06.232 direct=1 00:17:06.232 bs=4096 00:17:06.232 iodepth=1 00:17:06.232 norandommap=0 00:17:06.232 numjobs=1 00:17:06.232 00:17:06.232 verify_dump=1 00:17:06.232 verify_backlog=512 00:17:06.232 verify_state_save=0 00:17:06.232 do_verify=1 00:17:06.232 verify=crc32c-intel 00:17:06.232 [job0] 00:17:06.232 filename=/dev/nvme0n1 00:17:06.232 [job1] 00:17:06.232 filename=/dev/nvme0n2 00:17:06.232 [job2] 00:17:06.232 filename=/dev/nvme0n3 00:17:06.232 [job3] 00:17:06.232 filename=/dev/nvme0n4 00:17:06.232 Could not set queue depth (nvme0n1) 00:17:06.232 Could not set queue depth (nvme0n2) 00:17:06.232 Could not set queue depth (nvme0n3) 00:17:06.232 Could not set queue depth (nvme0n4) 00:17:06.232 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:06.232 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:06.232 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:06.232 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:06.232 fio-3.35 00:17:06.232 Starting 4 threads 00:17:07.606 00:17:07.606 job0: (groupid=0, jobs=1): err= 0: pid=3412963: Mon Jul 22 20:22:39 2024 00:17:07.606 read: IOPS=1122, BW=4492KiB/s (4599kB/s)(4496KiB/1001msec) 00:17:07.606 slat (nsec): min=7310, max=37542, avg=8444.03, stdev=1661.28 00:17:07.606 clat (usec): min=355, max=1106, avg=503.85, stdev=78.93 00:17:07.606 lat (usec): min=363, max=1114, avg=512.29, stdev=79.03 00:17:07.606 clat percentiles (usec): 00:17:07.606 | 1.00th=[ 371], 5.00th=[ 429], 10.00th=[ 445], 20.00th=[ 457], 00:17:07.606 | 30.00th=[ 465], 40.00th=[ 474], 50.00th=[ 482], 60.00th=[ 494], 00:17:07.606 | 70.00th=[ 506], 80.00th=[ 529], 90.00th=[ 619], 95.00th=[ 709], 00:17:07.606 | 99.00th=[ 742], 99.50th=[ 775], 99.90th=[ 1074], 99.95th=[ 1106], 00:17:07.606 | 99.99th=[ 1106] 00:17:07.606 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:17:07.606 slat (usec): min=10, max=31865, avg=35.57, stdev=816.37 00:17:07.606 clat (usec): min=183, max=948, avg=235.52, stdev=63.97 00:17:07.606 lat (usec): min=196, max=32704, avg=271.10, stdev=834.28 00:17:07.606 clat percentiles (usec): 00:17:07.606 | 1.00th=[ 190], 5.00th=[ 192], 10.00th=[ 194], 20.00th=[ 198], 00:17:07.606 | 30.00th=[ 200], 40.00th=[ 206], 50.00th=[ 219], 60.00th=[ 231], 00:17:07.606 | 70.00th=[ 241], 80.00th=[ 258], 90.00th=[ 297], 95.00th=[ 326], 00:17:07.606 | 99.00th=[ 437], 99.50th=[ 635], 99.90th=[ 840], 99.95th=[ 947], 00:17:07.606 | 99.99th=[ 947] 00:17:07.606 bw ( KiB/s): min= 5656, max= 5656, per=47.73%, avg=5656.00, stdev= 0.00, samples=1 00:17:07.606 iops : min= 1414, max= 1414, avg=1414.00, stdev= 0.00, samples=1 00:17:07.606 lat (usec) : 250=44.25%, 500=41.32%, 750=13.91%, 1000=0.45% 00:17:07.606 lat (msec) : 2=0.08% 00:17:07.606 cpu : usr=2.80%, sys=3.90%, ctx=2664, majf=0, minf=1 00:17:07.606 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:07.606 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.606 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.606 issued rwts: total=1124,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:07.606 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:07.606 job1: (groupid=0, jobs=1): err= 0: pid=3412964: Mon Jul 22 20:22:39 2024 00:17:07.606 read: IOPS=136, BW=547KiB/s (560kB/s)(552KiB/1009msec) 00:17:07.606 slat (nsec): min=6383, max=24500, avg=9058.41, stdev=5312.17 00:17:07.606 clat (usec): min=321, max=42018, avg=5773.50, stdev=13953.41 00:17:07.606 lat (usec): min=328, max=42042, avg=5782.56, stdev=13958.40 00:17:07.606 clat percentiles (usec): 00:17:07.606 | 1.00th=[ 326], 5.00th=[ 330], 10.00th=[ 334], 20.00th=[ 343], 00:17:07.606 | 30.00th=[ 359], 40.00th=[ 371], 50.00th=[ 383], 60.00th=[ 392], 00:17:07.606 | 70.00th=[ 416], 80.00th=[ 465], 90.00th=[41157], 95.00th=[42206], 00:17:07.606 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:07.606 | 99.99th=[42206] 00:17:07.606 write: IOPS=507, BW=2030KiB/s (2078kB/s)(2048KiB/1009msec); 0 zone resets 00:17:07.606 slat (nsec): min=9497, max=40245, avg=12228.93, stdev=3000.78 00:17:07.606 clat (usec): min=228, max=4014, avg=395.92, stdev=192.73 00:17:07.606 lat (usec): min=237, max=4027, avg=408.15, stdev=193.11 00:17:07.606 clat percentiles (usec): 00:17:07.606 | 1.00th=[ 247], 5.00th=[ 265], 10.00th=[ 277], 20.00th=[ 297], 00:17:07.606 | 30.00th=[ 322], 40.00th=[ 351], 50.00th=[ 379], 60.00th=[ 404], 00:17:07.606 | 70.00th=[ 429], 80.00th=[ 453], 90.00th=[ 515], 95.00th=[ 545], 00:17:07.606 | 99.00th=[ 799], 99.50th=[ 963], 99.90th=[ 4015], 99.95th=[ 4015], 00:17:07.606 | 99.99th=[ 4015] 00:17:07.606 bw ( KiB/s): min= 4096, max= 4096, per=34.57%, avg=4096.00, stdev= 0.00, samples=1 00:17:07.606 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:07.606 lat (usec) : 250=0.92%, 500=86.15%, 750=8.92%, 1000=0.92% 00:17:07.606 lat (msec) : 2=0.15%, 10=0.15%, 50=2.77% 00:17:07.606 cpu : usr=0.60%, sys=0.69%, ctx=651, majf=0, minf=1 00:17:07.606 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:07.606 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.606 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.606 issued rwts: total=138,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:07.606 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:07.606 job2: (groupid=0, jobs=1): err= 0: pid=3412965: Mon Jul 22 20:22:39 2024 00:17:07.606 read: IOPS=19, BW=79.0KiB/s (80.9kB/s)(80.0KiB/1013msec) 00:17:07.606 slat (nsec): min=11120, max=34090, avg=23299.15, stdev=3808.72 00:17:07.606 clat (usec): min=40853, max=42011, avg=41335.02, stdev=465.02 00:17:07.606 lat (usec): min=40878, max=42034, avg=41358.31, stdev=464.64 00:17:07.606 clat percentiles (usec): 00:17:07.606 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:17:07.606 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:07.606 | 70.00th=[41681], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:17:07.606 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:07.606 | 99.99th=[42206] 00:17:07.606 write: IOPS=505, BW=2022KiB/s (2070kB/s)(2048KiB/1013msec); 0 zone resets 00:17:07.606 slat (usec): min=11, max=2319, avg=18.72, stdev=104.00 00:17:07.606 clat (usec): min=193, max=976, avg=340.52, stdev=97.88 00:17:07.606 lat (usec): min=205, max=2757, avg=359.24, stdev=146.51 00:17:07.606 clat percentiles (usec): 00:17:07.606 | 1.00th=[ 206], 5.00th=[ 219], 10.00th=[ 231], 20.00th=[ 253], 00:17:07.606 | 30.00th=[ 277], 40.00th=[ 297], 50.00th=[ 326], 60.00th=[ 359], 00:17:07.606 | 70.00th=[ 383], 80.00th=[ 404], 90.00th=[ 478], 95.00th=[ 529], 00:17:07.606 | 99.00th=[ 619], 99.50th=[ 685], 99.90th=[ 979], 99.95th=[ 979], 00:17:07.606 | 99.99th=[ 979] 00:17:07.606 bw ( KiB/s): min= 4096, max= 4096, per=34.57%, avg=4096.00, stdev= 0.00, samples=1 00:17:07.606 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:07.606 lat (usec) : 250=18.23%, 500=71.24%, 750=6.58%, 1000=0.19% 00:17:07.606 lat (msec) : 50=3.76% 00:17:07.606 cpu : usr=0.89%, sys=0.49%, ctx=535, majf=0, minf=1 00:17:07.606 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:07.606 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.606 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.606 issued rwts: total=20,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:07.606 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:07.606 job3: (groupid=0, jobs=1): err= 0: pid=3412966: Mon Jul 22 20:22:39 2024 00:17:07.606 read: IOPS=21, BW=84.9KiB/s (86.9kB/s)(88.0KiB/1037msec) 00:17:07.606 slat (nsec): min=8892, max=26030, avg=21851.55, stdev=4189.22 00:17:07.606 clat (usec): min=548, max=42989, avg=38166.50, stdev=12168.20 00:17:07.606 lat (usec): min=557, max=43012, avg=38188.35, stdev=12169.66 00:17:07.606 clat percentiles (usec): 00:17:07.606 | 1.00th=[ 545], 5.00th=[ 668], 10.00th=[41157], 20.00th=[41157], 00:17:07.606 | 30.00th=[41681], 40.00th=[41681], 50.00th=[41681], 60.00th=[42206], 00:17:07.606 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42730], 95.00th=[42730], 00:17:07.606 | 99.00th=[42730], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:17:07.606 | 99.99th=[42730] 00:17:07.606 write: IOPS=493, BW=1975KiB/s (2022kB/s)(2048KiB/1037msec); 0 zone resets 00:17:07.606 slat (usec): min=6, max=32629, avg=83.78, stdev=1450.66 00:17:07.606 clat (usec): min=265, max=705, avg=298.15, stdev=43.12 00:17:07.606 lat (usec): min=278, max=33335, avg=381.93, stdev=1469.65 00:17:07.606 clat percentiles (usec): 00:17:07.606 | 1.00th=[ 269], 5.00th=[ 273], 10.00th=[ 273], 20.00th=[ 273], 00:17:07.606 | 30.00th=[ 277], 40.00th=[ 277], 50.00th=[ 281], 60.00th=[ 285], 00:17:07.606 | 70.00th=[ 289], 80.00th=[ 306], 90.00th=[ 359], 95.00th=[ 412], 00:17:07.606 | 99.00th=[ 429], 99.50th=[ 433], 99.90th=[ 709], 99.95th=[ 709], 00:17:07.606 | 99.99th=[ 709] 00:17:07.606 bw ( KiB/s): min= 4096, max= 4096, per=34.57%, avg=4096.00, stdev= 0.00, samples=1 00:17:07.606 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:07.607 lat (usec) : 500=95.69%, 750=0.56% 00:17:07.607 lat (msec) : 50=3.75% 00:17:07.607 cpu : usr=0.00%, sys=0.77%, ctx=539, majf=0, minf=2 00:17:07.607 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:07.607 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.607 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:07.607 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:07.607 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:07.607 00:17:07.607 Run status group 0 (all jobs): 00:17:07.607 READ: bw=5030KiB/s (5151kB/s), 79.0KiB/s-4492KiB/s (80.9kB/s-4599kB/s), io=5216KiB (5341kB), run=1001-1037msec 00:17:07.607 WRITE: bw=11.6MiB/s (12.1MB/s), 1975KiB/s-6138KiB/s (2022kB/s-6285kB/s), io=12.0MiB (12.6MB), run=1001-1037msec 00:17:07.607 00:17:07.607 Disk stats (read/write): 00:17:07.607 nvme0n1: ios=1083/1138, merge=0/0, ticks=688/263, in_queue=951, util=86.17% 00:17:07.607 nvme0n2: ios=157/512, merge=0/0, ticks=1505/190, in_queue=1695, util=89.94% 00:17:07.607 nvme0n3: ios=69/512, merge=0/0, ticks=759/172, in_queue=931, util=94.69% 00:17:07.607 nvme0n4: ios=80/512, merge=0/0, ticks=795/156, in_queue=951, util=95.39% 00:17:07.607 20:22:39 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:17:07.607 [global] 00:17:07.607 thread=1 00:17:07.607 invalidate=1 00:17:07.607 rw=randwrite 00:17:07.607 time_based=1 00:17:07.607 runtime=1 00:17:07.607 ioengine=libaio 00:17:07.607 direct=1 00:17:07.607 bs=4096 00:17:07.607 iodepth=1 00:17:07.607 norandommap=0 00:17:07.607 numjobs=1 00:17:07.607 00:17:07.607 verify_dump=1 00:17:07.607 verify_backlog=512 00:17:07.607 verify_state_save=0 00:17:07.607 do_verify=1 00:17:07.607 verify=crc32c-intel 00:17:07.607 [job0] 00:17:07.607 filename=/dev/nvme0n1 00:17:07.607 [job1] 00:17:07.607 filename=/dev/nvme0n2 00:17:07.607 [job2] 00:17:07.607 filename=/dev/nvme0n3 00:17:07.607 [job3] 00:17:07.607 filename=/dev/nvme0n4 00:17:07.607 Could not set queue depth (nvme0n1) 00:17:07.607 Could not set queue depth (nvme0n2) 00:17:07.607 Could not set queue depth (nvme0n3) 00:17:07.607 Could not set queue depth (nvme0n4) 00:17:07.607 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:07.607 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:07.607 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:07.607 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:07.607 fio-3.35 00:17:07.607 Starting 4 threads 00:17:08.981 00:17:08.981 job0: (groupid=0, jobs=1): err= 0: pid=3413342: Mon Jul 22 20:22:40 2024 00:17:08.981 read: IOPS=22, BW=90.1KiB/s (92.3kB/s)(92.0KiB/1021msec) 00:17:08.981 slat (nsec): min=8281, max=24812, avg=19809.13, stdev=5301.06 00:17:08.981 clat (usec): min=428, max=42055, avg=37962.87, stdev=11847.30 00:17:08.981 lat (usec): min=438, max=42079, avg=37982.68, stdev=11850.49 00:17:08.981 clat percentiles (usec): 00:17:08.981 | 1.00th=[ 429], 5.00th=[ 465], 10.00th=[40633], 20.00th=[41157], 00:17:08.981 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41681], 60.00th=[41681], 00:17:08.981 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:17:08.981 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:08.981 | 99.99th=[42206] 00:17:08.981 write: IOPS=501, BW=2006KiB/s (2054kB/s)(2048KiB/1021msec); 0 zone resets 00:17:08.981 slat (nsec): min=5998, max=30569, avg=9229.29, stdev=2806.92 00:17:08.981 clat (usec): min=156, max=924, avg=275.19, stdev=93.20 00:17:08.981 lat (usec): min=162, max=934, avg=284.42, stdev=94.91 00:17:08.981 clat percentiles (usec): 00:17:08.981 | 1.00th=[ 169], 5.00th=[ 178], 10.00th=[ 186], 20.00th=[ 204], 00:17:08.981 | 30.00th=[ 223], 40.00th=[ 235], 50.00th=[ 251], 60.00th=[ 277], 00:17:08.981 | 70.00th=[ 302], 80.00th=[ 334], 90.00th=[ 412], 95.00th=[ 429], 00:17:08.981 | 99.00th=[ 709], 99.50th=[ 725], 99.90th=[ 922], 99.95th=[ 922], 00:17:08.981 | 99.99th=[ 922] 00:17:08.981 bw ( KiB/s): min= 4096, max= 4096, per=41.56%, avg=4096.00, stdev= 0.00, samples=1 00:17:08.981 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:08.981 lat (usec) : 250=47.10%, 500=46.92%, 750=1.87%, 1000=0.19% 00:17:08.981 lat (msec) : 50=3.93% 00:17:08.981 cpu : usr=0.39%, sys=0.49%, ctx=537, majf=0, minf=1 00:17:08.981 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:08.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:08.981 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:08.981 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:08.981 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:08.981 job1: (groupid=0, jobs=1): err= 0: pid=3413343: Mon Jul 22 20:22:40 2024 00:17:08.981 read: IOPS=515, BW=2063KiB/s (2113kB/s)(2092KiB/1014msec) 00:17:08.981 slat (nsec): min=3856, max=38774, avg=9004.79, stdev=3679.59 00:17:08.981 clat (usec): min=387, max=42900, avg=1335.38, stdev=5688.33 00:17:08.981 lat (usec): min=395, max=42923, avg=1344.39, stdev=5690.08 00:17:08.981 clat percentiles (usec): 00:17:08.981 | 1.00th=[ 412], 5.00th=[ 424], 10.00th=[ 449], 20.00th=[ 494], 00:17:08.981 | 30.00th=[ 506], 40.00th=[ 515], 50.00th=[ 529], 60.00th=[ 537], 00:17:08.981 | 70.00th=[ 545], 80.00th=[ 562], 90.00th=[ 644], 95.00th=[ 742], 00:17:08.981 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:17:08.981 | 99.99th=[42730] 00:17:08.981 write: IOPS=1009, BW=4039KiB/s (4136kB/s)(4096KiB/1014msec); 0 zone resets 00:17:08.981 slat (nsec): min=7623, max=37702, avg=10433.38, stdev=2296.53 00:17:08.981 clat (usec): min=185, max=720, avg=285.28, stdev=87.48 00:17:08.981 lat (usec): min=197, max=730, avg=295.71, stdev=87.94 00:17:08.981 clat percentiles (usec): 00:17:08.981 | 1.00th=[ 190], 5.00th=[ 198], 10.00th=[ 206], 20.00th=[ 221], 00:17:08.981 | 30.00th=[ 233], 40.00th=[ 243], 50.00th=[ 255], 60.00th=[ 281], 00:17:08.981 | 70.00th=[ 297], 80.00th=[ 334], 90.00th=[ 416], 95.00th=[ 445], 00:17:08.981 | 99.00th=[ 652], 99.50th=[ 701], 99.90th=[ 709], 99.95th=[ 725], 00:17:08.981 | 99.99th=[ 725] 00:17:08.981 bw ( KiB/s): min= 2664, max= 5528, per=41.56%, avg=4096.00, stdev=2025.15, samples=2 00:17:08.981 iops : min= 666, max= 1382, avg=1024.00, stdev=506.29, samples=2 00:17:08.981 lat (usec) : 250=30.51%, 500=42.28%, 750=25.53%, 1000=0.71% 00:17:08.981 lat (msec) : 2=0.26%, 4=0.06%, 50=0.65% 00:17:08.981 cpu : usr=1.28%, sys=0.99%, ctx=1549, majf=0, minf=1 00:17:08.981 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:08.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:08.981 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:08.981 issued rwts: total=523,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:08.981 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:08.981 job2: (groupid=0, jobs=1): err= 0: pid=3413344: Mon Jul 22 20:22:40 2024 00:17:08.981 read: IOPS=20, BW=80.8KiB/s (82.8kB/s)(84.0KiB/1039msec) 00:17:08.981 slat (nsec): min=9019, max=24482, avg=22926.38, stdev=3216.57 00:17:08.981 clat (usec): min=40981, max=42985, avg=41907.37, stdev=367.72 00:17:08.981 lat (usec): min=41005, max=43009, avg=41930.29, stdev=368.28 00:17:08.981 clat percentiles (usec): 00:17:08.981 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41681], 20.00th=[41681], 00:17:08.981 | 30.00th=[41681], 40.00th=[41681], 50.00th=[41681], 60.00th=[42206], 00:17:08.981 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:17:08.981 | 99.00th=[42730], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:17:08.981 | 99.99th=[42730] 00:17:08.981 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:17:08.981 slat (usec): min=4, max=232, avg=11.88, stdev=13.80 00:17:08.981 clat (usec): min=208, max=1478, avg=285.91, stdev=111.06 00:17:08.981 lat (usec): min=217, max=1509, avg=297.79, stdev=114.41 00:17:08.981 clat percentiles (usec): 00:17:08.981 | 1.00th=[ 217], 5.00th=[ 223], 10.00th=[ 227], 20.00th=[ 235], 00:17:08.981 | 30.00th=[ 241], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 265], 00:17:08.981 | 70.00th=[ 273], 80.00th=[ 289], 90.00th=[ 404], 95.00th=[ 420], 00:17:08.981 | 99.00th=[ 717], 99.50th=[ 1020], 99.90th=[ 1483], 99.95th=[ 1483], 00:17:08.981 | 99.99th=[ 1483] 00:17:08.981 bw ( KiB/s): min= 4104, max= 4104, per=41.64%, avg=4104.00, stdev= 0.00, samples=1 00:17:08.981 iops : min= 1026, max= 1026, avg=1026.00, stdev= 0.00, samples=1 00:17:08.981 lat (usec) : 250=40.90%, 500=51.41%, 750=3.00%, 1000=0.19% 00:17:08.982 lat (msec) : 2=0.56%, 50=3.94% 00:17:08.982 cpu : usr=0.39%, sys=0.39%, ctx=535, majf=0, minf=1 00:17:08.982 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:08.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:08.982 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:08.982 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:08.982 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:08.982 job3: (groupid=0, jobs=1): err= 0: pid=3413345: Mon Jul 22 20:22:40 2024 00:17:08.982 read: IOPS=325, BW=1300KiB/s (1332kB/s)(1316KiB/1012msec) 00:17:08.982 slat (nsec): min=5901, max=27874, avg=10329.38, stdev=3977.71 00:17:08.982 clat (usec): min=396, max=41994, avg=2563.81, stdev=8796.57 00:17:08.982 lat (usec): min=403, max=42016, avg=2574.13, stdev=8799.27 00:17:08.982 clat percentiles (usec): 00:17:08.982 | 1.00th=[ 412], 5.00th=[ 441], 10.00th=[ 453], 20.00th=[ 515], 00:17:08.982 | 30.00th=[ 545], 40.00th=[ 553], 50.00th=[ 570], 60.00th=[ 578], 00:17:08.982 | 70.00th=[ 603], 80.00th=[ 660], 90.00th=[ 734], 95.00th=[ 1795], 00:17:08.982 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:08.982 | 99.99th=[42206] 00:17:08.982 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:17:08.982 slat (nsec): min=5990, max=41125, avg=10648.48, stdev=2344.82 00:17:08.982 clat (usec): min=191, max=2426, avg=298.67, stdev=162.17 00:17:08.982 lat (usec): min=201, max=2444, avg=309.32, stdev=162.80 00:17:08.982 clat percentiles (usec): 00:17:08.982 | 1.00th=[ 200], 5.00th=[ 208], 10.00th=[ 215], 20.00th=[ 223], 00:17:08.982 | 30.00th=[ 229], 40.00th=[ 233], 50.00th=[ 243], 60.00th=[ 265], 00:17:08.982 | 70.00th=[ 297], 80.00th=[ 334], 90.00th=[ 404], 95.00th=[ 506], 00:17:08.982 | 99.00th=[ 889], 99.50th=[ 1303], 99.90th=[ 2442], 99.95th=[ 2442], 00:17:08.982 | 99.99th=[ 2442] 00:17:08.982 bw ( KiB/s): min= 4096, max= 4096, per=41.56%, avg=4096.00, stdev= 0.00, samples=1 00:17:08.982 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:08.982 lat (usec) : 250=33.17%, 500=31.63%, 750=30.68%, 1000=2.02% 00:17:08.982 lat (msec) : 2=0.48%, 4=0.12%, 50=1.90% 00:17:08.982 cpu : usr=0.49%, sys=0.79%, ctx=842, majf=0, minf=2 00:17:08.982 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:08.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:08.982 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:08.982 issued rwts: total=329,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:08.982 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:08.982 00:17:08.982 Run status group 0 (all jobs): 00:17:08.982 READ: bw=3449KiB/s (3532kB/s), 80.8KiB/s-2063KiB/s (82.8kB/s-2113kB/s), io=3584KiB (3670kB), run=1012-1039msec 00:17:08.982 WRITE: bw=9856KiB/s (10.1MB/s), 1971KiB/s-4039KiB/s (2018kB/s-4136kB/s), io=10.0MiB (10.5MB), run=1012-1039msec 00:17:08.982 00:17:08.982 Disk stats (read/write): 00:17:08.982 nvme0n1: ios=66/512, merge=0/0, ticks=800/137, in_queue=937, util=87.07% 00:17:08.982 nvme0n2: ios=562/1024, merge=0/0, ticks=1294/290, in_queue=1584, util=90.86% 00:17:08.982 nvme0n3: ios=68/512, merge=0/0, ticks=808/141, in_queue=949, util=94.61% 00:17:08.982 nvme0n4: ios=377/512, merge=0/0, ticks=772/152, in_queue=924, util=95.40% 00:17:08.982 20:22:40 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:17:08.982 [global] 00:17:08.982 thread=1 00:17:08.982 invalidate=1 00:17:08.982 rw=write 00:17:08.982 time_based=1 00:17:08.982 runtime=1 00:17:08.982 ioengine=libaio 00:17:08.982 direct=1 00:17:08.982 bs=4096 00:17:08.982 iodepth=128 00:17:08.982 norandommap=0 00:17:08.982 numjobs=1 00:17:08.982 00:17:08.982 verify_dump=1 00:17:08.982 verify_backlog=512 00:17:08.982 verify_state_save=0 00:17:08.982 do_verify=1 00:17:08.982 verify=crc32c-intel 00:17:08.982 [job0] 00:17:08.982 filename=/dev/nvme0n1 00:17:08.982 [job1] 00:17:08.982 filename=/dev/nvme0n2 00:17:08.982 [job2] 00:17:08.982 filename=/dev/nvme0n3 00:17:08.982 [job3] 00:17:08.982 filename=/dev/nvme0n4 00:17:08.982 Could not set queue depth (nvme0n1) 00:17:08.982 Could not set queue depth (nvme0n2) 00:17:08.982 Could not set queue depth (nvme0n3) 00:17:08.982 Could not set queue depth (nvme0n4) 00:17:09.240 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:09.240 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:09.240 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:09.240 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:09.240 fio-3.35 00:17:09.240 Starting 4 threads 00:17:10.615 00:17:10.615 job0: (groupid=0, jobs=1): err= 0: pid=3413716: Mon Jul 22 20:22:42 2024 00:17:10.615 read: IOPS=3692, BW=14.4MiB/s (15.1MB/s)(14.5MiB/1005msec) 00:17:10.615 slat (nsec): min=1056, max=52597k, avg=131797.19, stdev=1110672.14 00:17:10.615 clat (usec): min=1723, max=74376, avg=16464.68, stdev=10239.44 00:17:10.615 lat (usec): min=4506, max=74386, avg=16596.47, stdev=10293.40 00:17:10.615 clat percentiles (usec): 00:17:10.615 | 1.00th=[ 7767], 5.00th=[ 9634], 10.00th=[10683], 20.00th=[11338], 00:17:10.615 | 30.00th=[12518], 40.00th=[13829], 50.00th=[14484], 60.00th=[15533], 00:17:10.615 | 70.00th=[16581], 80.00th=[18220], 90.00th=[20579], 95.00th=[22414], 00:17:10.615 | 99.00th=[71828], 99.50th=[71828], 99.90th=[73925], 99.95th=[73925], 00:17:10.615 | 99.99th=[73925] 00:17:10.615 write: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec); 0 zone resets 00:17:10.615 slat (usec): min=2, max=14651, avg=119.11, stdev=675.73 00:17:10.615 clat (usec): min=1276, max=72145, avg=16103.94, stdev=6890.08 00:17:10.616 lat (usec): min=1288, max=72154, avg=16223.05, stdev=6941.79 00:17:10.616 clat percentiles (usec): 00:17:10.616 | 1.00th=[ 4817], 5.00th=[ 8979], 10.00th=[ 9634], 20.00th=[10552], 00:17:10.616 | 30.00th=[11994], 40.00th=[13304], 50.00th=[14091], 60.00th=[15533], 00:17:10.616 | 70.00th=[17957], 80.00th=[21890], 90.00th=[25822], 95.00th=[29754], 00:17:10.616 | 99.00th=[33424], 99.50th=[35914], 99.90th=[71828], 99.95th=[71828], 00:17:10.616 | 99.99th=[71828] 00:17:10.616 bw ( KiB/s): min=13392, max=19368, per=24.52%, avg=16380.00, stdev=4225.67, samples=2 00:17:10.616 iops : min= 3348, max= 4842, avg=4095.00, stdev=1056.42, samples=2 00:17:10.616 lat (msec) : 2=0.08%, 4=0.31%, 10=10.35%, 20=70.68%, 50=16.96% 00:17:10.616 lat (msec) : 100=1.63% 00:17:10.616 cpu : usr=3.78%, sys=2.49%, ctx=495, majf=0, minf=1 00:17:10.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:17:10.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:10.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:10.616 issued rwts: total=3711,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:10.616 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:10.616 job1: (groupid=0, jobs=1): err= 0: pid=3413717: Mon Jul 22 20:22:42 2024 00:17:10.616 read: IOPS=5069, BW=19.8MiB/s (20.8MB/s)(20.0MiB/1010msec) 00:17:10.616 slat (nsec): min=1255, max=10814k, avg=82346.24, stdev=602861.77 00:17:10.616 clat (usec): min=4742, max=27005, avg=11477.59, stdev=3576.53 00:17:10.616 lat (usec): min=5933, max=27010, avg=11559.94, stdev=3598.91 00:17:10.616 clat percentiles (usec): 00:17:10.616 | 1.00th=[ 6325], 5.00th=[ 7046], 10.00th=[ 7767], 20.00th=[ 8455], 00:17:10.616 | 30.00th=[ 9241], 40.00th=[ 9896], 50.00th=[10683], 60.00th=[11338], 00:17:10.616 | 70.00th=[12649], 80.00th=[14091], 90.00th=[16450], 95.00th=[19268], 00:17:10.616 | 99.00th=[21365], 99.50th=[25035], 99.90th=[25822], 99.95th=[25822], 00:17:10.616 | 99.99th=[27132] 00:17:10.616 write: IOPS=5402, BW=21.1MiB/s (22.1MB/s)(21.3MiB/1010msec); 0 zone resets 00:17:10.616 slat (usec): min=2, max=17286, avg=100.24, stdev=575.69 00:17:10.616 clat (usec): min=2333, max=33266, avg=12692.05, stdev=5872.45 00:17:10.616 lat (usec): min=2336, max=33275, avg=12792.29, stdev=5894.20 00:17:10.616 clat percentiles (usec): 00:17:10.616 | 1.00th=[ 4113], 5.00th=[ 5735], 10.00th=[ 6521], 20.00th=[ 7898], 00:17:10.616 | 30.00th=[ 9110], 40.00th=[10159], 50.00th=[11731], 60.00th=[12911], 00:17:10.616 | 70.00th=[14615], 80.00th=[16319], 90.00th=[19792], 95.00th=[25822], 00:17:10.616 | 99.00th=[31589], 99.50th=[32375], 99.90th=[33162], 99.95th=[33162], 00:17:10.616 | 99.99th=[33162] 00:17:10.616 bw ( KiB/s): min=20480, max=22160, per=31.91%, avg=21320.00, stdev=1187.94, samples=2 00:17:10.616 iops : min= 5120, max= 5540, avg=5330.00, stdev=296.98, samples=2 00:17:10.616 lat (msec) : 4=0.48%, 10=41.10%, 20=51.70%, 50=6.72% 00:17:10.616 cpu : usr=3.47%, sys=4.36%, ctx=655, majf=0, minf=1 00:17:10.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:17:10.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:10.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:10.616 issued rwts: total=5120,5457,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:10.616 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:10.616 job2: (groupid=0, jobs=1): err= 0: pid=3413718: Mon Jul 22 20:22:42 2024 00:17:10.616 read: IOPS=2547, BW=9.95MiB/s (10.4MB/s)(10.0MiB/1005msec) 00:17:10.616 slat (nsec): min=1014, max=17699k, avg=178448.46, stdev=1012816.71 00:17:10.616 clat (usec): min=14070, max=52316, avg=22641.45, stdev=5756.54 00:17:10.616 lat (usec): min=14074, max=52327, avg=22819.90, stdev=5821.03 00:17:10.616 clat percentiles (usec): 00:17:10.616 | 1.00th=[14091], 5.00th=[16188], 10.00th=[17171], 20.00th=[18744], 00:17:10.616 | 30.00th=[19268], 40.00th=[20317], 50.00th=[21103], 60.00th=[21627], 00:17:10.616 | 70.00th=[23987], 80.00th=[26084], 90.00th=[31327], 95.00th=[36439], 00:17:10.616 | 99.00th=[42206], 99.50th=[45876], 99.90th=[47449], 99.95th=[47449], 00:17:10.616 | 99.99th=[52167] 00:17:10.616 write: IOPS=2749, BW=10.7MiB/s (11.3MB/s)(10.8MiB/1005msec); 0 zone resets 00:17:10.616 slat (usec): min=2, max=15717, avg=193.96, stdev=915.04 00:17:10.616 clat (usec): min=2416, max=48755, avg=24850.40, stdev=7260.53 00:17:10.616 lat (usec): min=8046, max=48759, avg=25044.36, stdev=7311.91 00:17:10.616 clat percentiles (usec): 00:17:10.616 | 1.00th=[ 8291], 5.00th=[15401], 10.00th=[16909], 20.00th=[18482], 00:17:10.616 | 30.00th=[20841], 40.00th=[22152], 50.00th=[23725], 60.00th=[25560], 00:17:10.616 | 70.00th=[27657], 80.00th=[31327], 90.00th=[35390], 95.00th=[39060], 00:17:10.616 | 99.00th=[41681], 99.50th=[43779], 99.90th=[48497], 99.95th=[48497], 00:17:10.616 | 99.99th=[48497] 00:17:10.616 bw ( KiB/s): min=10024, max=11056, per=15.78%, avg=10540.00, stdev=729.73, samples=2 00:17:10.616 iops : min= 2506, max= 2764, avg=2635.00, stdev=182.43, samples=2 00:17:10.616 lat (msec) : 4=0.02%, 10=0.79%, 20=32.54%, 50=66.64%, 100=0.02% 00:17:10.616 cpu : usr=1.20%, sys=1.59%, ctx=425, majf=0, minf=1 00:17:10.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:17:10.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:10.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:10.616 issued rwts: total=2560,2763,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:10.616 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:10.616 job3: (groupid=0, jobs=1): err= 0: pid=3413719: Mon Jul 22 20:22:42 2024 00:17:10.616 read: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec) 00:17:10.616 slat (nsec): min=1221, max=20417k, avg=107791.84, stdev=849116.82 00:17:10.616 clat (usec): min=3294, max=41411, avg=15542.66, stdev=5948.78 00:17:10.616 lat (usec): min=4560, max=41427, avg=15650.45, stdev=5994.19 00:17:10.616 clat percentiles (usec): 00:17:10.616 | 1.00th=[ 5407], 5.00th=[ 7963], 10.00th=[ 8717], 20.00th=[10159], 00:17:10.616 | 30.00th=[11469], 40.00th=[13042], 50.00th=[14877], 60.00th=[16319], 00:17:10.616 | 70.00th=[18744], 80.00th=[20579], 90.00th=[23462], 95.00th=[25822], 00:17:10.616 | 99.00th=[34341], 99.50th=[38011], 99.90th=[38536], 99.95th=[38536], 00:17:10.616 | 99.99th=[41157] 00:17:10.616 write: IOPS=4531, BW=17.7MiB/s (18.6MB/s)(17.8MiB/1005msec); 0 zone resets 00:17:10.616 slat (nsec): min=1987, max=9150.2k, avg=102929.94, stdev=614908.79 00:17:10.616 clat (usec): min=668, max=55370, avg=14014.50, stdev=8196.84 00:17:10.616 lat (usec): min=694, max=55383, avg=14117.43, stdev=8245.71 00:17:10.616 clat percentiles (usec): 00:17:10.616 | 1.00th=[ 3032], 5.00th=[ 5473], 10.00th=[ 6783], 20.00th=[ 8160], 00:17:10.616 | 30.00th=[10028], 40.00th=[10814], 50.00th=[12387], 60.00th=[14222], 00:17:10.616 | 70.00th=[15926], 80.00th=[17695], 90.00th=[20317], 95.00th=[26084], 00:17:10.616 | 99.00th=[50594], 99.50th=[52167], 99.90th=[55313], 99.95th=[55313], 00:17:10.616 | 99.99th=[55313] 00:17:10.616 bw ( KiB/s): min=14704, max=20712, per=26.50%, avg=17708.00, stdev=4248.30, samples=2 00:17:10.616 iops : min= 3676, max= 5178, avg=4427.00, stdev=1062.07, samples=2 00:17:10.616 lat (usec) : 750=0.02%, 1000=0.01% 00:17:10.616 lat (msec) : 2=0.25%, 4=0.65%, 10=23.28%, 20=59.04%, 50=16.06% 00:17:10.616 lat (msec) : 100=0.68% 00:17:10.616 cpu : usr=3.49%, sys=3.78%, ctx=444, majf=0, minf=1 00:17:10.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:17:10.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:10.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:10.616 issued rwts: total=4096,4554,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:10.616 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:10.616 00:17:10.616 Run status group 0 (all jobs): 00:17:10.616 READ: bw=59.9MiB/s (62.8MB/s), 9.95MiB/s-19.8MiB/s (10.4MB/s-20.8MB/s), io=60.5MiB (63.4MB), run=1005-1010msec 00:17:10.616 WRITE: bw=65.2MiB/s (68.4MB/s), 10.7MiB/s-21.1MiB/s (11.3MB/s-22.1MB/s), io=65.9MiB (69.1MB), run=1005-1010msec 00:17:10.616 00:17:10.616 Disk stats (read/write): 00:17:10.616 nvme0n1: ios=3122/3103, merge=0/0, ticks=25022/24811, in_queue=49833, util=88.58% 00:17:10.616 nvme0n2: ios=4145/4608, merge=0/0, ticks=49046/56996, in_queue=106042, util=96.04% 00:17:10.616 nvme0n3: ios=2105/2391, merge=0/0, ticks=15539/19952, in_queue=35491, util=92.72% 00:17:10.616 nvme0n4: ios=3625/4024, merge=0/0, ticks=51889/53569, in_queue=105458, util=95.81% 00:17:10.616 20:22:42 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:17:10.616 [global] 00:17:10.616 thread=1 00:17:10.616 invalidate=1 00:17:10.616 rw=randwrite 00:17:10.616 time_based=1 00:17:10.616 runtime=1 00:17:10.616 ioengine=libaio 00:17:10.616 direct=1 00:17:10.616 bs=4096 00:17:10.616 iodepth=128 00:17:10.616 norandommap=0 00:17:10.616 numjobs=1 00:17:10.616 00:17:10.616 verify_dump=1 00:17:10.616 verify_backlog=512 00:17:10.616 verify_state_save=0 00:17:10.616 do_verify=1 00:17:10.616 verify=crc32c-intel 00:17:10.616 [job0] 00:17:10.616 filename=/dev/nvme0n1 00:17:10.616 [job1] 00:17:10.616 filename=/dev/nvme0n2 00:17:10.616 [job2] 00:17:10.616 filename=/dev/nvme0n3 00:17:10.616 [job3] 00:17:10.616 filename=/dev/nvme0n4 00:17:10.616 Could not set queue depth (nvme0n1) 00:17:10.616 Could not set queue depth (nvme0n2) 00:17:10.616 Could not set queue depth (nvme0n3) 00:17:10.616 Could not set queue depth (nvme0n4) 00:17:10.874 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:10.874 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:10.874 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:10.874 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:10.874 fio-3.35 00:17:10.874 Starting 4 threads 00:17:12.249 00:17:12.249 job0: (groupid=0, jobs=1): err= 0: pid=3414095: Mon Jul 22 20:22:43 2024 00:17:12.249 read: IOPS=4841, BW=18.9MiB/s (19.8MB/s)(19.0MiB/1004msec) 00:17:12.249 slat (nsec): min=1452, max=19836k, avg=94581.69, stdev=728534.85 00:17:12.249 clat (usec): min=1800, max=37608, avg=12800.70, stdev=5334.45 00:17:12.249 lat (usec): min=5760, max=37615, avg=12895.28, stdev=5363.32 00:17:12.249 clat percentiles (usec): 00:17:12.249 | 1.00th=[ 6652], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8979], 00:17:12.249 | 30.00th=[ 9765], 40.00th=[10552], 50.00th=[11469], 60.00th=[12256], 00:17:12.249 | 70.00th=[13304], 80.00th=[15008], 90.00th=[21103], 95.00th=[23200], 00:17:12.249 | 99.00th=[33817], 99.50th=[35390], 99.90th=[37487], 99.95th=[37487], 00:17:12.249 | 99.99th=[37487] 00:17:12.249 write: IOPS=5099, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1004msec); 0 zone resets 00:17:12.249 slat (usec): min=2, max=15737, avg=96.84, stdev=497.33 00:17:12.249 clat (usec): min=2027, max=37588, avg=12715.87, stdev=4776.70 00:17:12.249 lat (usec): min=2039, max=37592, avg=12812.71, stdev=4788.04 00:17:12.249 clat percentiles (usec): 00:17:12.249 | 1.00th=[ 4293], 5.00th=[ 5866], 10.00th=[ 6915], 20.00th=[ 8455], 00:17:12.249 | 30.00th=[ 9896], 40.00th=[10945], 50.00th=[12125], 60.00th=[13698], 00:17:12.249 | 70.00th=[15139], 80.00th=[16909], 90.00th=[18482], 95.00th=[20579], 00:17:12.249 | 99.00th=[26608], 99.50th=[27657], 99.90th=[27657], 99.95th=[27657], 00:17:12.249 | 99.99th=[37487] 00:17:12.249 bw ( KiB/s): min=18160, max=22800, per=29.28%, avg=20480.00, stdev=3280.98, samples=2 00:17:12.249 iops : min= 4540, max= 5700, avg=5120.00, stdev=820.24, samples=2 00:17:12.249 lat (msec) : 2=0.01%, 4=0.33%, 10=32.56%, 20=58.76%, 50=8.34% 00:17:12.249 cpu : usr=4.09%, sys=4.59%, ctx=570, majf=0, minf=1 00:17:12.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:17:12.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:12.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:12.249 issued rwts: total=4861,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:12.249 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:12.249 job1: (groupid=0, jobs=1): err= 0: pid=3414096: Mon Jul 22 20:22:43 2024 00:17:12.249 read: IOPS=5019, BW=19.6MiB/s (20.6MB/s)(20.0MiB/1020msec) 00:17:12.249 slat (nsec): min=1137, max=14820k, avg=83265.04, stdev=648795.75 00:17:12.249 clat (usec): min=2720, max=55029, avg=12334.30, stdev=5727.61 00:17:12.249 lat (usec): min=2731, max=55063, avg=12417.57, stdev=5753.01 00:17:12.249 clat percentiles (usec): 00:17:12.249 | 1.00th=[ 3294], 5.00th=[ 6390], 10.00th=[ 7898], 20.00th=[ 8979], 00:17:12.249 | 30.00th=[ 9765], 40.00th=[10290], 50.00th=[11076], 60.00th=[11731], 00:17:12.249 | 70.00th=[12649], 80.00th=[14222], 90.00th=[17695], 95.00th=[22414], 00:17:12.249 | 99.00th=[40633], 99.50th=[47449], 99.90th=[54789], 99.95th=[54789], 00:17:12.249 | 99.99th=[54789] 00:17:12.249 write: IOPS=5183, BW=20.2MiB/s (21.2MB/s)(20.7MiB/1020msec); 0 zone resets 00:17:12.249 slat (usec): min=2, max=18064, avg=99.58, stdev=659.09 00:17:12.249 clat (usec): min=2661, max=49153, avg=12525.06, stdev=6014.62 00:17:12.249 lat (usec): min=2664, max=49160, avg=12624.65, stdev=6051.68 00:17:12.249 clat percentiles (usec): 00:17:12.249 | 1.00th=[ 4555], 5.00th=[ 6325], 10.00th=[ 7504], 20.00th=[ 8848], 00:17:12.249 | 30.00th=[ 9503], 40.00th=[10290], 50.00th=[10814], 60.00th=[11863], 00:17:12.249 | 70.00th=[13435], 80.00th=[15008], 90.00th=[19006], 95.00th=[22938], 00:17:12.249 | 99.00th=[42206], 99.50th=[43254], 99.90th=[47449], 99.95th=[47449], 00:17:12.249 | 99.99th=[49021] 00:17:12.249 bw ( KiB/s): min=18768, max=22544, per=29.53%, avg=20656.00, stdev=2670.04, samples=2 00:17:12.249 iops : min= 4692, max= 5636, avg=5164.00, stdev=667.51, samples=2 00:17:12.249 lat (msec) : 4=0.93%, 10=35.71%, 20=55.34%, 50=7.85%, 100=0.17% 00:17:12.249 cpu : usr=3.24%, sys=4.81%, ctx=555, majf=0, minf=1 00:17:12.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:17:12.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:12.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:12.249 issued rwts: total=5120,5287,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:12.249 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:12.249 job2: (groupid=0, jobs=1): err= 0: pid=3414110: Mon Jul 22 20:22:43 2024 00:17:12.249 read: IOPS=2539, BW=9.92MiB/s (10.4MB/s)(10.0MiB/1008msec) 00:17:12.249 slat (nsec): min=1153, max=26182k, avg=218560.74, stdev=1531387.65 00:17:12.249 clat (usec): min=3715, max=83778, avg=28311.14, stdev=17660.96 00:17:12.249 lat (usec): min=3718, max=83788, avg=28529.70, stdev=17784.59 00:17:12.249 clat percentiles (usec): 00:17:12.249 | 1.00th=[ 4146], 5.00th=[ 8094], 10.00th=[10421], 20.00th=[12125], 00:17:12.249 | 30.00th=[14746], 40.00th=[17957], 50.00th=[23987], 60.00th=[29754], 00:17:12.249 | 70.00th=[37487], 80.00th=[45876], 90.00th=[57410], 95.00th=[62129], 00:17:12.249 | 99.00th=[69731], 99.50th=[69731], 99.90th=[83362], 99.95th=[83362], 00:17:12.249 | 99.99th=[83362] 00:17:12.249 write: IOPS=2572, BW=10.0MiB/s (10.5MB/s)(10.1MiB/1008msec); 0 zone resets 00:17:12.249 slat (nsec): min=1991, max=17058k, avg=157145.13, stdev=1070328.23 00:17:12.249 clat (usec): min=1096, max=67262, avg=21329.38, stdev=10206.23 00:17:12.249 lat (usec): min=1108, max=67265, avg=21486.53, stdev=10298.14 00:17:12.249 clat percentiles (usec): 00:17:12.249 | 1.00th=[ 1778], 5.00th=[ 3949], 10.00th=[ 5866], 20.00th=[14877], 00:17:12.249 | 30.00th=[17171], 40.00th=[18220], 50.00th=[19530], 60.00th=[21890], 00:17:12.249 | 70.00th=[25560], 80.00th=[29754], 90.00th=[35914], 95.00th=[40633], 00:17:12.249 | 99.00th=[47449], 99.50th=[50594], 99.90th=[67634], 99.95th=[67634], 00:17:12.249 | 99.99th=[67634] 00:17:12.249 bw ( KiB/s): min= 6024, max=14456, per=14.64%, avg=10240.00, stdev=5962.32, samples=2 00:17:12.249 iops : min= 1506, max= 3614, avg=2560.00, stdev=1490.58, samples=2 00:17:12.249 lat (msec) : 2=0.52%, 4=2.33%, 10=8.77%, 20=36.31%, 50=43.47% 00:17:12.249 lat (msec) : 100=8.60% 00:17:12.249 cpu : usr=1.29%, sys=1.99%, ctx=355, majf=0, minf=1 00:17:12.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:17:12.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:12.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:12.249 issued rwts: total=2560,2593,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:12.249 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:12.249 job3: (groupid=0, jobs=1): err= 0: pid=3414117: Mon Jul 22 20:22:43 2024 00:17:12.249 read: IOPS=4575, BW=17.9MiB/s (18.7MB/s)(18.0MiB/1007msec) 00:17:12.249 slat (nsec): min=1475, max=12220k, avg=88908.36, stdev=700584.63 00:17:12.249 clat (usec): min=2528, max=26628, avg=14361.09, stdev=3971.37 00:17:12.249 lat (usec): min=2533, max=28791, avg=14450.00, stdev=3989.44 00:17:12.249 clat percentiles (usec): 00:17:12.249 | 1.00th=[ 7242], 5.00th=[ 8717], 10.00th=[ 9372], 20.00th=[10945], 00:17:12.249 | 30.00th=[11863], 40.00th=[12780], 50.00th=[13829], 60.00th=[15139], 00:17:12.249 | 70.00th=[15795], 80.00th=[17957], 90.00th=[20055], 95.00th=[21627], 00:17:12.249 | 99.00th=[24773], 99.50th=[25822], 99.90th=[26608], 99.95th=[26608], 00:17:12.249 | 99.99th=[26608] 00:17:12.249 write: IOPS=4801, BW=18.8MiB/s (19.7MB/s)(18.9MiB/1007msec); 0 zone resets 00:17:12.249 slat (usec): min=2, max=13276, avg=91.94, stdev=661.58 00:17:12.249 clat (usec): min=3658, max=28816, avg=12741.42, stdev=3967.20 00:17:12.249 lat (usec): min=4081, max=28830, avg=12833.36, stdev=3959.79 00:17:12.249 clat percentiles (usec): 00:17:12.249 | 1.00th=[ 4883], 5.00th=[ 7046], 10.00th=[ 8094], 20.00th=[ 9634], 00:17:12.249 | 30.00th=[10814], 40.00th=[11469], 50.00th=[12125], 60.00th=[13304], 00:17:12.249 | 70.00th=[14353], 80.00th=[15401], 90.00th=[17695], 95.00th=[20841], 00:17:12.249 | 99.00th=[23725], 99.50th=[28705], 99.90th=[28705], 99.95th=[28705], 00:17:12.249 | 99.99th=[28705] 00:17:12.249 bw ( KiB/s): min=17184, max=20480, per=26.93%, avg=18832.00, stdev=2330.62, samples=2 00:17:12.249 iops : min= 4296, max= 5120, avg=4708.00, stdev=582.66, samples=2 00:17:12.249 lat (msec) : 4=0.17%, 10=19.31%, 20=72.61%, 50=7.91% 00:17:12.249 cpu : usr=3.28%, sys=4.08%, ctx=434, majf=0, minf=1 00:17:12.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:17:12.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:12.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:12.249 issued rwts: total=4608,4835,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:12.249 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:12.249 00:17:12.249 Run status group 0 (all jobs): 00:17:12.249 READ: bw=65.7MiB/s (68.9MB/s), 9.92MiB/s-19.6MiB/s (10.4MB/s-20.6MB/s), io=67.0MiB (70.2MB), run=1004-1020msec 00:17:12.249 WRITE: bw=68.3MiB/s (71.6MB/s), 10.0MiB/s-20.2MiB/s (10.5MB/s-21.2MB/s), io=69.7MiB (73.1MB), run=1004-1020msec 00:17:12.249 00:17:12.249 Disk stats (read/write): 00:17:12.249 nvme0n1: ios=3605/4034, merge=0/0, ticks=48964/49404, in_queue=98368, util=93.49% 00:17:12.249 nvme0n2: ios=3841/4096, merge=0/0, ticks=43235/44557, in_queue=87792, util=99.90% 00:17:12.249 nvme0n3: ios=2136/2560, merge=0/0, ticks=21522/22845, in_queue=44367, util=99.67% 00:17:12.249 nvme0n4: ios=3603/3855, merge=0/0, ticks=48993/45353, in_queue=94346, util=97.56% 00:17:12.249 20:22:43 -- target/fio.sh@55 -- # sync 00:17:12.249 20:22:43 -- target/fio.sh@59 -- # fio_pid=3414333 00:17:12.250 20:22:43 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:17:12.250 20:22:43 -- target/fio.sh@61 -- # sleep 3 00:17:12.250 [global] 00:17:12.250 thread=1 00:17:12.250 invalidate=1 00:17:12.250 rw=read 00:17:12.250 time_based=1 00:17:12.250 runtime=10 00:17:12.250 ioengine=libaio 00:17:12.250 direct=1 00:17:12.250 bs=4096 00:17:12.250 iodepth=1 00:17:12.250 norandommap=1 00:17:12.250 numjobs=1 00:17:12.250 00:17:12.250 [job0] 00:17:12.250 filename=/dev/nvme0n1 00:17:12.250 [job1] 00:17:12.250 filename=/dev/nvme0n2 00:17:12.250 [job2] 00:17:12.250 filename=/dev/nvme0n3 00:17:12.250 [job3] 00:17:12.250 filename=/dev/nvme0n4 00:17:12.250 Could not set queue depth (nvme0n1) 00:17:12.250 Could not set queue depth (nvme0n2) 00:17:12.250 Could not set queue depth (nvme0n3) 00:17:12.250 Could not set queue depth (nvme0n4) 00:17:12.507 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:12.507 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:12.507 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:12.507 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:12.507 fio-3.35 00:17:12.507 Starting 4 threads 00:17:15.039 20:22:46 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:17:15.297 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=16621568, buflen=4096 00:17:15.297 fio: pid=3414580, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:17:15.297 20:22:47 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:17:15.556 20:22:47 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:15.556 20:22:47 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:17:15.556 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=20414464, buflen=4096 00:17:15.556 fio: pid=3414574, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:17:15.816 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=315392, buflen=4096 00:17:15.816 fio: pid=3414537, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:17:15.816 20:22:47 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:15.816 20:22:47 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:17:15.817 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=6721536, buflen=4096 00:17:15.817 fio: pid=3414554, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:17:15.817 20:22:47 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:15.817 20:22:47 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:17:15.817 00:17:15.817 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3414537: Mon Jul 22 20:22:47 2024 00:17:15.817 read: IOPS=25, BW=99.8KiB/s (102kB/s)(308KiB/3085msec) 00:17:15.817 slat (nsec): min=9751, max=67623, avg=22454.82, stdev=7235.94 00:17:15.817 clat (usec): min=572, max=42135, avg=40022.75, stdev=6461.54 00:17:15.817 lat (usec): min=593, max=42156, avg=40045.19, stdev=6458.55 00:17:15.817 clat percentiles (usec): 00:17:15.817 | 1.00th=[ 570], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:17:15.817 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:15.817 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:17:15.817 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:15.817 | 99.99th=[42206] 00:17:15.817 bw ( KiB/s): min= 96, max= 104, per=0.75%, avg=99.20, stdev= 4.38, samples=5 00:17:15.817 iops : min= 24, max= 26, avg=24.80, stdev= 1.10, samples=5 00:17:15.817 lat (usec) : 750=1.28%, 1000=1.28% 00:17:15.817 lat (msec) : 50=96.15% 00:17:15.817 cpu : usr=0.13%, sys=0.00%, ctx=80, majf=0, minf=1 00:17:15.817 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:15.817 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.817 complete : 0=1.3%, 4=98.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.817 issued rwts: total=78,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:15.817 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:15.817 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=3414554: Mon Jul 22 20:22:47 2024 00:17:15.817 read: IOPS=504, BW=2017KiB/s (2065kB/s)(6564KiB/3255msec) 00:17:15.817 slat (usec): min=7, max=7568, avg=19.00, stdev=255.68 00:17:15.817 clat (usec): min=484, max=42946, avg=1961.63, stdev=7467.48 00:17:15.817 lat (usec): min=492, max=49997, avg=1980.62, stdev=7529.01 00:17:15.817 clat percentiles (usec): 00:17:15.817 | 1.00th=[ 494], 5.00th=[ 502], 10.00th=[ 506], 20.00th=[ 515], 00:17:15.817 | 30.00th=[ 519], 40.00th=[ 529], 50.00th=[ 537], 60.00th=[ 537], 00:17:15.817 | 70.00th=[ 545], 80.00th=[ 553], 90.00th=[ 627], 95.00th=[ 734], 00:17:15.817 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42730], 00:17:15.817 | 99.99th=[42730] 00:17:15.817 bw ( KiB/s): min= 93, max= 6592, per=16.48%, avg=2179.50, stdev=3223.69, samples=6 00:17:15.817 iops : min= 23, max= 1648, avg=544.83, stdev=805.96, samples=6 00:17:15.817 lat (usec) : 500=5.24%, 750=90.68%, 1000=0.30% 00:17:15.817 lat (msec) : 2=0.18%, 10=0.06%, 50=3.47% 00:17:15.817 cpu : usr=0.55%, sys=0.65%, ctx=1646, majf=0, minf=1 00:17:15.817 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:15.817 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.817 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.817 issued rwts: total=1642,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:15.817 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:15.817 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3414574: Mon Jul 22 20:22:47 2024 00:17:15.817 read: IOPS=1716, BW=6865KiB/s (7030kB/s)(19.5MiB/2904msec) 00:17:15.817 slat (usec): min=7, max=13696, avg=11.42, stdev=193.88 00:17:15.817 clat (usec): min=302, max=41269, avg=569.06, stdev=1148.98 00:17:15.817 lat (usec): min=311, max=54966, avg=580.47, stdev=1257.74 00:17:15.817 clat percentiles (usec): 00:17:15.817 | 1.00th=[ 338], 5.00th=[ 437], 10.00th=[ 490], 20.00th=[ 510], 00:17:15.817 | 30.00th=[ 519], 40.00th=[ 529], 50.00th=[ 537], 60.00th=[ 553], 00:17:15.817 | 70.00th=[ 562], 80.00th=[ 570], 90.00th=[ 594], 95.00th=[ 619], 00:17:15.817 | 99.00th=[ 652], 99.50th=[ 676], 99.90th=[ 1467], 99.95th=[41157], 00:17:15.817 | 99.99th=[41157] 00:17:15.817 bw ( KiB/s): min= 6800, max= 7984, per=55.34%, avg=7318.40, stdev=432.68, samples=5 00:17:15.817 iops : min= 1700, max= 1996, avg=1829.60, stdev=108.17, samples=5 00:17:15.817 lat (usec) : 500=14.12%, 750=85.44%, 1000=0.28% 00:17:15.817 lat (msec) : 2=0.06%, 50=0.08% 00:17:15.817 cpu : usr=1.14%, sys=2.79%, ctx=4988, majf=0, minf=1 00:17:15.817 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:15.817 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.817 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.817 issued rwts: total=4985,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:15.817 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:15.817 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3414580: Mon Jul 22 20:22:47 2024 00:17:15.817 read: IOPS=1516, BW=6064KiB/s (6209kB/s)(15.9MiB/2677msec) 00:17:15.817 slat (usec): min=6, max=161, avg=12.81, stdev= 7.77 00:17:15.817 clat (usec): min=305, max=41567, avg=644.14, stdev=656.35 00:17:15.817 lat (usec): min=312, max=41574, avg=656.95, stdev=657.34 00:17:15.817 clat percentiles (usec): 00:17:15.817 | 1.00th=[ 355], 5.00th=[ 465], 10.00th=[ 482], 20.00th=[ 519], 00:17:15.817 | 30.00th=[ 545], 40.00th=[ 578], 50.00th=[ 619], 60.00th=[ 676], 00:17:15.817 | 70.00th=[ 717], 80.00th=[ 758], 90.00th=[ 791], 95.00th=[ 824], 00:17:15.817 | 99.00th=[ 979], 99.50th=[ 1057], 99.90th=[ 1483], 99.95th=[ 1565], 00:17:15.817 | 99.99th=[41681] 00:17:15.817 bw ( KiB/s): min= 5144, max= 7320, per=45.75%, avg=6049.60, stdev=973.63, samples=5 00:17:15.817 iops : min= 1286, max= 1830, avg=1512.40, stdev=243.41, samples=5 00:17:15.817 lat (usec) : 500=14.66%, 750=63.88%, 1000=20.74% 00:17:15.817 lat (msec) : 2=0.64%, 4=0.02%, 50=0.02% 00:17:15.817 cpu : usr=0.60%, sys=2.47%, ctx=4060, majf=0, minf=2 00:17:15.817 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:15.817 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.817 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.817 issued rwts: total=4059,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:15.817 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:15.817 00:17:15.817 Run status group 0 (all jobs): 00:17:15.818 READ: bw=12.9MiB/s (13.5MB/s), 99.8KiB/s-6865KiB/s (102kB/s-7030kB/s), io=42.0MiB (44.1MB), run=2677-3255msec 00:17:15.818 00:17:15.818 Disk stats (read/write): 00:17:15.818 nvme0n1: ios=71/0, merge=0/0, ticks=2835/0, in_queue=2835, util=95.29% 00:17:15.818 nvme0n2: ios=1676/0, merge=0/0, ticks=3241/0, in_queue=3241, util=98.73% 00:17:15.818 nvme0n3: ios=5022/0, merge=0/0, ticks=3599/0, in_queue=3599, util=99.43% 00:17:15.818 nvme0n4: ios=3938/0, merge=0/0, ticks=2522/0, in_queue=2522, util=96.44% 00:17:16.077 20:22:47 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:16.077 20:22:47 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:17:16.336 20:22:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:16.336 20:22:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:17:16.336 20:22:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:16.336 20:22:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:17:16.596 20:22:48 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:16.596 20:22:48 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:17:16.855 20:22:48 -- target/fio.sh@69 -- # fio_status=0 00:17:16.855 20:22:48 -- target/fio.sh@70 -- # wait 3414333 00:17:16.855 20:22:48 -- target/fio.sh@70 -- # fio_status=4 00:17:16.855 20:22:48 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:16.855 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:16.855 20:22:48 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:16.855 20:22:48 -- common/autotest_common.sh@1198 -- # local i=0 00:17:16.855 20:22:48 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:17:16.855 20:22:48 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:16.855 20:22:48 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:17:16.855 20:22:48 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:16.855 20:22:48 -- common/autotest_common.sh@1210 -- # return 0 00:17:16.855 20:22:48 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:17:16.855 20:22:48 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:17:16.855 nvmf hotplug test: fio failed as expected 00:17:16.855 20:22:48 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:17.114 20:22:48 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:17:17.114 20:22:48 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:17:17.114 20:22:48 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:17:17.114 20:22:48 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:17:17.114 20:22:48 -- target/fio.sh@91 -- # nvmftestfini 00:17:17.114 20:22:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:17.114 20:22:48 -- nvmf/common.sh@116 -- # sync 00:17:17.114 20:22:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:17.114 20:22:48 -- nvmf/common.sh@119 -- # set +e 00:17:17.114 20:22:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:17.114 20:22:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:17.114 rmmod nvme_tcp 00:17:17.114 rmmod nvme_fabrics 00:17:17.114 rmmod nvme_keyring 00:17:17.114 20:22:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:17.114 20:22:49 -- nvmf/common.sh@123 -- # set -e 00:17:17.114 20:22:49 -- nvmf/common.sh@124 -- # return 0 00:17:17.114 20:22:49 -- nvmf/common.sh@477 -- # '[' -n 3411591 ']' 00:17:17.114 20:22:49 -- nvmf/common.sh@478 -- # killprocess 3411591 00:17:17.114 20:22:49 -- common/autotest_common.sh@926 -- # '[' -z 3411591 ']' 00:17:17.114 20:22:49 -- common/autotest_common.sh@930 -- # kill -0 3411591 00:17:17.114 20:22:49 -- common/autotest_common.sh@931 -- # uname 00:17:17.114 20:22:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:17.114 20:22:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3411591 00:17:17.373 20:22:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:17.373 20:22:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:17.373 20:22:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3411591' 00:17:17.373 killing process with pid 3411591 00:17:17.373 20:22:49 -- common/autotest_common.sh@945 -- # kill 3411591 00:17:17.373 20:22:49 -- common/autotest_common.sh@950 -- # wait 3411591 00:17:17.373 20:22:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:17.373 20:22:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:17.373 20:22:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:17.373 20:22:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:17.373 20:22:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:17.373 20:22:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:17.373 20:22:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:17.373 20:22:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.913 20:22:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:19.913 00:17:19.913 real 0m25.916s 00:17:19.913 user 1m46.076s 00:17:19.913 sys 0m7.284s 00:17:19.913 20:22:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:19.913 20:22:51 -- common/autotest_common.sh@10 -- # set +x 00:17:19.913 ************************************ 00:17:19.913 END TEST nvmf_fio_target 00:17:19.913 ************************************ 00:17:19.913 20:22:51 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:19.913 20:22:51 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:19.913 20:22:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:19.913 20:22:51 -- common/autotest_common.sh@10 -- # set +x 00:17:19.913 ************************************ 00:17:19.913 START TEST nvmf_bdevio 00:17:19.913 ************************************ 00:17:19.913 20:22:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:19.913 * Looking for test storage... 00:17:19.913 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:19.913 20:22:51 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:19.913 20:22:51 -- nvmf/common.sh@7 -- # uname -s 00:17:19.913 20:22:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:19.913 20:22:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:19.913 20:22:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:19.913 20:22:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:19.913 20:22:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:19.913 20:22:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:19.913 20:22:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:19.913 20:22:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:19.913 20:22:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:19.913 20:22:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:19.913 20:22:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:17:19.913 20:22:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:17:19.913 20:22:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:19.913 20:22:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:19.913 20:22:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:19.913 20:22:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:19.913 20:22:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:19.913 20:22:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:19.913 20:22:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:19.913 20:22:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.913 20:22:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.913 20:22:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.913 20:22:51 -- paths/export.sh@5 -- # export PATH 00:17:19.913 20:22:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.913 20:22:51 -- nvmf/common.sh@46 -- # : 0 00:17:19.913 20:22:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:19.913 20:22:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:19.913 20:22:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:19.913 20:22:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:19.913 20:22:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:19.913 20:22:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:19.913 20:22:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:19.913 20:22:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:19.913 20:22:51 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:19.913 20:22:51 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:19.913 20:22:51 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:19.913 20:22:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:19.913 20:22:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:19.913 20:22:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:19.913 20:22:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:19.913 20:22:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:19.913 20:22:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:19.913 20:22:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:19.913 20:22:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.913 20:22:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:19.913 20:22:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:19.913 20:22:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:19.913 20:22:51 -- common/autotest_common.sh@10 -- # set +x 00:17:25.192 20:22:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:25.192 20:22:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:25.192 20:22:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:25.192 20:22:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:25.192 20:22:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:25.192 20:22:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:25.192 20:22:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:25.192 20:22:56 -- nvmf/common.sh@294 -- # net_devs=() 00:17:25.192 20:22:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:25.192 20:22:56 -- nvmf/common.sh@295 -- # e810=() 00:17:25.192 20:22:56 -- nvmf/common.sh@295 -- # local -ga e810 00:17:25.192 20:22:56 -- nvmf/common.sh@296 -- # x722=() 00:17:25.192 20:22:56 -- nvmf/common.sh@296 -- # local -ga x722 00:17:25.192 20:22:56 -- nvmf/common.sh@297 -- # mlx=() 00:17:25.192 20:22:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:25.192 20:22:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:25.192 20:22:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:25.192 20:22:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:25.192 20:22:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:25.192 20:22:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:25.192 20:22:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:25.192 20:22:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:25.192 20:22:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:25.192 20:22:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:17:25.193 Found 0000:86:00.0 (0x8086 - 0x159b) 00:17:25.193 20:22:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:25.193 20:22:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:17:25.193 Found 0000:86:00.1 (0x8086 - 0x159b) 00:17:25.193 20:22:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:25.193 20:22:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:25.193 20:22:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:25.193 20:22:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:25.193 20:22:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:25.193 20:22:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:17:25.193 Found net devices under 0000:86:00.0: cvl_0_0 00:17:25.193 20:22:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:25.193 20:22:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:25.193 20:22:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:25.193 20:22:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:25.193 20:22:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:25.193 20:22:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:17:25.193 Found net devices under 0000:86:00.1: cvl_0_1 00:17:25.193 20:22:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:25.193 20:22:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:25.193 20:22:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:25.193 20:22:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:25.193 20:22:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:25.193 20:22:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:25.193 20:22:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:25.193 20:22:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:25.193 20:22:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:25.193 20:22:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:25.193 20:22:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:25.193 20:22:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:25.193 20:22:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:25.193 20:22:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:25.193 20:22:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:25.193 20:22:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:25.193 20:22:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:25.193 20:22:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:25.193 20:22:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:25.193 20:22:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:25.193 20:22:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:25.193 20:22:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:25.193 20:22:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:25.193 20:22:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:25.193 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:25.193 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:17:25.193 00:17:25.193 --- 10.0.0.2 ping statistics --- 00:17:25.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:25.193 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:17:25.193 20:22:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:25.193 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:25.193 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.281 ms 00:17:25.193 00:17:25.193 --- 10.0.0.1 ping statistics --- 00:17:25.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:25.193 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:17:25.193 20:22:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:25.193 20:22:56 -- nvmf/common.sh@410 -- # return 0 00:17:25.193 20:22:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:25.193 20:22:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:25.193 20:22:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:25.193 20:22:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:25.193 20:22:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:25.193 20:22:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:25.193 20:22:56 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:25.193 20:22:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:25.193 20:22:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:25.193 20:22:56 -- common/autotest_common.sh@10 -- # set +x 00:17:25.193 20:22:56 -- nvmf/common.sh@469 -- # nvmfpid=3418739 00:17:25.193 20:22:56 -- nvmf/common.sh@470 -- # waitforlisten 3418739 00:17:25.193 20:22:56 -- common/autotest_common.sh@819 -- # '[' -z 3418739 ']' 00:17:25.193 20:22:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:25.193 20:22:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:25.193 20:22:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:25.193 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:25.193 20:22:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:25.193 20:22:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:25.193 20:22:56 -- common/autotest_common.sh@10 -- # set +x 00:17:25.193 [2024-07-22 20:22:56.741703] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:17:25.193 [2024-07-22 20:22:56.741745] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:25.193 EAL: No free 2048 kB hugepages reported on node 1 00:17:25.193 [2024-07-22 20:22:56.798032] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:25.193 [2024-07-22 20:22:56.874828] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:25.193 [2024-07-22 20:22:56.874947] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:25.193 [2024-07-22 20:22:56.874959] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:25.193 [2024-07-22 20:22:56.874968] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:25.193 [2024-07-22 20:22:56.875092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:25.193 [2024-07-22 20:22:56.875201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:25.193 [2024-07-22 20:22:56.875307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:25.193 [2024-07-22 20:22:56.875307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:25.805 20:22:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:25.805 20:22:57 -- common/autotest_common.sh@852 -- # return 0 00:17:25.805 20:22:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:25.805 20:22:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:25.805 20:22:57 -- common/autotest_common.sh@10 -- # set +x 00:17:25.805 20:22:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:25.805 20:22:57 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:25.805 20:22:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:25.805 20:22:57 -- common/autotest_common.sh@10 -- # set +x 00:17:25.805 [2024-07-22 20:22:57.566207] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:25.805 20:22:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:25.805 20:22:57 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:25.805 20:22:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:25.805 20:22:57 -- common/autotest_common.sh@10 -- # set +x 00:17:25.805 Malloc0 00:17:25.805 20:22:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:25.805 20:22:57 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:25.805 20:22:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:25.805 20:22:57 -- common/autotest_common.sh@10 -- # set +x 00:17:25.805 20:22:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:25.805 20:22:57 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:25.805 20:22:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:25.805 20:22:57 -- common/autotest_common.sh@10 -- # set +x 00:17:25.805 20:22:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:25.805 20:22:57 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:25.805 20:22:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:25.805 20:22:57 -- common/autotest_common.sh@10 -- # set +x 00:17:25.805 [2024-07-22 20:22:57.609759] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:25.805 20:22:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:25.805 20:22:57 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:25.805 20:22:57 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:25.805 20:22:57 -- nvmf/common.sh@520 -- # config=() 00:17:25.805 20:22:57 -- nvmf/common.sh@520 -- # local subsystem config 00:17:25.805 20:22:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:25.805 20:22:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:25.805 { 00:17:25.805 "params": { 00:17:25.805 "name": "Nvme$subsystem", 00:17:25.805 "trtype": "$TEST_TRANSPORT", 00:17:25.805 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:25.805 "adrfam": "ipv4", 00:17:25.805 "trsvcid": "$NVMF_PORT", 00:17:25.805 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:25.805 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:25.805 "hdgst": ${hdgst:-false}, 00:17:25.805 "ddgst": ${ddgst:-false} 00:17:25.805 }, 00:17:25.805 "method": "bdev_nvme_attach_controller" 00:17:25.805 } 00:17:25.805 EOF 00:17:25.805 )") 00:17:25.805 20:22:57 -- nvmf/common.sh@542 -- # cat 00:17:25.805 20:22:57 -- nvmf/common.sh@544 -- # jq . 00:17:25.805 20:22:57 -- nvmf/common.sh@545 -- # IFS=, 00:17:25.805 20:22:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:25.806 "params": { 00:17:25.806 "name": "Nvme1", 00:17:25.806 "trtype": "tcp", 00:17:25.806 "traddr": "10.0.0.2", 00:17:25.806 "adrfam": "ipv4", 00:17:25.806 "trsvcid": "4420", 00:17:25.806 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:25.806 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:25.806 "hdgst": false, 00:17:25.806 "ddgst": false 00:17:25.806 }, 00:17:25.806 "method": "bdev_nvme_attach_controller" 00:17:25.806 }' 00:17:25.806 [2024-07-22 20:22:57.653928] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:17:25.806 [2024-07-22 20:22:57.653979] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3418992 ] 00:17:25.806 EAL: No free 2048 kB hugepages reported on node 1 00:17:26.071 [2024-07-22 20:22:57.707926] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:26.071 [2024-07-22 20:22:57.782114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:26.071 [2024-07-22 20:22:57.782211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:26.071 [2024-07-22 20:22:57.782213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:26.071 [2024-07-22 20:22:57.930627] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:26.071 [2024-07-22 20:22:57.930658] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:26.071 I/O targets: 00:17:26.071 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:26.071 00:17:26.071 00:17:26.071 CUnit - A unit testing framework for C - Version 2.1-3 00:17:26.071 http://cunit.sourceforge.net/ 00:17:26.071 00:17:26.071 00:17:26.071 Suite: bdevio tests on: Nvme1n1 00:17:26.071 Test: blockdev write read block ...passed 00:17:26.330 Test: blockdev write zeroes read block ...passed 00:17:26.330 Test: blockdev write zeroes read no split ...passed 00:17:26.330 Test: blockdev write zeroes read split ...passed 00:17:26.330 Test: blockdev write zeroes read split partial ...passed 00:17:26.330 Test: blockdev reset ...[2024-07-22 20:22:58.163840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:26.330 [2024-07-22 20:22:58.163892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x891590 (9): Bad file descriptor 00:17:26.330 [2024-07-22 20:22:58.181984] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:26.330 passed 00:17:26.330 Test: blockdev write read 8 blocks ...passed 00:17:26.330 Test: blockdev write read size > 128k ...passed 00:17:26.330 Test: blockdev write read invalid size ...passed 00:17:26.590 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:26.590 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:26.590 Test: blockdev write read max offset ...passed 00:17:26.590 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:26.590 Test: blockdev writev readv 8 blocks ...passed 00:17:26.590 Test: blockdev writev readv 30 x 1block ...passed 00:17:26.590 Test: blockdev writev readv block ...passed 00:17:26.590 Test: blockdev writev readv size > 128k ...passed 00:17:26.590 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:26.590 Test: blockdev comparev and writev ...[2024-07-22 20:22:58.488351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:26.590 [2024-07-22 20:22:58.488379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:26.590 [2024-07-22 20:22:58.488392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:26.590 [2024-07-22 20:22:58.488400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:26.590 [2024-07-22 20:22:58.489005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:26.590 [2024-07-22 20:22:58.489017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:26.590 [2024-07-22 20:22:58.489028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:26.590 [2024-07-22 20:22:58.489036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:26.590 [2024-07-22 20:22:58.489524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:26.590 [2024-07-22 20:22:58.489536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:26.590 [2024-07-22 20:22:58.489548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:26.590 [2024-07-22 20:22:58.489556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:26.590 [2024-07-22 20:22:58.489963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:26.590 [2024-07-22 20:22:58.489974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:26.590 [2024-07-22 20:22:58.489986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:26.590 [2024-07-22 20:22:58.489994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:26.849 passed 00:17:26.849 Test: blockdev nvme passthru rw ...passed 00:17:26.849 Test: blockdev nvme passthru vendor specific ...[2024-07-22 20:22:58.572726] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:26.849 [2024-07-22 20:22:58.572744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:26.849 [2024-07-22 20:22:58.573023] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:26.849 [2024-07-22 20:22:58.573034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:26.849 [2024-07-22 20:22:58.573319] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:26.849 [2024-07-22 20:22:58.573331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:26.849 [2024-07-22 20:22:58.573609] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:26.849 [2024-07-22 20:22:58.573619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:26.849 passed 00:17:26.849 Test: blockdev nvme admin passthru ...passed 00:17:26.849 Test: blockdev copy ...passed 00:17:26.849 00:17:26.849 Run Summary: Type Total Ran Passed Failed Inactive 00:17:26.849 suites 1 1 n/a 0 0 00:17:26.849 tests 23 23 23 0 0 00:17:26.849 asserts 152 152 152 0 n/a 00:17:26.849 00:17:26.849 Elapsed time = 1.387 seconds 00:17:27.108 20:22:58 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:27.108 20:22:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:27.109 20:22:58 -- common/autotest_common.sh@10 -- # set +x 00:17:27.109 20:22:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:27.109 20:22:58 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:27.109 20:22:58 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:27.109 20:22:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:27.109 20:22:58 -- nvmf/common.sh@116 -- # sync 00:17:27.109 20:22:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:27.109 20:22:58 -- nvmf/common.sh@119 -- # set +e 00:17:27.109 20:22:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:27.109 20:22:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:27.109 rmmod nvme_tcp 00:17:27.109 rmmod nvme_fabrics 00:17:27.109 rmmod nvme_keyring 00:17:27.109 20:22:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:27.109 20:22:58 -- nvmf/common.sh@123 -- # set -e 00:17:27.109 20:22:58 -- nvmf/common.sh@124 -- # return 0 00:17:27.109 20:22:58 -- nvmf/common.sh@477 -- # '[' -n 3418739 ']' 00:17:27.109 20:22:58 -- nvmf/common.sh@478 -- # killprocess 3418739 00:17:27.109 20:22:58 -- common/autotest_common.sh@926 -- # '[' -z 3418739 ']' 00:17:27.109 20:22:58 -- common/autotest_common.sh@930 -- # kill -0 3418739 00:17:27.109 20:22:58 -- common/autotest_common.sh@931 -- # uname 00:17:27.109 20:22:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:27.109 20:22:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3418739 00:17:27.109 20:22:58 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:17:27.109 20:22:58 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:17:27.109 20:22:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3418739' 00:17:27.109 killing process with pid 3418739 00:17:27.109 20:22:58 -- common/autotest_common.sh@945 -- # kill 3418739 00:17:27.109 20:22:58 -- common/autotest_common.sh@950 -- # wait 3418739 00:17:27.368 20:22:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:27.368 20:22:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:27.368 20:22:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:27.368 20:22:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:27.368 20:22:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:27.368 20:22:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:27.368 20:22:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:27.368 20:22:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:29.905 20:23:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:29.905 00:17:29.905 real 0m9.872s 00:17:29.905 user 0m12.667s 00:17:29.905 sys 0m4.400s 00:17:29.905 20:23:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:29.905 20:23:01 -- common/autotest_common.sh@10 -- # set +x 00:17:29.905 ************************************ 00:17:29.905 END TEST nvmf_bdevio 00:17:29.905 ************************************ 00:17:29.905 20:23:01 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:29.905 20:23:01 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:29.905 20:23:01 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:17:29.905 20:23:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:29.905 20:23:01 -- common/autotest_common.sh@10 -- # set +x 00:17:29.905 ************************************ 00:17:29.905 START TEST nvmf_bdevio_no_huge 00:17:29.905 ************************************ 00:17:29.905 20:23:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:29.905 * Looking for test storage... 00:17:29.905 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:29.905 20:23:01 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:29.905 20:23:01 -- nvmf/common.sh@7 -- # uname -s 00:17:29.905 20:23:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:29.905 20:23:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:29.905 20:23:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:29.905 20:23:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:29.906 20:23:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:29.906 20:23:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:29.906 20:23:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:29.906 20:23:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:29.906 20:23:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:29.906 20:23:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:29.906 20:23:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:17:29.906 20:23:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:17:29.906 20:23:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:29.906 20:23:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:29.906 20:23:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:29.906 20:23:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:29.906 20:23:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:29.906 20:23:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:29.906 20:23:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:29.906 20:23:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:29.906 20:23:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:29.906 20:23:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:29.906 20:23:01 -- paths/export.sh@5 -- # export PATH 00:17:29.906 20:23:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:29.906 20:23:01 -- nvmf/common.sh@46 -- # : 0 00:17:29.906 20:23:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:29.906 20:23:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:29.906 20:23:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:29.906 20:23:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:29.906 20:23:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:29.906 20:23:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:29.906 20:23:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:29.906 20:23:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:29.906 20:23:01 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:29.906 20:23:01 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:29.906 20:23:01 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:29.906 20:23:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:29.906 20:23:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:29.906 20:23:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:29.906 20:23:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:29.906 20:23:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:29.906 20:23:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:29.906 20:23:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:29.906 20:23:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:29.906 20:23:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:29.906 20:23:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:29.906 20:23:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:29.906 20:23:01 -- common/autotest_common.sh@10 -- # set +x 00:17:35.183 20:23:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:35.183 20:23:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:35.183 20:23:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:35.183 20:23:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:35.183 20:23:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:35.183 20:23:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:35.183 20:23:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:35.183 20:23:06 -- nvmf/common.sh@294 -- # net_devs=() 00:17:35.183 20:23:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:35.183 20:23:06 -- nvmf/common.sh@295 -- # e810=() 00:17:35.183 20:23:06 -- nvmf/common.sh@295 -- # local -ga e810 00:17:35.183 20:23:06 -- nvmf/common.sh@296 -- # x722=() 00:17:35.183 20:23:06 -- nvmf/common.sh@296 -- # local -ga x722 00:17:35.183 20:23:06 -- nvmf/common.sh@297 -- # mlx=() 00:17:35.183 20:23:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:35.183 20:23:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:35.183 20:23:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:35.183 20:23:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:35.183 20:23:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:35.183 20:23:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:35.183 20:23:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:17:35.183 Found 0000:86:00.0 (0x8086 - 0x159b) 00:17:35.183 20:23:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:35.183 20:23:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:17:35.183 Found 0000:86:00.1 (0x8086 - 0x159b) 00:17:35.183 20:23:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:35.183 20:23:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:35.183 20:23:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:35.183 20:23:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:35.183 20:23:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:35.183 20:23:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:17:35.183 Found net devices under 0000:86:00.0: cvl_0_0 00:17:35.183 20:23:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:35.183 20:23:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:35.183 20:23:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:35.183 20:23:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:35.183 20:23:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:35.183 20:23:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:17:35.183 Found net devices under 0000:86:00.1: cvl_0_1 00:17:35.183 20:23:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:35.183 20:23:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:35.183 20:23:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:35.183 20:23:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:35.183 20:23:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:35.183 20:23:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:35.183 20:23:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:35.183 20:23:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:35.183 20:23:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:35.183 20:23:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:35.183 20:23:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:35.183 20:23:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:35.183 20:23:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:35.183 20:23:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:35.183 20:23:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:35.183 20:23:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:35.183 20:23:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:35.183 20:23:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:35.183 20:23:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:35.183 20:23:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:35.183 20:23:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:35.183 20:23:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:35.183 20:23:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:35.183 20:23:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:35.183 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:35.183 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.180 ms 00:17:35.183 00:17:35.183 --- 10.0.0.2 ping statistics --- 00:17:35.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:35.183 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:17:35.183 20:23:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:35.183 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:35.183 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.296 ms 00:17:35.183 00:17:35.183 --- 10.0.0.1 ping statistics --- 00:17:35.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:35.183 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:17:35.183 20:23:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:35.183 20:23:06 -- nvmf/common.sh@410 -- # return 0 00:17:35.183 20:23:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:35.183 20:23:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:35.183 20:23:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:35.183 20:23:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:35.183 20:23:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:35.183 20:23:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:35.183 20:23:06 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:35.183 20:23:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:35.183 20:23:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:35.183 20:23:06 -- common/autotest_common.sh@10 -- # set +x 00:17:35.183 20:23:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:35.183 20:23:06 -- nvmf/common.sh@469 -- # nvmfpid=3422583 00:17:35.183 20:23:06 -- nvmf/common.sh@470 -- # waitforlisten 3422583 00:17:35.183 20:23:06 -- common/autotest_common.sh@819 -- # '[' -z 3422583 ']' 00:17:35.183 20:23:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:35.183 20:23:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:35.183 20:23:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:35.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:35.183 20:23:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:35.183 20:23:06 -- common/autotest_common.sh@10 -- # set +x 00:17:35.183 [2024-07-22 20:23:06.800703] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:17:35.183 [2024-07-22 20:23:06.800746] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:35.183 [2024-07-22 20:23:06.862306] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:35.183 [2024-07-22 20:23:06.945038] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:35.183 [2024-07-22 20:23:06.945146] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:35.183 [2024-07-22 20:23:06.945154] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:35.183 [2024-07-22 20:23:06.945161] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:35.183 [2024-07-22 20:23:06.945208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:35.183 [2024-07-22 20:23:06.945317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:35.183 [2024-07-22 20:23:06.945425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:35.183 [2024-07-22 20:23:06.945425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:35.751 20:23:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:35.751 20:23:07 -- common/autotest_common.sh@852 -- # return 0 00:17:35.751 20:23:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:35.751 20:23:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:35.751 20:23:07 -- common/autotest_common.sh@10 -- # set +x 00:17:35.751 20:23:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:35.751 20:23:07 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:35.752 20:23:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:35.752 20:23:07 -- common/autotest_common.sh@10 -- # set +x 00:17:35.752 [2024-07-22 20:23:07.660633] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:35.752 20:23:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:35.752 20:23:07 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:35.752 20:23:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:35.752 20:23:07 -- common/autotest_common.sh@10 -- # set +x 00:17:35.752 Malloc0 00:17:35.752 20:23:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:35.752 20:23:07 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:35.752 20:23:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:35.752 20:23:07 -- common/autotest_common.sh@10 -- # set +x 00:17:36.011 20:23:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.011 20:23:07 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:36.011 20:23:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.011 20:23:07 -- common/autotest_common.sh@10 -- # set +x 00:17:36.011 20:23:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.011 20:23:07 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:36.011 20:23:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.011 20:23:07 -- common/autotest_common.sh@10 -- # set +x 00:17:36.011 [2024-07-22 20:23:07.704901] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:36.011 20:23:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.011 20:23:07 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:36.011 20:23:07 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:36.011 20:23:07 -- nvmf/common.sh@520 -- # config=() 00:17:36.011 20:23:07 -- nvmf/common.sh@520 -- # local subsystem config 00:17:36.011 20:23:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:36.011 20:23:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:36.011 { 00:17:36.011 "params": { 00:17:36.011 "name": "Nvme$subsystem", 00:17:36.011 "trtype": "$TEST_TRANSPORT", 00:17:36.011 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:36.011 "adrfam": "ipv4", 00:17:36.011 "trsvcid": "$NVMF_PORT", 00:17:36.011 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:36.011 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:36.011 "hdgst": ${hdgst:-false}, 00:17:36.011 "ddgst": ${ddgst:-false} 00:17:36.011 }, 00:17:36.011 "method": "bdev_nvme_attach_controller" 00:17:36.011 } 00:17:36.011 EOF 00:17:36.011 )") 00:17:36.011 20:23:07 -- nvmf/common.sh@542 -- # cat 00:17:36.011 20:23:07 -- nvmf/common.sh@544 -- # jq . 00:17:36.011 20:23:07 -- nvmf/common.sh@545 -- # IFS=, 00:17:36.011 20:23:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:36.011 "params": { 00:17:36.011 "name": "Nvme1", 00:17:36.011 "trtype": "tcp", 00:17:36.011 "traddr": "10.0.0.2", 00:17:36.011 "adrfam": "ipv4", 00:17:36.011 "trsvcid": "4420", 00:17:36.011 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:36.011 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:36.011 "hdgst": false, 00:17:36.011 "ddgst": false 00:17:36.011 }, 00:17:36.011 "method": "bdev_nvme_attach_controller" 00:17:36.011 }' 00:17:36.011 [2024-07-22 20:23:07.750651] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:17:36.011 [2024-07-22 20:23:07.750701] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3422793 ] 00:17:36.011 [2024-07-22 20:23:07.808679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:36.011 [2024-07-22 20:23:07.892420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:36.011 [2024-07-22 20:23:07.892519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:36.011 [2024-07-22 20:23:07.892520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:36.271 [2024-07-22 20:23:08.032804] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:36.271 [2024-07-22 20:23:08.032835] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:36.271 I/O targets: 00:17:36.271 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:36.271 00:17:36.271 00:17:36.271 CUnit - A unit testing framework for C - Version 2.1-3 00:17:36.271 http://cunit.sourceforge.net/ 00:17:36.271 00:17:36.271 00:17:36.271 Suite: bdevio tests on: Nvme1n1 00:17:36.271 Test: blockdev write read block ...passed 00:17:36.271 Test: blockdev write zeroes read block ...passed 00:17:36.271 Test: blockdev write zeroes read no split ...passed 00:17:36.271 Test: blockdev write zeroes read split ...passed 00:17:36.530 Test: blockdev write zeroes read split partial ...passed 00:17:36.530 Test: blockdev reset ...[2024-07-22 20:23:08.274374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:36.530 [2024-07-22 20:23:08.274438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x224eea0 (9): Bad file descriptor 00:17:36.530 [2024-07-22 20:23:08.293252] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:36.530 passed 00:17:36.530 Test: blockdev write read 8 blocks ...passed 00:17:36.530 Test: blockdev write read size > 128k ...passed 00:17:36.530 Test: blockdev write read invalid size ...passed 00:17:36.530 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:36.530 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:36.530 Test: blockdev write read max offset ...passed 00:17:36.530 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:36.530 Test: blockdev writev readv 8 blocks ...passed 00:17:36.530 Test: blockdev writev readv 30 x 1block ...passed 00:17:36.789 Test: blockdev writev readv block ...passed 00:17:36.789 Test: blockdev writev readv size > 128k ...passed 00:17:36.789 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:36.789 Test: blockdev comparev and writev ...[2024-07-22 20:23:08.475315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:36.789 [2024-07-22 20:23:08.475342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.475356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:36.789 [2024-07-22 20:23:08.475364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.475791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:36.789 [2024-07-22 20:23:08.475803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.475815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:36.789 [2024-07-22 20:23:08.475822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.476247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:36.789 [2024-07-22 20:23:08.476259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.476270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:36.789 [2024-07-22 20:23:08.476278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.476688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:36.789 [2024-07-22 20:23:08.476699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.476710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:36.789 [2024-07-22 20:23:08.476718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:36.789 passed 00:17:36.789 Test: blockdev nvme passthru rw ...passed 00:17:36.789 Test: blockdev nvme passthru vendor specific ...[2024-07-22 20:23:08.558680] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:36.789 [2024-07-22 20:23:08.558696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.558986] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:36.789 [2024-07-22 20:23:08.559000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.559283] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:36.789 [2024-07-22 20:23:08.559295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:36.789 [2024-07-22 20:23:08.559571] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:36.789 [2024-07-22 20:23:08.559582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:36.789 passed 00:17:36.789 Test: blockdev nvme admin passthru ...passed 00:17:36.789 Test: blockdev copy ...passed 00:17:36.789 00:17:36.789 Run Summary: Type Total Ran Passed Failed Inactive 00:17:36.789 suites 1 1 n/a 0 0 00:17:36.789 tests 23 23 23 0 0 00:17:36.789 asserts 152 152 152 0 n/a 00:17:36.789 00:17:36.789 Elapsed time = 1.167 seconds 00:17:37.047 20:23:08 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:37.047 20:23:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:37.047 20:23:08 -- common/autotest_common.sh@10 -- # set +x 00:17:37.047 20:23:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:37.047 20:23:08 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:37.047 20:23:08 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:37.047 20:23:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:37.047 20:23:08 -- nvmf/common.sh@116 -- # sync 00:17:37.047 20:23:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:37.047 20:23:08 -- nvmf/common.sh@119 -- # set +e 00:17:37.047 20:23:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:37.047 20:23:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:37.047 rmmod nvme_tcp 00:17:37.047 rmmod nvme_fabrics 00:17:37.047 rmmod nvme_keyring 00:17:37.047 20:23:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:37.306 20:23:08 -- nvmf/common.sh@123 -- # set -e 00:17:37.306 20:23:08 -- nvmf/common.sh@124 -- # return 0 00:17:37.306 20:23:08 -- nvmf/common.sh@477 -- # '[' -n 3422583 ']' 00:17:37.306 20:23:08 -- nvmf/common.sh@478 -- # killprocess 3422583 00:17:37.306 20:23:08 -- common/autotest_common.sh@926 -- # '[' -z 3422583 ']' 00:17:37.306 20:23:08 -- common/autotest_common.sh@930 -- # kill -0 3422583 00:17:37.306 20:23:08 -- common/autotest_common.sh@931 -- # uname 00:17:37.306 20:23:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:37.306 20:23:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3422583 00:17:37.306 20:23:09 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:17:37.306 20:23:09 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:17:37.306 20:23:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3422583' 00:17:37.306 killing process with pid 3422583 00:17:37.306 20:23:09 -- common/autotest_common.sh@945 -- # kill 3422583 00:17:37.306 20:23:09 -- common/autotest_common.sh@950 -- # wait 3422583 00:17:37.564 20:23:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:37.564 20:23:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:37.564 20:23:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:37.564 20:23:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:37.564 20:23:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:37.564 20:23:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:37.564 20:23:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:37.564 20:23:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.488 20:23:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:39.488 00:17:39.488 real 0m10.154s 00:17:39.488 user 0m12.914s 00:17:39.488 sys 0m4.865s 00:17:39.748 20:23:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:39.748 20:23:11 -- common/autotest_common.sh@10 -- # set +x 00:17:39.748 ************************************ 00:17:39.748 END TEST nvmf_bdevio_no_huge 00:17:39.748 ************************************ 00:17:39.748 20:23:11 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:39.748 20:23:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:39.748 20:23:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:39.748 20:23:11 -- common/autotest_common.sh@10 -- # set +x 00:17:39.748 ************************************ 00:17:39.748 START TEST nvmf_tls 00:17:39.748 ************************************ 00:17:39.748 20:23:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:39.748 * Looking for test storage... 00:17:39.748 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:39.748 20:23:11 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:39.748 20:23:11 -- nvmf/common.sh@7 -- # uname -s 00:17:39.748 20:23:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:39.748 20:23:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:39.748 20:23:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:39.748 20:23:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:39.748 20:23:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:39.748 20:23:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:39.748 20:23:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:39.748 20:23:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:39.748 20:23:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:39.748 20:23:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:39.748 20:23:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:17:39.748 20:23:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:17:39.748 20:23:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:39.748 20:23:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:39.748 20:23:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:39.748 20:23:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:39.748 20:23:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:39.748 20:23:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:39.748 20:23:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:39.748 20:23:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.748 20:23:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.748 20:23:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.748 20:23:11 -- paths/export.sh@5 -- # export PATH 00:17:39.748 20:23:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.748 20:23:11 -- nvmf/common.sh@46 -- # : 0 00:17:39.748 20:23:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:39.748 20:23:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:39.748 20:23:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:39.748 20:23:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:39.748 20:23:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:39.748 20:23:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:39.748 20:23:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:39.748 20:23:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:39.748 20:23:11 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:39.748 20:23:11 -- target/tls.sh@71 -- # nvmftestinit 00:17:39.748 20:23:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:39.748 20:23:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:39.748 20:23:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:39.748 20:23:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:39.748 20:23:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:39.748 20:23:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:39.748 20:23:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:39.748 20:23:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.748 20:23:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:39.748 20:23:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:39.748 20:23:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:39.748 20:23:11 -- common/autotest_common.sh@10 -- # set +x 00:17:45.023 20:23:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:45.023 20:23:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:45.023 20:23:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:45.023 20:23:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:45.023 20:23:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:45.023 20:23:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:45.023 20:23:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:45.023 20:23:16 -- nvmf/common.sh@294 -- # net_devs=() 00:17:45.023 20:23:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:45.023 20:23:16 -- nvmf/common.sh@295 -- # e810=() 00:17:45.023 20:23:16 -- nvmf/common.sh@295 -- # local -ga e810 00:17:45.023 20:23:16 -- nvmf/common.sh@296 -- # x722=() 00:17:45.023 20:23:16 -- nvmf/common.sh@296 -- # local -ga x722 00:17:45.023 20:23:16 -- nvmf/common.sh@297 -- # mlx=() 00:17:45.023 20:23:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:45.023 20:23:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:45.023 20:23:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:45.023 20:23:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:45.023 20:23:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:45.024 20:23:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:45.024 20:23:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:45.024 20:23:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:17:45.024 Found 0000:86:00.0 (0x8086 - 0x159b) 00:17:45.024 20:23:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:45.024 20:23:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:17:45.024 Found 0000:86:00.1 (0x8086 - 0x159b) 00:17:45.024 20:23:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:45.024 20:23:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:45.024 20:23:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:45.024 20:23:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:45.024 20:23:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:45.024 20:23:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:17:45.024 Found net devices under 0000:86:00.0: cvl_0_0 00:17:45.024 20:23:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:45.024 20:23:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:45.024 20:23:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:45.024 20:23:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:45.024 20:23:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:45.024 20:23:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:17:45.024 Found net devices under 0000:86:00.1: cvl_0_1 00:17:45.024 20:23:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:45.024 20:23:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:45.024 20:23:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:45.024 20:23:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:45.024 20:23:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:45.024 20:23:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:45.024 20:23:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:45.024 20:23:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:45.024 20:23:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:45.024 20:23:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:45.024 20:23:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:45.024 20:23:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:45.024 20:23:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:45.024 20:23:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:45.024 20:23:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:45.024 20:23:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:45.024 20:23:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:45.024 20:23:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:45.024 20:23:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:45.024 20:23:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:45.024 20:23:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:45.024 20:23:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:45.024 20:23:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:45.024 20:23:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:45.024 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:45.024 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.190 ms 00:17:45.024 00:17:45.024 --- 10.0.0.2 ping statistics --- 00:17:45.024 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:45.024 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:17:45.024 20:23:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:45.024 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:45.024 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.456 ms 00:17:45.024 00:17:45.024 --- 10.0.0.1 ping statistics --- 00:17:45.024 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:45.024 rtt min/avg/max/mdev = 0.456/0.456/0.456/0.000 ms 00:17:45.024 20:23:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:45.024 20:23:16 -- nvmf/common.sh@410 -- # return 0 00:17:45.024 20:23:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:45.024 20:23:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:45.024 20:23:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:45.024 20:23:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:45.024 20:23:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:45.024 20:23:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:45.024 20:23:16 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:45.024 20:23:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:45.024 20:23:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:45.024 20:23:16 -- common/autotest_common.sh@10 -- # set +x 00:17:45.024 20:23:16 -- nvmf/common.sh@469 -- # nvmfpid=3426488 00:17:45.024 20:23:16 -- nvmf/common.sh@470 -- # waitforlisten 3426488 00:17:45.024 20:23:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:45.024 20:23:16 -- common/autotest_common.sh@819 -- # '[' -z 3426488 ']' 00:17:45.024 20:23:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:45.024 20:23:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:45.024 20:23:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:45.024 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:45.024 20:23:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:45.024 20:23:16 -- common/autotest_common.sh@10 -- # set +x 00:17:45.024 [2024-07-22 20:23:16.934939] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:17:45.024 [2024-07-22 20:23:16.934986] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:45.283 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.283 [2024-07-22 20:23:16.993557] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.283 [2024-07-22 20:23:17.071799] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:45.283 [2024-07-22 20:23:17.071902] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:45.283 [2024-07-22 20:23:17.071910] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:45.283 [2024-07-22 20:23:17.071917] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:45.283 [2024-07-22 20:23:17.071932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:45.851 20:23:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:45.851 20:23:17 -- common/autotest_common.sh@852 -- # return 0 00:17:45.851 20:23:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:45.851 20:23:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:45.851 20:23:17 -- common/autotest_common.sh@10 -- # set +x 00:17:45.851 20:23:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:45.851 20:23:17 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:45.851 20:23:17 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:46.110 true 00:17:46.110 20:23:17 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:46.110 20:23:17 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:46.368 20:23:18 -- target/tls.sh@82 -- # version=0 00:17:46.368 20:23:18 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:46.368 20:23:18 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:46.368 20:23:18 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:46.368 20:23:18 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:46.627 20:23:18 -- target/tls.sh@90 -- # version=13 00:17:46.627 20:23:18 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:46.627 20:23:18 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:46.886 20:23:18 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:46.886 20:23:18 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:46.886 20:23:18 -- target/tls.sh@98 -- # version=7 00:17:46.886 20:23:18 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:46.886 20:23:18 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:46.886 20:23:18 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:47.146 20:23:18 -- target/tls.sh@105 -- # ktls=false 00:17:47.146 20:23:18 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:47.146 20:23:18 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:47.405 20:23:19 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:47.405 20:23:19 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:47.405 20:23:19 -- target/tls.sh@113 -- # ktls=true 00:17:47.405 20:23:19 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:47.405 20:23:19 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:47.664 20:23:19 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:47.664 20:23:19 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:47.664 20:23:19 -- target/tls.sh@121 -- # ktls=false 00:17:47.664 20:23:19 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:47.664 20:23:19 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:47.664 20:23:19 -- target/tls.sh@49 -- # local key hash crc 00:17:47.664 20:23:19 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:47.664 20:23:19 -- target/tls.sh@51 -- # hash=01 00:17:47.664 20:23:19 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:47.923 20:23:19 -- target/tls.sh@52 -- # gzip -1 -c 00:17:47.923 20:23:19 -- target/tls.sh@52 -- # head -c 4 00:17:47.923 20:23:19 -- target/tls.sh@52 -- # tail -c8 00:17:47.923 20:23:19 -- target/tls.sh@52 -- # crc='p$H�' 00:17:47.923 20:23:19 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:47.923 20:23:19 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:47.923 20:23:19 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:47.923 20:23:19 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:47.923 20:23:19 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:47.923 20:23:19 -- target/tls.sh@49 -- # local key hash crc 00:17:47.923 20:23:19 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:47.923 20:23:19 -- target/tls.sh@51 -- # hash=01 00:17:47.923 20:23:19 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:47.923 20:23:19 -- target/tls.sh@52 -- # tail -c8 00:17:47.924 20:23:19 -- target/tls.sh@52 -- # gzip -1 -c 00:17:47.924 20:23:19 -- target/tls.sh@52 -- # head -c 4 00:17:47.924 20:23:19 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:47.924 20:23:19 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:47.924 20:23:19 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:47.924 20:23:19 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:47.924 20:23:19 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:47.924 20:23:19 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:47.924 20:23:19 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.924 20:23:19 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:47.924 20:23:19 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:47.924 20:23:19 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:47.924 20:23:19 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.924 20:23:19 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:47.924 20:23:19 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:48.183 20:23:20 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.183 20:23:20 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.183 20:23:20 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:48.442 [2024-07-22 20:23:20.190045] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:48.442 20:23:20 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:48.442 20:23:20 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:48.701 [2024-07-22 20:23:20.514897] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:48.701 [2024-07-22 20:23:20.515079] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:48.701 20:23:20 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:48.960 malloc0 00:17:48.960 20:23:20 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:48.960 20:23:20 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.218 20:23:21 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.218 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.237 Initializing NVMe Controllers 00:17:59.237 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:59.237 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:59.237 Initialization complete. Launching workers. 00:17:59.237 ======================================================== 00:17:59.237 Latency(us) 00:17:59.237 Device Information : IOPS MiB/s Average min max 00:17:59.237 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 17040.47 66.56 3756.13 799.03 5144.82 00:17:59.237 ======================================================== 00:17:59.237 Total : 17040.47 66.56 3756.13 799.03 5144.82 00:17:59.237 00:17:59.237 20:23:31 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:59.237 20:23:31 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:59.237 20:23:31 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:59.237 20:23:31 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:59.237 20:23:31 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:59.237 20:23:31 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:59.237 20:23:31 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:59.237 20:23:31 -- target/tls.sh@28 -- # bdevperf_pid=3428954 00:17:59.237 20:23:31 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:59.237 20:23:31 -- target/tls.sh@31 -- # waitforlisten 3428954 /var/tmp/bdevperf.sock 00:17:59.237 20:23:31 -- common/autotest_common.sh@819 -- # '[' -z 3428954 ']' 00:17:59.237 20:23:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:59.237 20:23:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:59.237 20:23:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:59.237 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:59.237 20:23:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:59.237 20:23:31 -- common/autotest_common.sh@10 -- # set +x 00:17:59.237 [2024-07-22 20:23:31.131788] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:17:59.237 [2024-07-22 20:23:31.131838] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3428954 ] 00:17:59.237 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.496 [2024-07-22 20:23:31.180179] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.496 [2024-07-22 20:23:31.252081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:00.064 20:23:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:00.064 20:23:31 -- common/autotest_common.sh@852 -- # return 0 00:18:00.064 20:23:31 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:00.323 [2024-07-22 20:23:32.093494] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:00.323 TLSTESTn1 00:18:00.323 20:23:32 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:00.590 Running I/O for 10 seconds... 00:18:10.579 00:18:10.579 Latency(us) 00:18:10.579 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.579 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:10.579 Verification LBA range: start 0x0 length 0x2000 00:18:10.579 TLSTESTn1 : 10.03 2001.19 7.82 0.00 0.00 63884.33 10827.69 94371.84 00:18:10.579 =================================================================================================================== 00:18:10.579 Total : 2001.19 7.82 0.00 0.00 63884.33 10827.69 94371.84 00:18:10.579 0 00:18:10.579 20:23:42 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:10.579 20:23:42 -- target/tls.sh@45 -- # killprocess 3428954 00:18:10.579 20:23:42 -- common/autotest_common.sh@926 -- # '[' -z 3428954 ']' 00:18:10.579 20:23:42 -- common/autotest_common.sh@930 -- # kill -0 3428954 00:18:10.579 20:23:42 -- common/autotest_common.sh@931 -- # uname 00:18:10.579 20:23:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:10.579 20:23:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3428954 00:18:10.579 20:23:42 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:10.579 20:23:42 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:10.579 20:23:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3428954' 00:18:10.579 killing process with pid 3428954 00:18:10.579 20:23:42 -- common/autotest_common.sh@945 -- # kill 3428954 00:18:10.579 Received shutdown signal, test time was about 10.000000 seconds 00:18:10.579 00:18:10.579 Latency(us) 00:18:10.579 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.579 =================================================================================================================== 00:18:10.579 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:10.579 20:23:42 -- common/autotest_common.sh@950 -- # wait 3428954 00:18:10.839 20:23:42 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:10.839 20:23:42 -- common/autotest_common.sh@640 -- # local es=0 00:18:10.839 20:23:42 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:10.839 20:23:42 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:18:10.839 20:23:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:10.839 20:23:42 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:18:10.839 20:23:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:10.839 20:23:42 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:10.839 20:23:42 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:10.839 20:23:42 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:10.839 20:23:42 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:10.839 20:23:42 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:18:10.839 20:23:42 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:10.839 20:23:42 -- target/tls.sh@28 -- # bdevperf_pid=3430826 00:18:10.839 20:23:42 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:10.839 20:23:42 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:10.839 20:23:42 -- target/tls.sh@31 -- # waitforlisten 3430826 /var/tmp/bdevperf.sock 00:18:10.839 20:23:42 -- common/autotest_common.sh@819 -- # '[' -z 3430826 ']' 00:18:10.839 20:23:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:10.839 20:23:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:10.839 20:23:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:10.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:10.839 20:23:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:10.839 20:23:42 -- common/autotest_common.sh@10 -- # set +x 00:18:10.839 [2024-07-22 20:23:42.636856] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:10.839 [2024-07-22 20:23:42.636907] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3430826 ] 00:18:10.839 EAL: No free 2048 kB hugepages reported on node 1 00:18:10.839 [2024-07-22 20:23:42.687186] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:10.839 [2024-07-22 20:23:42.752076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:11.776 20:23:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:11.776 20:23:43 -- common/autotest_common.sh@852 -- # return 0 00:18:11.776 20:23:43 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:11.776 [2024-07-22 20:23:43.594011] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:11.776 [2024-07-22 20:23:43.598847] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:18:11.776 [2024-07-22 20:23:43.599470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12f50c0 (107): Transport endpoint is not connected 00:18:11.776 [2024-07-22 20:23:43.600462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12f50c0 (9): Bad file descriptor 00:18:11.776 [2024-07-22 20:23:43.601464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:11.776 [2024-07-22 20:23:43.601474] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:18:11.776 [2024-07-22 20:23:43.601481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:11.776 request: 00:18:11.776 { 00:18:11.776 "name": "TLSTEST", 00:18:11.776 "trtype": "tcp", 00:18:11.776 "traddr": "10.0.0.2", 00:18:11.776 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:11.776 "adrfam": "ipv4", 00:18:11.776 "trsvcid": "4420", 00:18:11.776 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:11.776 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:18:11.776 "method": "bdev_nvme_attach_controller", 00:18:11.776 "req_id": 1 00:18:11.776 } 00:18:11.776 Got JSON-RPC error response 00:18:11.776 response: 00:18:11.776 { 00:18:11.776 "code": -32602, 00:18:11.776 "message": "Invalid parameters" 00:18:11.776 } 00:18:11.776 20:23:43 -- target/tls.sh@36 -- # killprocess 3430826 00:18:11.776 20:23:43 -- common/autotest_common.sh@926 -- # '[' -z 3430826 ']' 00:18:11.776 20:23:43 -- common/autotest_common.sh@930 -- # kill -0 3430826 00:18:11.776 20:23:43 -- common/autotest_common.sh@931 -- # uname 00:18:11.776 20:23:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:11.776 20:23:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3430826 00:18:11.776 20:23:43 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:11.776 20:23:43 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:11.776 20:23:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3430826' 00:18:11.776 killing process with pid 3430826 00:18:11.776 20:23:43 -- common/autotest_common.sh@945 -- # kill 3430826 00:18:11.776 Received shutdown signal, test time was about 10.000000 seconds 00:18:11.776 00:18:11.776 Latency(us) 00:18:11.776 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:11.776 =================================================================================================================== 00:18:11.776 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:11.776 20:23:43 -- common/autotest_common.sh@950 -- # wait 3430826 00:18:12.035 20:23:43 -- target/tls.sh@37 -- # return 1 00:18:12.035 20:23:43 -- common/autotest_common.sh@643 -- # es=1 00:18:12.035 20:23:43 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:12.035 20:23:43 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:12.035 20:23:43 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:12.035 20:23:43 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:12.035 20:23:43 -- common/autotest_common.sh@640 -- # local es=0 00:18:12.035 20:23:43 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:12.035 20:23:43 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:18:12.035 20:23:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:12.035 20:23:43 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:18:12.035 20:23:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:12.035 20:23:43 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:12.035 20:23:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:12.035 20:23:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:12.036 20:23:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:18:12.036 20:23:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:18:12.036 20:23:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:12.036 20:23:43 -- target/tls.sh@28 -- # bdevperf_pid=3431071 00:18:12.036 20:23:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:12.036 20:23:43 -- target/tls.sh@31 -- # waitforlisten 3431071 /var/tmp/bdevperf.sock 00:18:12.036 20:23:43 -- common/autotest_common.sh@819 -- # '[' -z 3431071 ']' 00:18:12.036 20:23:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:12.036 20:23:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:12.036 20:23:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:12.036 20:23:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:12.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:12.036 20:23:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:12.036 20:23:43 -- common/autotest_common.sh@10 -- # set +x 00:18:12.036 [2024-07-22 20:23:43.904546] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:12.036 [2024-07-22 20:23:43.904597] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3431071 ] 00:18:12.036 EAL: No free 2048 kB hugepages reported on node 1 00:18:12.036 [2024-07-22 20:23:43.954633] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:12.295 [2024-07-22 20:23:44.022121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:12.863 20:23:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:12.863 20:23:44 -- common/autotest_common.sh@852 -- # return 0 00:18:12.863 20:23:44 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:13.122 [2024-07-22 20:23:44.843539] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:13.122 [2024-07-22 20:23:44.851268] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:18:13.122 [2024-07-22 20:23:44.851293] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:18:13.122 [2024-07-22 20:23:44.851317] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:18:13.122 [2024-07-22 20:23:44.852010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x85b0c0 (107): Transport endpoint is not connected 00:18:13.122 [2024-07-22 20:23:44.853003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x85b0c0 (9): Bad file descriptor 00:18:13.122 [2024-07-22 20:23:44.854004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:13.122 [2024-07-22 20:23:44.854015] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:18:13.122 [2024-07-22 20:23:44.854022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:13.122 request: 00:18:13.122 { 00:18:13.122 "name": "TLSTEST", 00:18:13.122 "trtype": "tcp", 00:18:13.122 "traddr": "10.0.0.2", 00:18:13.122 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:13.122 "adrfam": "ipv4", 00:18:13.122 "trsvcid": "4420", 00:18:13.122 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:13.122 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:18:13.122 "method": "bdev_nvme_attach_controller", 00:18:13.122 "req_id": 1 00:18:13.122 } 00:18:13.122 Got JSON-RPC error response 00:18:13.122 response: 00:18:13.122 { 00:18:13.122 "code": -32602, 00:18:13.122 "message": "Invalid parameters" 00:18:13.122 } 00:18:13.122 20:23:44 -- target/tls.sh@36 -- # killprocess 3431071 00:18:13.122 20:23:44 -- common/autotest_common.sh@926 -- # '[' -z 3431071 ']' 00:18:13.122 20:23:44 -- common/autotest_common.sh@930 -- # kill -0 3431071 00:18:13.122 20:23:44 -- common/autotest_common.sh@931 -- # uname 00:18:13.122 20:23:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:13.122 20:23:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3431071 00:18:13.122 20:23:44 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:13.122 20:23:44 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:13.122 20:23:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3431071' 00:18:13.122 killing process with pid 3431071 00:18:13.122 20:23:44 -- common/autotest_common.sh@945 -- # kill 3431071 00:18:13.122 Received shutdown signal, test time was about 10.000000 seconds 00:18:13.122 00:18:13.122 Latency(us) 00:18:13.122 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:13.122 =================================================================================================================== 00:18:13.122 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:13.122 20:23:44 -- common/autotest_common.sh@950 -- # wait 3431071 00:18:13.393 20:23:45 -- target/tls.sh@37 -- # return 1 00:18:13.393 20:23:45 -- common/autotest_common.sh@643 -- # es=1 00:18:13.393 20:23:45 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:13.393 20:23:45 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:13.393 20:23:45 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:13.393 20:23:45 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:13.393 20:23:45 -- common/autotest_common.sh@640 -- # local es=0 00:18:13.393 20:23:45 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:13.393 20:23:45 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:18:13.393 20:23:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:13.393 20:23:45 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:18:13.393 20:23:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:13.393 20:23:45 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:13.393 20:23:45 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:13.393 20:23:45 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:18:13.393 20:23:45 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:13.393 20:23:45 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:18:13.393 20:23:45 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:13.393 20:23:45 -- target/tls.sh@28 -- # bdevperf_pid=3431291 00:18:13.393 20:23:45 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:13.393 20:23:45 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:13.394 20:23:45 -- target/tls.sh@31 -- # waitforlisten 3431291 /var/tmp/bdevperf.sock 00:18:13.394 20:23:45 -- common/autotest_common.sh@819 -- # '[' -z 3431291 ']' 00:18:13.394 20:23:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:13.394 20:23:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:13.394 20:23:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:13.394 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:13.394 20:23:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:13.394 20:23:45 -- common/autotest_common.sh@10 -- # set +x 00:18:13.394 [2024-07-22 20:23:45.159490] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:13.394 [2024-07-22 20:23:45.159538] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3431291 ] 00:18:13.394 EAL: No free 2048 kB hugepages reported on node 1 00:18:13.394 [2024-07-22 20:23:45.210055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:13.394 [2024-07-22 20:23:45.275083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:14.335 20:23:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:14.335 20:23:45 -- common/autotest_common.sh@852 -- # return 0 00:18:14.335 20:23:45 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:14.335 [2024-07-22 20:23:46.089830] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:14.335 [2024-07-22 20:23:46.094521] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:18:14.335 [2024-07-22 20:23:46.094542] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:18:14.335 [2024-07-22 20:23:46.094565] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:18:14.335 [2024-07-22 20:23:46.095216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcfd0c0 (107): Transport endpoint is not connected 00:18:14.335 [2024-07-22 20:23:46.096207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcfd0c0 (9): Bad file descriptor 00:18:14.335 [2024-07-22 20:23:46.097208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:18:14.335 [2024-07-22 20:23:46.097218] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:18:14.335 [2024-07-22 20:23:46.097225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:18:14.335 request: 00:18:14.335 { 00:18:14.335 "name": "TLSTEST", 00:18:14.335 "trtype": "tcp", 00:18:14.335 "traddr": "10.0.0.2", 00:18:14.335 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.335 "adrfam": "ipv4", 00:18:14.335 "trsvcid": "4420", 00:18:14.335 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:14.335 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:18:14.335 "method": "bdev_nvme_attach_controller", 00:18:14.335 "req_id": 1 00:18:14.335 } 00:18:14.335 Got JSON-RPC error response 00:18:14.335 response: 00:18:14.335 { 00:18:14.335 "code": -32602, 00:18:14.335 "message": "Invalid parameters" 00:18:14.335 } 00:18:14.335 20:23:46 -- target/tls.sh@36 -- # killprocess 3431291 00:18:14.335 20:23:46 -- common/autotest_common.sh@926 -- # '[' -z 3431291 ']' 00:18:14.335 20:23:46 -- common/autotest_common.sh@930 -- # kill -0 3431291 00:18:14.335 20:23:46 -- common/autotest_common.sh@931 -- # uname 00:18:14.335 20:23:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:14.335 20:23:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3431291 00:18:14.335 20:23:46 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:14.335 20:23:46 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:14.335 20:23:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3431291' 00:18:14.335 killing process with pid 3431291 00:18:14.335 20:23:46 -- common/autotest_common.sh@945 -- # kill 3431291 00:18:14.335 Received shutdown signal, test time was about 10.000000 seconds 00:18:14.335 00:18:14.335 Latency(us) 00:18:14.335 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:14.335 =================================================================================================================== 00:18:14.335 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:14.335 20:23:46 -- common/autotest_common.sh@950 -- # wait 3431291 00:18:14.595 20:23:46 -- target/tls.sh@37 -- # return 1 00:18:14.595 20:23:46 -- common/autotest_common.sh@643 -- # es=1 00:18:14.595 20:23:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:14.595 20:23:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:14.595 20:23:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:14.595 20:23:46 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:18:14.595 20:23:46 -- common/autotest_common.sh@640 -- # local es=0 00:18:14.595 20:23:46 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:18:14.595 20:23:46 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:18:14.595 20:23:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:14.595 20:23:46 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:18:14.595 20:23:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:14.595 20:23:46 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:18:14.595 20:23:46 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:14.595 20:23:46 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:14.595 20:23:46 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:14.595 20:23:46 -- target/tls.sh@23 -- # psk= 00:18:14.595 20:23:46 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:14.595 20:23:46 -- target/tls.sh@28 -- # bdevperf_pid=3431439 00:18:14.595 20:23:46 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:14.595 20:23:46 -- target/tls.sh@31 -- # waitforlisten 3431439 /var/tmp/bdevperf.sock 00:18:14.595 20:23:46 -- common/autotest_common.sh@819 -- # '[' -z 3431439 ']' 00:18:14.595 20:23:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:14.595 20:23:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:14.595 20:23:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:14.595 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:14.595 20:23:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:14.595 20:23:46 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:14.595 20:23:46 -- common/autotest_common.sh@10 -- # set +x 00:18:14.595 [2024-07-22 20:23:46.397605] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:14.595 [2024-07-22 20:23:46.397655] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3431439 ] 00:18:14.595 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.595 [2024-07-22 20:23:46.448646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.595 [2024-07-22 20:23:46.516289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:15.533 20:23:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:15.533 20:23:47 -- common/autotest_common.sh@852 -- # return 0 00:18:15.533 20:23:47 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:18:15.533 [2024-07-22 20:23:47.347707] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:18:15.533 [2024-07-22 20:23:47.349988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aea740 (9): Bad file descriptor 00:18:15.533 [2024-07-22 20:23:47.350987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:15.533 [2024-07-22 20:23:47.350998] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:18:15.533 [2024-07-22 20:23:47.351005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:15.533 request: 00:18:15.533 { 00:18:15.533 "name": "TLSTEST", 00:18:15.533 "trtype": "tcp", 00:18:15.533 "traddr": "10.0.0.2", 00:18:15.533 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:15.533 "adrfam": "ipv4", 00:18:15.533 "trsvcid": "4420", 00:18:15.533 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.533 "method": "bdev_nvme_attach_controller", 00:18:15.533 "req_id": 1 00:18:15.533 } 00:18:15.533 Got JSON-RPC error response 00:18:15.533 response: 00:18:15.533 { 00:18:15.533 "code": -32602, 00:18:15.533 "message": "Invalid parameters" 00:18:15.533 } 00:18:15.533 20:23:47 -- target/tls.sh@36 -- # killprocess 3431439 00:18:15.533 20:23:47 -- common/autotest_common.sh@926 -- # '[' -z 3431439 ']' 00:18:15.533 20:23:47 -- common/autotest_common.sh@930 -- # kill -0 3431439 00:18:15.533 20:23:47 -- common/autotest_common.sh@931 -- # uname 00:18:15.533 20:23:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:15.533 20:23:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3431439 00:18:15.533 20:23:47 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:15.533 20:23:47 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:15.533 20:23:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3431439' 00:18:15.533 killing process with pid 3431439 00:18:15.533 20:23:47 -- common/autotest_common.sh@945 -- # kill 3431439 00:18:15.533 Received shutdown signal, test time was about 10.000000 seconds 00:18:15.533 00:18:15.533 Latency(us) 00:18:15.533 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.533 =================================================================================================================== 00:18:15.533 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:15.533 20:23:47 -- common/autotest_common.sh@950 -- # wait 3431439 00:18:15.792 20:23:47 -- target/tls.sh@37 -- # return 1 00:18:15.792 20:23:47 -- common/autotest_common.sh@643 -- # es=1 00:18:15.792 20:23:47 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:15.792 20:23:47 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:15.792 20:23:47 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:15.792 20:23:47 -- target/tls.sh@167 -- # killprocess 3426488 00:18:15.792 20:23:47 -- common/autotest_common.sh@926 -- # '[' -z 3426488 ']' 00:18:15.792 20:23:47 -- common/autotest_common.sh@930 -- # kill -0 3426488 00:18:15.792 20:23:47 -- common/autotest_common.sh@931 -- # uname 00:18:15.792 20:23:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:15.792 20:23:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3426488 00:18:15.792 20:23:47 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:15.792 20:23:47 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:15.792 20:23:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3426488' 00:18:15.792 killing process with pid 3426488 00:18:15.792 20:23:47 -- common/autotest_common.sh@945 -- # kill 3426488 00:18:15.792 20:23:47 -- common/autotest_common.sh@950 -- # wait 3426488 00:18:16.052 20:23:47 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:18:16.052 20:23:47 -- target/tls.sh@49 -- # local key hash crc 00:18:16.052 20:23:47 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:18:16.052 20:23:47 -- target/tls.sh@51 -- # hash=02 00:18:16.052 20:23:47 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:18:16.052 20:23:47 -- target/tls.sh@52 -- # gzip -1 -c 00:18:16.052 20:23:47 -- target/tls.sh@52 -- # tail -c8 00:18:16.052 20:23:47 -- target/tls.sh@52 -- # head -c 4 00:18:16.052 20:23:47 -- target/tls.sh@52 -- # crc='�e�'\''' 00:18:16.052 20:23:47 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:18:16.052 20:23:47 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:18:16.052 20:23:47 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:18:16.052 20:23:47 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:18:16.052 20:23:47 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.052 20:23:47 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:18:16.052 20:23:47 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.052 20:23:47 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:18:16.052 20:23:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:16.052 20:23:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:16.052 20:23:47 -- common/autotest_common.sh@10 -- # set +x 00:18:16.052 20:23:47 -- nvmf/common.sh@469 -- # nvmfpid=3431778 00:18:16.052 20:23:47 -- nvmf/common.sh@470 -- # waitforlisten 3431778 00:18:16.052 20:23:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:16.052 20:23:47 -- common/autotest_common.sh@819 -- # '[' -z 3431778 ']' 00:18:16.052 20:23:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:16.052 20:23:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:16.052 20:23:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:16.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:16.052 20:23:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:16.052 20:23:47 -- common/autotest_common.sh@10 -- # set +x 00:18:16.052 [2024-07-22 20:23:47.945135] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:16.052 [2024-07-22 20:23:47.945181] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:16.052 EAL: No free 2048 kB hugepages reported on node 1 00:18:16.311 [2024-07-22 20:23:47.999520] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:16.311 [2024-07-22 20:23:48.076646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:16.311 [2024-07-22 20:23:48.076749] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:16.311 [2024-07-22 20:23:48.076757] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:16.311 [2024-07-22 20:23:48.076763] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:16.311 [2024-07-22 20:23:48.076782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:16.879 20:23:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:16.879 20:23:48 -- common/autotest_common.sh@852 -- # return 0 00:18:16.879 20:23:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:16.879 20:23:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:16.879 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:18:16.879 20:23:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:16.879 20:23:48 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.879 20:23:48 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.879 20:23:48 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:17.138 [2024-07-22 20:23:48.923986] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:17.138 20:23:48 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:17.397 20:23:49 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:17.397 [2024-07-22 20:23:49.268903] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:17.397 [2024-07-22 20:23:49.269103] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:17.397 20:23:49 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:17.656 malloc0 00:18:17.656 20:23:49 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:17.915 20:23:49 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.915 20:23:49 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.915 20:23:49 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:17.915 20:23:49 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:17.915 20:23:49 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:17.915 20:23:49 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:17.915 20:23:49 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:17.915 20:23:49 -- target/tls.sh@28 -- # bdevperf_pid=3432077 00:18:17.915 20:23:49 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:17.915 20:23:49 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:17.915 20:23:49 -- target/tls.sh@31 -- # waitforlisten 3432077 /var/tmp/bdevperf.sock 00:18:17.915 20:23:49 -- common/autotest_common.sh@819 -- # '[' -z 3432077 ']' 00:18:17.915 20:23:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:17.915 20:23:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:17.915 20:23:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:17.915 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:17.915 20:23:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:17.915 20:23:49 -- common/autotest_common.sh@10 -- # set +x 00:18:17.915 [2024-07-22 20:23:49.797122] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:17.915 [2024-07-22 20:23:49.797172] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3432077 ] 00:18:17.915 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.915 [2024-07-22 20:23:49.847351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.174 [2024-07-22 20:23:49.919460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:18.740 20:23:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:18.740 20:23:50 -- common/autotest_common.sh@852 -- # return 0 00:18:18.740 20:23:50 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:18.999 [2024-07-22 20:23:50.765977] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:18.999 TLSTESTn1 00:18:18.999 20:23:50 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:19.257 Running I/O for 10 seconds... 00:18:29.268 00:18:29.268 Latency(us) 00:18:29.268 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:29.268 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:29.268 Verification LBA range: start 0x0 length 0x2000 00:18:29.268 TLSTESTn1 : 10.03 2035.61 7.95 0.00 0.00 62806.29 11796.48 90268.72 00:18:29.268 =================================================================================================================== 00:18:29.268 Total : 2035.61 7.95 0.00 0.00 62806.29 11796.48 90268.72 00:18:29.268 0 00:18:29.268 20:24:01 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:29.268 20:24:01 -- target/tls.sh@45 -- # killprocess 3432077 00:18:29.268 20:24:01 -- common/autotest_common.sh@926 -- # '[' -z 3432077 ']' 00:18:29.268 20:24:01 -- common/autotest_common.sh@930 -- # kill -0 3432077 00:18:29.268 20:24:01 -- common/autotest_common.sh@931 -- # uname 00:18:29.268 20:24:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:29.268 20:24:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3432077 00:18:29.268 20:24:01 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:29.268 20:24:01 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:29.268 20:24:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3432077' 00:18:29.268 killing process with pid 3432077 00:18:29.268 20:24:01 -- common/autotest_common.sh@945 -- # kill 3432077 00:18:29.268 Received shutdown signal, test time was about 10.000000 seconds 00:18:29.268 00:18:29.268 Latency(us) 00:18:29.268 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:29.268 =================================================================================================================== 00:18:29.268 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:29.268 20:24:01 -- common/autotest_common.sh@950 -- # wait 3432077 00:18:29.529 20:24:01 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:29.529 20:24:01 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:29.529 20:24:01 -- common/autotest_common.sh@640 -- # local es=0 00:18:29.529 20:24:01 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:29.529 20:24:01 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:18:29.529 20:24:01 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:29.529 20:24:01 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:18:29.529 20:24:01 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:29.529 20:24:01 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:29.529 20:24:01 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:29.529 20:24:01 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:29.529 20:24:01 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:29.529 20:24:01 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:29.529 20:24:01 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:29.529 20:24:01 -- target/tls.sh@28 -- # bdevperf_pid=3434026 00:18:29.529 20:24:01 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:29.529 20:24:01 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:29.529 20:24:01 -- target/tls.sh@31 -- # waitforlisten 3434026 /var/tmp/bdevperf.sock 00:18:29.529 20:24:01 -- common/autotest_common.sh@819 -- # '[' -z 3434026 ']' 00:18:29.529 20:24:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:29.529 20:24:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:29.529 20:24:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:29.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:29.529 20:24:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:29.529 20:24:01 -- common/autotest_common.sh@10 -- # set +x 00:18:29.529 [2024-07-22 20:24:01.309617] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:29.529 [2024-07-22 20:24:01.309672] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3434026 ] 00:18:29.529 EAL: No free 2048 kB hugepages reported on node 1 00:18:29.529 [2024-07-22 20:24:01.361113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:29.529 [2024-07-22 20:24:01.425996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:30.467 20:24:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:30.467 20:24:02 -- common/autotest_common.sh@852 -- # return 0 00:18:30.467 20:24:02 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:30.467 [2024-07-22 20:24:02.264022] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:30.467 [2024-07-22 20:24:02.264065] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:30.467 request: 00:18:30.467 { 00:18:30.467 "name": "TLSTEST", 00:18:30.467 "trtype": "tcp", 00:18:30.467 "traddr": "10.0.0.2", 00:18:30.467 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:30.467 "adrfam": "ipv4", 00:18:30.467 "trsvcid": "4420", 00:18:30.467 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:30.467 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:30.467 "method": "bdev_nvme_attach_controller", 00:18:30.467 "req_id": 1 00:18:30.467 } 00:18:30.467 Got JSON-RPC error response 00:18:30.467 response: 00:18:30.467 { 00:18:30.467 "code": -22, 00:18:30.467 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:30.467 } 00:18:30.467 20:24:02 -- target/tls.sh@36 -- # killprocess 3434026 00:18:30.467 20:24:02 -- common/autotest_common.sh@926 -- # '[' -z 3434026 ']' 00:18:30.467 20:24:02 -- common/autotest_common.sh@930 -- # kill -0 3434026 00:18:30.467 20:24:02 -- common/autotest_common.sh@931 -- # uname 00:18:30.467 20:24:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:30.467 20:24:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3434026 00:18:30.467 20:24:02 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:30.467 20:24:02 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:30.467 20:24:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3434026' 00:18:30.467 killing process with pid 3434026 00:18:30.467 20:24:02 -- common/autotest_common.sh@945 -- # kill 3434026 00:18:30.467 Received shutdown signal, test time was about 10.000000 seconds 00:18:30.467 00:18:30.467 Latency(us) 00:18:30.467 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.467 =================================================================================================================== 00:18:30.467 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:30.467 20:24:02 -- common/autotest_common.sh@950 -- # wait 3434026 00:18:30.726 20:24:02 -- target/tls.sh@37 -- # return 1 00:18:30.726 20:24:02 -- common/autotest_common.sh@643 -- # es=1 00:18:30.726 20:24:02 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:30.727 20:24:02 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:30.727 20:24:02 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:30.727 20:24:02 -- target/tls.sh@183 -- # killprocess 3431778 00:18:30.727 20:24:02 -- common/autotest_common.sh@926 -- # '[' -z 3431778 ']' 00:18:30.727 20:24:02 -- common/autotest_common.sh@930 -- # kill -0 3431778 00:18:30.727 20:24:02 -- common/autotest_common.sh@931 -- # uname 00:18:30.727 20:24:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:30.727 20:24:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3431778 00:18:30.727 20:24:02 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:30.727 20:24:02 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:30.727 20:24:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3431778' 00:18:30.727 killing process with pid 3431778 00:18:30.727 20:24:02 -- common/autotest_common.sh@945 -- # kill 3431778 00:18:30.727 20:24:02 -- common/autotest_common.sh@950 -- # wait 3431778 00:18:30.987 20:24:02 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:30.987 20:24:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:30.987 20:24:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:30.987 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:18:30.987 20:24:02 -- nvmf/common.sh@469 -- # nvmfpid=3434327 00:18:30.987 20:24:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:30.987 20:24:02 -- nvmf/common.sh@470 -- # waitforlisten 3434327 00:18:30.987 20:24:02 -- common/autotest_common.sh@819 -- # '[' -z 3434327 ']' 00:18:30.987 20:24:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:30.987 20:24:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:30.987 20:24:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:30.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:30.987 20:24:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:30.987 20:24:02 -- common/autotest_common.sh@10 -- # set +x 00:18:30.987 [2024-07-22 20:24:02.818747] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:30.987 [2024-07-22 20:24:02.818793] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:30.987 EAL: No free 2048 kB hugepages reported on node 1 00:18:30.987 [2024-07-22 20:24:02.877173] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:31.246 [2024-07-22 20:24:02.943788] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:31.246 [2024-07-22 20:24:02.943896] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:31.246 [2024-07-22 20:24:02.943903] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:31.246 [2024-07-22 20:24:02.943909] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:31.246 [2024-07-22 20:24:02.943924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:31.815 20:24:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:31.815 20:24:03 -- common/autotest_common.sh@852 -- # return 0 00:18:31.815 20:24:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:31.815 20:24:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:31.815 20:24:03 -- common/autotest_common.sh@10 -- # set +x 00:18:31.815 20:24:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:31.815 20:24:03 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:31.815 20:24:03 -- common/autotest_common.sh@640 -- # local es=0 00:18:31.815 20:24:03 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:31.815 20:24:03 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:18:31.815 20:24:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:31.815 20:24:03 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:18:31.815 20:24:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:31.815 20:24:03 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:31.815 20:24:03 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:31.815 20:24:03 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:32.074 [2024-07-22 20:24:03.795133] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:32.074 20:24:03 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:32.074 20:24:03 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:32.334 [2024-07-22 20:24:04.115974] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:32.334 [2024-07-22 20:24:04.116163] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:32.334 20:24:04 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:32.594 malloc0 00:18:32.594 20:24:04 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:32.594 20:24:04 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:32.854 [2024-07-22 20:24:04.613482] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:32.854 [2024-07-22 20:24:04.613512] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:32.854 [2024-07-22 20:24:04.613525] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:32.854 request: 00:18:32.854 { 00:18:32.854 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:32.854 "host": "nqn.2016-06.io.spdk:host1", 00:18:32.854 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:32.854 "method": "nvmf_subsystem_add_host", 00:18:32.854 "req_id": 1 00:18:32.854 } 00:18:32.854 Got JSON-RPC error response 00:18:32.854 response: 00:18:32.854 { 00:18:32.854 "code": -32603, 00:18:32.854 "message": "Internal error" 00:18:32.854 } 00:18:32.854 20:24:04 -- common/autotest_common.sh@643 -- # es=1 00:18:32.854 20:24:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:32.854 20:24:04 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:32.854 20:24:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:32.854 20:24:04 -- target/tls.sh@189 -- # killprocess 3434327 00:18:32.854 20:24:04 -- common/autotest_common.sh@926 -- # '[' -z 3434327 ']' 00:18:32.854 20:24:04 -- common/autotest_common.sh@930 -- # kill -0 3434327 00:18:32.854 20:24:04 -- common/autotest_common.sh@931 -- # uname 00:18:32.854 20:24:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:32.854 20:24:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3434327 00:18:32.854 20:24:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:32.854 20:24:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:32.854 20:24:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3434327' 00:18:32.854 killing process with pid 3434327 00:18:32.854 20:24:04 -- common/autotest_common.sh@945 -- # kill 3434327 00:18:32.854 20:24:04 -- common/autotest_common.sh@950 -- # wait 3434327 00:18:33.114 20:24:04 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:33.114 20:24:04 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:33.114 20:24:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:33.114 20:24:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:33.114 20:24:04 -- common/autotest_common.sh@10 -- # set +x 00:18:33.114 20:24:04 -- nvmf/common.sh@469 -- # nvmfpid=3434818 00:18:33.114 20:24:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:33.114 20:24:04 -- nvmf/common.sh@470 -- # waitforlisten 3434818 00:18:33.114 20:24:04 -- common/autotest_common.sh@819 -- # '[' -z 3434818 ']' 00:18:33.114 20:24:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:33.114 20:24:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:33.114 20:24:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:33.114 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:33.114 20:24:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:33.114 20:24:04 -- common/autotest_common.sh@10 -- # set +x 00:18:33.114 [2024-07-22 20:24:04.953094] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:33.114 [2024-07-22 20:24:04.953140] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:33.114 EAL: No free 2048 kB hugepages reported on node 1 00:18:33.114 [2024-07-22 20:24:05.009560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:33.374 [2024-07-22 20:24:05.086450] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:33.374 [2024-07-22 20:24:05.086551] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:33.374 [2024-07-22 20:24:05.086559] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:33.374 [2024-07-22 20:24:05.086565] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:33.374 [2024-07-22 20:24:05.086581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:33.942 20:24:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:33.942 20:24:05 -- common/autotest_common.sh@852 -- # return 0 00:18:33.942 20:24:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:33.942 20:24:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:33.942 20:24:05 -- common/autotest_common.sh@10 -- # set +x 00:18:33.942 20:24:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:33.942 20:24:05 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:33.942 20:24:05 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:33.942 20:24:05 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:34.213 [2024-07-22 20:24:05.925789] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:34.213 20:24:05 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:34.213 20:24:06 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:34.474 [2024-07-22 20:24:06.262677] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:34.474 [2024-07-22 20:24:06.262866] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:34.474 20:24:06 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:34.734 malloc0 00:18:34.734 20:24:06 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:34.734 20:24:06 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:34.993 20:24:06 -- target/tls.sh@197 -- # bdevperf_pid=3435083 00:18:34.993 20:24:06 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:34.993 20:24:06 -- target/tls.sh@200 -- # waitforlisten 3435083 /var/tmp/bdevperf.sock 00:18:34.993 20:24:06 -- common/autotest_common.sh@819 -- # '[' -z 3435083 ']' 00:18:34.993 20:24:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:34.993 20:24:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:34.993 20:24:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:34.993 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:34.993 20:24:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:34.993 20:24:06 -- common/autotest_common.sh@10 -- # set +x 00:18:34.994 20:24:06 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:34.994 [2024-07-22 20:24:06.800757] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:34.994 [2024-07-22 20:24:06.800804] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3435083 ] 00:18:34.994 EAL: No free 2048 kB hugepages reported on node 1 00:18:34.994 [2024-07-22 20:24:06.849141] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:34.994 [2024-07-22 20:24:06.918128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:35.931 20:24:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:35.931 20:24:07 -- common/autotest_common.sh@852 -- # return 0 00:18:35.931 20:24:07 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:35.931 [2024-07-22 20:24:07.740635] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:35.931 TLSTESTn1 00:18:35.931 20:24:07 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:36.190 20:24:08 -- target/tls.sh@205 -- # tgtconf='{ 00:18:36.190 "subsystems": [ 00:18:36.190 { 00:18:36.190 "subsystem": "iobuf", 00:18:36.190 "config": [ 00:18:36.190 { 00:18:36.190 "method": "iobuf_set_options", 00:18:36.190 "params": { 00:18:36.190 "small_pool_count": 8192, 00:18:36.190 "large_pool_count": 1024, 00:18:36.190 "small_bufsize": 8192, 00:18:36.190 "large_bufsize": 135168 00:18:36.190 } 00:18:36.190 } 00:18:36.190 ] 00:18:36.190 }, 00:18:36.190 { 00:18:36.190 "subsystem": "sock", 00:18:36.190 "config": [ 00:18:36.190 { 00:18:36.191 "method": "sock_impl_set_options", 00:18:36.191 "params": { 00:18:36.191 "impl_name": "posix", 00:18:36.191 "recv_buf_size": 2097152, 00:18:36.191 "send_buf_size": 2097152, 00:18:36.191 "enable_recv_pipe": true, 00:18:36.191 "enable_quickack": false, 00:18:36.191 "enable_placement_id": 0, 00:18:36.191 "enable_zerocopy_send_server": true, 00:18:36.191 "enable_zerocopy_send_client": false, 00:18:36.191 "zerocopy_threshold": 0, 00:18:36.191 "tls_version": 0, 00:18:36.191 "enable_ktls": false 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "sock_impl_set_options", 00:18:36.191 "params": { 00:18:36.191 "impl_name": "ssl", 00:18:36.191 "recv_buf_size": 4096, 00:18:36.191 "send_buf_size": 4096, 00:18:36.191 "enable_recv_pipe": true, 00:18:36.191 "enable_quickack": false, 00:18:36.191 "enable_placement_id": 0, 00:18:36.191 "enable_zerocopy_send_server": true, 00:18:36.191 "enable_zerocopy_send_client": false, 00:18:36.191 "zerocopy_threshold": 0, 00:18:36.191 "tls_version": 0, 00:18:36.191 "enable_ktls": false 00:18:36.191 } 00:18:36.191 } 00:18:36.191 ] 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "subsystem": "vmd", 00:18:36.191 "config": [] 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "subsystem": "accel", 00:18:36.191 "config": [ 00:18:36.191 { 00:18:36.191 "method": "accel_set_options", 00:18:36.191 "params": { 00:18:36.191 "small_cache_size": 128, 00:18:36.191 "large_cache_size": 16, 00:18:36.191 "task_count": 2048, 00:18:36.191 "sequence_count": 2048, 00:18:36.191 "buf_count": 2048 00:18:36.191 } 00:18:36.191 } 00:18:36.191 ] 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "subsystem": "bdev", 00:18:36.191 "config": [ 00:18:36.191 { 00:18:36.191 "method": "bdev_set_options", 00:18:36.191 "params": { 00:18:36.191 "bdev_io_pool_size": 65535, 00:18:36.191 "bdev_io_cache_size": 256, 00:18:36.191 "bdev_auto_examine": true, 00:18:36.191 "iobuf_small_cache_size": 128, 00:18:36.191 "iobuf_large_cache_size": 16 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "bdev_raid_set_options", 00:18:36.191 "params": { 00:18:36.191 "process_window_size_kb": 1024 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "bdev_iscsi_set_options", 00:18:36.191 "params": { 00:18:36.191 "timeout_sec": 30 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "bdev_nvme_set_options", 00:18:36.191 "params": { 00:18:36.191 "action_on_timeout": "none", 00:18:36.191 "timeout_us": 0, 00:18:36.191 "timeout_admin_us": 0, 00:18:36.191 "keep_alive_timeout_ms": 10000, 00:18:36.191 "transport_retry_count": 4, 00:18:36.191 "arbitration_burst": 0, 00:18:36.191 "low_priority_weight": 0, 00:18:36.191 "medium_priority_weight": 0, 00:18:36.191 "high_priority_weight": 0, 00:18:36.191 "nvme_adminq_poll_period_us": 10000, 00:18:36.191 "nvme_ioq_poll_period_us": 0, 00:18:36.191 "io_queue_requests": 0, 00:18:36.191 "delay_cmd_submit": true, 00:18:36.191 "bdev_retry_count": 3, 00:18:36.191 "transport_ack_timeout": 0, 00:18:36.191 "ctrlr_loss_timeout_sec": 0, 00:18:36.191 "reconnect_delay_sec": 0, 00:18:36.191 "fast_io_fail_timeout_sec": 0, 00:18:36.191 "generate_uuids": false, 00:18:36.191 "transport_tos": 0, 00:18:36.191 "io_path_stat": false, 00:18:36.191 "allow_accel_sequence": false 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "bdev_nvme_set_hotplug", 00:18:36.191 "params": { 00:18:36.191 "period_us": 100000, 00:18:36.191 "enable": false 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "bdev_malloc_create", 00:18:36.191 "params": { 00:18:36.191 "name": "malloc0", 00:18:36.191 "num_blocks": 8192, 00:18:36.191 "block_size": 4096, 00:18:36.191 "physical_block_size": 4096, 00:18:36.191 "uuid": "58602c00-be31-43fc-889f-5844a9712232", 00:18:36.191 "optimal_io_boundary": 0 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "bdev_wait_for_examine" 00:18:36.191 } 00:18:36.191 ] 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "subsystem": "nbd", 00:18:36.191 "config": [] 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "subsystem": "scheduler", 00:18:36.191 "config": [ 00:18:36.191 { 00:18:36.191 "method": "framework_set_scheduler", 00:18:36.191 "params": { 00:18:36.191 "name": "static" 00:18:36.191 } 00:18:36.191 } 00:18:36.191 ] 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "subsystem": "nvmf", 00:18:36.191 "config": [ 00:18:36.191 { 00:18:36.191 "method": "nvmf_set_config", 00:18:36.191 "params": { 00:18:36.191 "discovery_filter": "match_any", 00:18:36.191 "admin_cmd_passthru": { 00:18:36.191 "identify_ctrlr": false 00:18:36.191 } 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "nvmf_set_max_subsystems", 00:18:36.191 "params": { 00:18:36.191 "max_subsystems": 1024 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "nvmf_set_crdt", 00:18:36.191 "params": { 00:18:36.191 "crdt1": 0, 00:18:36.191 "crdt2": 0, 00:18:36.191 "crdt3": 0 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "nvmf_create_transport", 00:18:36.191 "params": { 00:18:36.191 "trtype": "TCP", 00:18:36.191 "max_queue_depth": 128, 00:18:36.191 "max_io_qpairs_per_ctrlr": 127, 00:18:36.191 "in_capsule_data_size": 4096, 00:18:36.191 "max_io_size": 131072, 00:18:36.191 "io_unit_size": 131072, 00:18:36.191 "max_aq_depth": 128, 00:18:36.191 "num_shared_buffers": 511, 00:18:36.191 "buf_cache_size": 4294967295, 00:18:36.191 "dif_insert_or_strip": false, 00:18:36.191 "zcopy": false, 00:18:36.191 "c2h_success": false, 00:18:36.191 "sock_priority": 0, 00:18:36.191 "abort_timeout_sec": 1 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "nvmf_create_subsystem", 00:18:36.191 "params": { 00:18:36.191 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.191 "allow_any_host": false, 00:18:36.191 "serial_number": "SPDK00000000000001", 00:18:36.191 "model_number": "SPDK bdev Controller", 00:18:36.191 "max_namespaces": 10, 00:18:36.191 "min_cntlid": 1, 00:18:36.191 "max_cntlid": 65519, 00:18:36.191 "ana_reporting": false 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "nvmf_subsystem_add_host", 00:18:36.191 "params": { 00:18:36.191 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.191 "host": "nqn.2016-06.io.spdk:host1", 00:18:36.191 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "nvmf_subsystem_add_ns", 00:18:36.191 "params": { 00:18:36.191 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.191 "namespace": { 00:18:36.191 "nsid": 1, 00:18:36.191 "bdev_name": "malloc0", 00:18:36.191 "nguid": "58602C00BE3143FC889F5844A9712232", 00:18:36.191 "uuid": "58602c00-be31-43fc-889f-5844a9712232" 00:18:36.191 } 00:18:36.191 } 00:18:36.191 }, 00:18:36.191 { 00:18:36.191 "method": "nvmf_subsystem_add_listener", 00:18:36.191 "params": { 00:18:36.191 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.191 "listen_address": { 00:18:36.191 "trtype": "TCP", 00:18:36.191 "adrfam": "IPv4", 00:18:36.191 "traddr": "10.0.0.2", 00:18:36.191 "trsvcid": "4420" 00:18:36.191 }, 00:18:36.192 "secure_channel": true 00:18:36.192 } 00:18:36.192 } 00:18:36.192 ] 00:18:36.192 } 00:18:36.192 ] 00:18:36.192 }' 00:18:36.192 20:24:08 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:36.451 20:24:08 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:36.451 "subsystems": [ 00:18:36.451 { 00:18:36.451 "subsystem": "iobuf", 00:18:36.451 "config": [ 00:18:36.451 { 00:18:36.451 "method": "iobuf_set_options", 00:18:36.451 "params": { 00:18:36.451 "small_pool_count": 8192, 00:18:36.451 "large_pool_count": 1024, 00:18:36.451 "small_bufsize": 8192, 00:18:36.451 "large_bufsize": 135168 00:18:36.451 } 00:18:36.451 } 00:18:36.451 ] 00:18:36.451 }, 00:18:36.451 { 00:18:36.451 "subsystem": "sock", 00:18:36.451 "config": [ 00:18:36.451 { 00:18:36.451 "method": "sock_impl_set_options", 00:18:36.451 "params": { 00:18:36.451 "impl_name": "posix", 00:18:36.451 "recv_buf_size": 2097152, 00:18:36.451 "send_buf_size": 2097152, 00:18:36.451 "enable_recv_pipe": true, 00:18:36.451 "enable_quickack": false, 00:18:36.451 "enable_placement_id": 0, 00:18:36.451 "enable_zerocopy_send_server": true, 00:18:36.451 "enable_zerocopy_send_client": false, 00:18:36.451 "zerocopy_threshold": 0, 00:18:36.451 "tls_version": 0, 00:18:36.451 "enable_ktls": false 00:18:36.451 } 00:18:36.451 }, 00:18:36.451 { 00:18:36.451 "method": "sock_impl_set_options", 00:18:36.451 "params": { 00:18:36.451 "impl_name": "ssl", 00:18:36.451 "recv_buf_size": 4096, 00:18:36.451 "send_buf_size": 4096, 00:18:36.451 "enable_recv_pipe": true, 00:18:36.451 "enable_quickack": false, 00:18:36.451 "enable_placement_id": 0, 00:18:36.452 "enable_zerocopy_send_server": true, 00:18:36.452 "enable_zerocopy_send_client": false, 00:18:36.452 "zerocopy_threshold": 0, 00:18:36.452 "tls_version": 0, 00:18:36.452 "enable_ktls": false 00:18:36.452 } 00:18:36.452 } 00:18:36.452 ] 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "subsystem": "vmd", 00:18:36.452 "config": [] 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "subsystem": "accel", 00:18:36.452 "config": [ 00:18:36.452 { 00:18:36.452 "method": "accel_set_options", 00:18:36.452 "params": { 00:18:36.452 "small_cache_size": 128, 00:18:36.452 "large_cache_size": 16, 00:18:36.452 "task_count": 2048, 00:18:36.452 "sequence_count": 2048, 00:18:36.452 "buf_count": 2048 00:18:36.452 } 00:18:36.452 } 00:18:36.452 ] 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "subsystem": "bdev", 00:18:36.452 "config": [ 00:18:36.452 { 00:18:36.452 "method": "bdev_set_options", 00:18:36.452 "params": { 00:18:36.452 "bdev_io_pool_size": 65535, 00:18:36.452 "bdev_io_cache_size": 256, 00:18:36.452 "bdev_auto_examine": true, 00:18:36.452 "iobuf_small_cache_size": 128, 00:18:36.452 "iobuf_large_cache_size": 16 00:18:36.452 } 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "method": "bdev_raid_set_options", 00:18:36.452 "params": { 00:18:36.452 "process_window_size_kb": 1024 00:18:36.452 } 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "method": "bdev_iscsi_set_options", 00:18:36.452 "params": { 00:18:36.452 "timeout_sec": 30 00:18:36.452 } 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "method": "bdev_nvme_set_options", 00:18:36.452 "params": { 00:18:36.452 "action_on_timeout": "none", 00:18:36.452 "timeout_us": 0, 00:18:36.452 "timeout_admin_us": 0, 00:18:36.452 "keep_alive_timeout_ms": 10000, 00:18:36.452 "transport_retry_count": 4, 00:18:36.452 "arbitration_burst": 0, 00:18:36.452 "low_priority_weight": 0, 00:18:36.452 "medium_priority_weight": 0, 00:18:36.452 "high_priority_weight": 0, 00:18:36.452 "nvme_adminq_poll_period_us": 10000, 00:18:36.452 "nvme_ioq_poll_period_us": 0, 00:18:36.452 "io_queue_requests": 512, 00:18:36.452 "delay_cmd_submit": true, 00:18:36.452 "bdev_retry_count": 3, 00:18:36.452 "transport_ack_timeout": 0, 00:18:36.452 "ctrlr_loss_timeout_sec": 0, 00:18:36.452 "reconnect_delay_sec": 0, 00:18:36.452 "fast_io_fail_timeout_sec": 0, 00:18:36.452 "generate_uuids": false, 00:18:36.452 "transport_tos": 0, 00:18:36.452 "io_path_stat": false, 00:18:36.452 "allow_accel_sequence": false 00:18:36.452 } 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "method": "bdev_nvme_attach_controller", 00:18:36.452 "params": { 00:18:36.452 "name": "TLSTEST", 00:18:36.452 "trtype": "TCP", 00:18:36.452 "adrfam": "IPv4", 00:18:36.452 "traddr": "10.0.0.2", 00:18:36.452 "trsvcid": "4420", 00:18:36.452 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.452 "prchk_reftag": false, 00:18:36.452 "prchk_guard": false, 00:18:36.452 "ctrlr_loss_timeout_sec": 0, 00:18:36.452 "reconnect_delay_sec": 0, 00:18:36.452 "fast_io_fail_timeout_sec": 0, 00:18:36.452 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:36.452 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:36.452 "hdgst": false, 00:18:36.452 "ddgst": false 00:18:36.452 } 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "method": "bdev_nvme_set_hotplug", 00:18:36.452 "params": { 00:18:36.452 "period_us": 100000, 00:18:36.452 "enable": false 00:18:36.452 } 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "method": "bdev_wait_for_examine" 00:18:36.452 } 00:18:36.452 ] 00:18:36.452 }, 00:18:36.452 { 00:18:36.452 "subsystem": "nbd", 00:18:36.452 "config": [] 00:18:36.452 } 00:18:36.452 ] 00:18:36.452 }' 00:18:36.452 20:24:08 -- target/tls.sh@208 -- # killprocess 3435083 00:18:36.452 20:24:08 -- common/autotest_common.sh@926 -- # '[' -z 3435083 ']' 00:18:36.452 20:24:08 -- common/autotest_common.sh@930 -- # kill -0 3435083 00:18:36.452 20:24:08 -- common/autotest_common.sh@931 -- # uname 00:18:36.452 20:24:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:36.452 20:24:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3435083 00:18:36.452 20:24:08 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:36.452 20:24:08 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:36.452 20:24:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3435083' 00:18:36.452 killing process with pid 3435083 00:18:36.452 20:24:08 -- common/autotest_common.sh@945 -- # kill 3435083 00:18:36.452 Received shutdown signal, test time was about 10.000000 seconds 00:18:36.452 00:18:36.452 Latency(us) 00:18:36.452 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.452 =================================================================================================================== 00:18:36.452 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:36.452 20:24:08 -- common/autotest_common.sh@950 -- # wait 3435083 00:18:36.712 20:24:08 -- target/tls.sh@209 -- # killprocess 3434818 00:18:36.712 20:24:08 -- common/autotest_common.sh@926 -- # '[' -z 3434818 ']' 00:18:36.712 20:24:08 -- common/autotest_common.sh@930 -- # kill -0 3434818 00:18:36.712 20:24:08 -- common/autotest_common.sh@931 -- # uname 00:18:36.712 20:24:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:36.712 20:24:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3434818 00:18:36.712 20:24:08 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:36.712 20:24:08 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:36.712 20:24:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3434818' 00:18:36.712 killing process with pid 3434818 00:18:36.712 20:24:08 -- common/autotest_common.sh@945 -- # kill 3434818 00:18:36.712 20:24:08 -- common/autotest_common.sh@950 -- # wait 3434818 00:18:36.972 20:24:08 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:36.972 20:24:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:36.972 20:24:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:36.972 20:24:08 -- target/tls.sh@212 -- # echo '{ 00:18:36.972 "subsystems": [ 00:18:36.972 { 00:18:36.972 "subsystem": "iobuf", 00:18:36.972 "config": [ 00:18:36.972 { 00:18:36.972 "method": "iobuf_set_options", 00:18:36.972 "params": { 00:18:36.972 "small_pool_count": 8192, 00:18:36.972 "large_pool_count": 1024, 00:18:36.972 "small_bufsize": 8192, 00:18:36.972 "large_bufsize": 135168 00:18:36.972 } 00:18:36.972 } 00:18:36.972 ] 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "subsystem": "sock", 00:18:36.972 "config": [ 00:18:36.972 { 00:18:36.972 "method": "sock_impl_set_options", 00:18:36.972 "params": { 00:18:36.972 "impl_name": "posix", 00:18:36.972 "recv_buf_size": 2097152, 00:18:36.972 "send_buf_size": 2097152, 00:18:36.972 "enable_recv_pipe": true, 00:18:36.972 "enable_quickack": false, 00:18:36.972 "enable_placement_id": 0, 00:18:36.972 "enable_zerocopy_send_server": true, 00:18:36.972 "enable_zerocopy_send_client": false, 00:18:36.972 "zerocopy_threshold": 0, 00:18:36.972 "tls_version": 0, 00:18:36.972 "enable_ktls": false 00:18:36.972 } 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "method": "sock_impl_set_options", 00:18:36.972 "params": { 00:18:36.972 "impl_name": "ssl", 00:18:36.972 "recv_buf_size": 4096, 00:18:36.972 "send_buf_size": 4096, 00:18:36.972 "enable_recv_pipe": true, 00:18:36.972 "enable_quickack": false, 00:18:36.972 "enable_placement_id": 0, 00:18:36.972 "enable_zerocopy_send_server": true, 00:18:36.972 "enable_zerocopy_send_client": false, 00:18:36.972 "zerocopy_threshold": 0, 00:18:36.972 "tls_version": 0, 00:18:36.972 "enable_ktls": false 00:18:36.972 } 00:18:36.972 } 00:18:36.972 ] 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "subsystem": "vmd", 00:18:36.972 "config": [] 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "subsystem": "accel", 00:18:36.972 "config": [ 00:18:36.972 { 00:18:36.972 "method": "accel_set_options", 00:18:36.972 "params": { 00:18:36.972 "small_cache_size": 128, 00:18:36.972 "large_cache_size": 16, 00:18:36.972 "task_count": 2048, 00:18:36.972 "sequence_count": 2048, 00:18:36.972 "buf_count": 2048 00:18:36.972 } 00:18:36.972 } 00:18:36.972 ] 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "subsystem": "bdev", 00:18:36.972 "config": [ 00:18:36.972 { 00:18:36.972 "method": "bdev_set_options", 00:18:36.972 "params": { 00:18:36.972 "bdev_io_pool_size": 65535, 00:18:36.972 "bdev_io_cache_size": 256, 00:18:36.972 "bdev_auto_examine": true, 00:18:36.972 "iobuf_small_cache_size": 128, 00:18:36.972 "iobuf_large_cache_size": 16 00:18:36.972 } 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "method": "bdev_raid_set_options", 00:18:36.972 "params": { 00:18:36.972 "process_window_size_kb": 1024 00:18:36.972 } 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "method": "bdev_iscsi_set_options", 00:18:36.972 "params": { 00:18:36.972 "timeout_sec": 30 00:18:36.972 } 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "method": "bdev_nvme_set_options", 00:18:36.972 "params": { 00:18:36.972 "action_on_timeout": "none", 00:18:36.972 "timeout_us": 0, 00:18:36.972 "timeout_admin_us": 0, 00:18:36.972 "keep_alive_timeout_ms": 10000, 00:18:36.972 "transport_retry_count": 4, 00:18:36.972 "arbitration_burst": 0, 00:18:36.972 "low_priority_weight": 0, 00:18:36.972 "medium_priority_weight": 0, 00:18:36.972 "high_priority_weight": 0, 00:18:36.972 "nvme_adminq_poll_period_us": 10000, 00:18:36.972 "nvme_ioq_poll_period_us": 0, 00:18:36.972 "io_queue_requests": 0, 00:18:36.972 "delay_cmd_submit": true, 00:18:36.972 "bdev_retry_count": 3, 00:18:36.972 "transport_ack_timeout": 0, 00:18:36.972 "ctrlr_loss_timeout_sec": 0, 00:18:36.972 "reconnect_delay_sec": 0, 00:18:36.972 "fast_io_fail_timeout_sec": 0, 00:18:36.972 "generate_uuids": false, 00:18:36.972 "transport_tos": 0, 00:18:36.972 "io_path_stat": false, 00:18:36.972 "allow_accel_sequence": false 00:18:36.972 } 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "method": "bdev_nvme_set_hotplug", 00:18:36.972 "params": { 00:18:36.972 "period_us": 100000, 00:18:36.972 "enable": false 00:18:36.972 } 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "method": "bdev_malloc_create", 00:18:36.972 "params": { 00:18:36.972 "name": "malloc0", 00:18:36.972 "num_blocks": 8192, 00:18:36.972 "block_size": 4096, 00:18:36.972 "physical_block_size": 4096, 00:18:36.972 "uuid": "58602c00-be31-43fc-889f-5844a9712232", 00:18:36.972 "optimal_io_boundary": 0 00:18:36.972 } 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "method": "bdev_wait_for_examine" 00:18:36.972 } 00:18:36.972 ] 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "subsystem": "nbd", 00:18:36.972 "config": [] 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "subsystem": "scheduler", 00:18:36.972 "config": [ 00:18:36.972 { 00:18:36.972 "method": "framework_set_scheduler", 00:18:36.972 "params": { 00:18:36.972 "name": "static" 00:18:36.972 } 00:18:36.972 } 00:18:36.972 ] 00:18:36.972 }, 00:18:36.972 { 00:18:36.972 "subsystem": "nvmf", 00:18:36.972 "config": [ 00:18:36.972 { 00:18:36.972 "method": "nvmf_set_config", 00:18:36.972 "params": { 00:18:36.972 "discovery_filter": "match_any", 00:18:36.972 "admin_cmd_passthru": { 00:18:36.972 "identify_ctrlr": false 00:18:36.972 } 00:18:36.973 } 00:18:36.973 }, 00:18:36.973 { 00:18:36.973 "method": "nvmf_set_max_subsystems", 00:18:36.973 "params": { 00:18:36.973 "max_subsystems": 1024 00:18:36.973 } 00:18:36.973 }, 00:18:36.973 { 00:18:36.973 "method": "nvmf_set_crdt", 00:18:36.973 "params": { 00:18:36.973 "crdt1": 0, 00:18:36.973 "crdt2": 0, 00:18:36.973 "crdt3": 0 00:18:36.973 } 00:18:36.973 }, 00:18:36.973 { 00:18:36.973 "method": "nvmf_create_transport", 00:18:36.973 "params": { 00:18:36.973 "trtype": "TCP", 00:18:36.973 "max_queue_depth": 128, 00:18:36.973 "max_io_qpairs_per_ctrlr": 127, 00:18:36.973 "in_capsule_data_size": 4096, 00:18:36.973 "max_io_size": 131072, 00:18:36.973 "io_unit_size": 131072, 00:18:36.973 "max_aq_depth": 128, 00:18:36.973 "num_shared_buffers": 511, 00:18:36.973 "buf_cache_size": 4294967295, 00:18:36.973 "dif_insert_or_strip": false, 00:18:36.973 "zcopy": false, 00:18:36.973 "c2h_success": false, 00:18:36.973 "sock_priority": 0, 00:18:36.973 "abort_timeout_sec": 1 00:18:36.973 } 00:18:36.973 }, 00:18:36.973 { 00:18:36.973 "method": "nvmf_create_subsystem", 00:18:36.973 "params": { 00:18:36.973 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.973 "allow_any_host": false, 00:18:36.973 "serial_number": "SPDK00000000000001", 00:18:36.973 "model_number": "SPDK bdev Controller", 00:18:36.973 "max_namespaces": 10, 00:18:36.973 "min_cntlid": 1, 00:18:36.973 "max_cntlid": 65519, 00:18:36.973 "ana_reporting": false 00:18:36.973 } 00:18:36.973 }, 00:18:36.973 { 00:18:36.973 "method": "nvmf_subsystem_add_host", 00:18:36.973 "params": { 00:18:36.973 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.973 "host": "nqn.2016-06.io.spdk:host1", 00:18:36.973 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:36.973 } 00:18:36.973 }, 00:18:36.973 { 00:18:36.973 "method": "nvmf_subsystem_add_ns", 00:18:36.973 "params": { 00:18:36.973 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.973 "namespace": { 00:18:36.973 "nsid": 1, 00:18:36.973 "bdev_name": "malloc0", 00:18:36.973 "nguid": "58602C00BE3143FC889F5844A9712232", 00:18:36.973 "uuid": "58602c00-be31-43fc-889f-5844a9712232" 00:18:36.973 } 00:18:36.973 } 00:18:36.973 }, 00:18:36.973 { 00:18:36.973 "method": "nvmf_subsystem_add_listener", 00:18:36.973 "params": { 00:18:36.973 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.973 "listen_address": { 00:18:36.973 "trtype": "TCP", 00:18:36.973 "adrfam": "IPv4", 00:18:36.973 "traddr": "10.0.0.2", 00:18:36.973 "trsvcid": "4420" 00:18:36.973 }, 00:18:36.973 "secure_channel": true 00:18:36.973 } 00:18:36.973 } 00:18:36.973 ] 00:18:36.973 } 00:18:36.973 ] 00:18:36.973 }' 00:18:36.973 20:24:08 -- common/autotest_common.sh@10 -- # set +x 00:18:36.973 20:24:08 -- nvmf/common.sh@469 -- # nvmfpid=3435580 00:18:36.973 20:24:08 -- nvmf/common.sh@470 -- # waitforlisten 3435580 00:18:36.973 20:24:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:36.973 20:24:08 -- common/autotest_common.sh@819 -- # '[' -z 3435580 ']' 00:18:36.973 20:24:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:36.973 20:24:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:36.973 20:24:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:36.973 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:36.973 20:24:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:36.973 20:24:08 -- common/autotest_common.sh@10 -- # set +x 00:18:36.973 [2024-07-22 20:24:08.866409] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:36.973 [2024-07-22 20:24:08.866455] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:36.973 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.233 [2024-07-22 20:24:08.923722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:37.233 [2024-07-22 20:24:09.006350] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:37.233 [2024-07-22 20:24:09.006460] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:37.233 [2024-07-22 20:24:09.006469] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:37.233 [2024-07-22 20:24:09.006476] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:37.233 [2024-07-22 20:24:09.006496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:37.492 [2024-07-22 20:24:09.200257] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:37.492 [2024-07-22 20:24:09.232309] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:37.492 [2024-07-22 20:24:09.232489] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:37.752 20:24:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:37.752 20:24:09 -- common/autotest_common.sh@852 -- # return 0 00:18:37.752 20:24:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:37.752 20:24:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:37.752 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:18:38.011 20:24:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:38.011 20:24:09 -- target/tls.sh@216 -- # bdevperf_pid=3435931 00:18:38.011 20:24:09 -- target/tls.sh@217 -- # waitforlisten 3435931 /var/tmp/bdevperf.sock 00:18:38.011 20:24:09 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:38.011 20:24:09 -- common/autotest_common.sh@819 -- # '[' -z 3435931 ']' 00:18:38.011 20:24:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:38.011 20:24:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:38.011 20:24:09 -- target/tls.sh@213 -- # echo '{ 00:18:38.011 "subsystems": [ 00:18:38.011 { 00:18:38.011 "subsystem": "iobuf", 00:18:38.011 "config": [ 00:18:38.011 { 00:18:38.011 "method": "iobuf_set_options", 00:18:38.011 "params": { 00:18:38.011 "small_pool_count": 8192, 00:18:38.011 "large_pool_count": 1024, 00:18:38.011 "small_bufsize": 8192, 00:18:38.011 "large_bufsize": 135168 00:18:38.011 } 00:18:38.011 } 00:18:38.011 ] 00:18:38.011 }, 00:18:38.011 { 00:18:38.011 "subsystem": "sock", 00:18:38.011 "config": [ 00:18:38.011 { 00:18:38.011 "method": "sock_impl_set_options", 00:18:38.011 "params": { 00:18:38.011 "impl_name": "posix", 00:18:38.011 "recv_buf_size": 2097152, 00:18:38.011 "send_buf_size": 2097152, 00:18:38.011 "enable_recv_pipe": true, 00:18:38.012 "enable_quickack": false, 00:18:38.012 "enable_placement_id": 0, 00:18:38.012 "enable_zerocopy_send_server": true, 00:18:38.012 "enable_zerocopy_send_client": false, 00:18:38.012 "zerocopy_threshold": 0, 00:18:38.012 "tls_version": 0, 00:18:38.012 "enable_ktls": false 00:18:38.012 } 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "method": "sock_impl_set_options", 00:18:38.012 "params": { 00:18:38.012 "impl_name": "ssl", 00:18:38.012 "recv_buf_size": 4096, 00:18:38.012 "send_buf_size": 4096, 00:18:38.012 "enable_recv_pipe": true, 00:18:38.012 "enable_quickack": false, 00:18:38.012 "enable_placement_id": 0, 00:18:38.012 "enable_zerocopy_send_server": true, 00:18:38.012 "enable_zerocopy_send_client": false, 00:18:38.012 "zerocopy_threshold": 0, 00:18:38.012 "tls_version": 0, 00:18:38.012 "enable_ktls": false 00:18:38.012 } 00:18:38.012 } 00:18:38.012 ] 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "subsystem": "vmd", 00:18:38.012 "config": [] 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "subsystem": "accel", 00:18:38.012 "config": [ 00:18:38.012 { 00:18:38.012 "method": "accel_set_options", 00:18:38.012 "params": { 00:18:38.012 "small_cache_size": 128, 00:18:38.012 "large_cache_size": 16, 00:18:38.012 "task_count": 2048, 00:18:38.012 "sequence_count": 2048, 00:18:38.012 "buf_count": 2048 00:18:38.012 } 00:18:38.012 } 00:18:38.012 ] 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "subsystem": "bdev", 00:18:38.012 "config": [ 00:18:38.012 { 00:18:38.012 "method": "bdev_set_options", 00:18:38.012 "params": { 00:18:38.012 "bdev_io_pool_size": 65535, 00:18:38.012 "bdev_io_cache_size": 256, 00:18:38.012 "bdev_auto_examine": true, 00:18:38.012 "iobuf_small_cache_size": 128, 00:18:38.012 "iobuf_large_cache_size": 16 00:18:38.012 } 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "method": "bdev_raid_set_options", 00:18:38.012 "params": { 00:18:38.012 "process_window_size_kb": 1024 00:18:38.012 } 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "method": "bdev_iscsi_set_options", 00:18:38.012 "params": { 00:18:38.012 "timeout_sec": 30 00:18:38.012 } 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "method": "bdev_nvme_set_options", 00:18:38.012 "params": { 00:18:38.012 "action_on_timeout": "none", 00:18:38.012 "timeout_us": 0, 00:18:38.012 "timeout_admin_us": 0, 00:18:38.012 "keep_alive_timeout_ms": 10000, 00:18:38.012 "transport_retry_count": 4, 00:18:38.012 "arbitration_burst": 0, 00:18:38.012 "low_priority_weight": 0, 00:18:38.012 "medium_priority_weight": 0, 00:18:38.012 "high_priority_weight": 0, 00:18:38.012 "nvme_adminq_poll_period_us": 10000, 00:18:38.012 "nvme_ioq_poll_period_us": 0, 00:18:38.012 "io_queue_requests": 512, 00:18:38.012 "delay_cmd_submit": true, 00:18:38.012 "bdev_retry_count": 3, 00:18:38.012 "transport_ack_timeout": 0, 00:18:38.012 "ctrlr_loss_timeout_sec": 0, 00:18:38.012 "reconnect_delay_sec": 0, 00:18:38.012 "fast_io_fail_timeout_sec": 0, 00:18:38.012 "generate_uuids": false, 00:18:38.012 "transport_tos": 0, 00:18:38.012 "io_path_stat": false, 00:18:38.012 "allow_accel_sequence": false 00:18:38.012 } 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "method": "bdev_nvme_attach_controller", 00:18:38.012 "params": { 00:18:38.012 "name": "TLSTEST", 00:18:38.012 "trtype": "TCP", 00:18:38.012 "adrfam": "IPv4", 00:18:38.012 "traddr": "10.0.0.2", 00:18:38.012 "trsvcid": "4420", 00:18:38.012 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:38.012 "prchk_reftag": false, 00:18:38.012 "prchk_guard": false, 00:18:38.012 "ctrlr_loss_timeout_sec": 0, 00:18:38.012 "reconnect_delay_sec": 0, 00:18:38.012 "fast_io_fail_timeout_sec": 0, 00:18:38.012 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:38.012 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:38.012 "hdgst": false, 00:18:38.012 "ddgst": false 00:18:38.012 } 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "method": "bdev_nvme_set_hotplug", 00:18:38.012 "params": { 00:18:38.012 "period_us": 100000, 00:18:38.012 "enable": false 00:18:38.012 } 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "method": "bdev_wait_for_examine" 00:18:38.012 } 00:18:38.012 ] 00:18:38.012 }, 00:18:38.012 { 00:18:38.012 "subsystem": "nbd", 00:18:38.012 "config": [] 00:18:38.012 } 00:18:38.012 ] 00:18:38.012 }' 00:18:38.012 20:24:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:38.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:38.012 20:24:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:38.012 20:24:09 -- common/autotest_common.sh@10 -- # set +x 00:18:38.012 [2024-07-22 20:24:09.739710] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:38.012 [2024-07-22 20:24:09.739755] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3435931 ] 00:18:38.012 EAL: No free 2048 kB hugepages reported on node 1 00:18:38.012 [2024-07-22 20:24:09.789317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:38.012 [2024-07-22 20:24:09.865499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:38.271 [2024-07-22 20:24:09.999454] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:38.838 20:24:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:38.838 20:24:10 -- common/autotest_common.sh@852 -- # return 0 00:18:38.838 20:24:10 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:38.838 Running I/O for 10 seconds... 00:18:48.813 00:18:48.813 Latency(us) 00:18:48.813 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:48.813 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:48.813 Verification LBA range: start 0x0 length 0x2000 00:18:48.813 TLSTESTn1 : 10.03 2140.67 8.36 0.00 0.00 59701.20 9687.93 83886.08 00:18:48.813 =================================================================================================================== 00:18:48.813 Total : 2140.67 8.36 0.00 0.00 59701.20 9687.93 83886.08 00:18:48.813 0 00:18:48.813 20:24:20 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:48.813 20:24:20 -- target/tls.sh@223 -- # killprocess 3435931 00:18:48.813 20:24:20 -- common/autotest_common.sh@926 -- # '[' -z 3435931 ']' 00:18:48.813 20:24:20 -- common/autotest_common.sh@930 -- # kill -0 3435931 00:18:48.813 20:24:20 -- common/autotest_common.sh@931 -- # uname 00:18:48.813 20:24:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:48.813 20:24:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3435931 00:18:49.072 20:24:20 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:49.072 20:24:20 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:49.072 20:24:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3435931' 00:18:49.072 killing process with pid 3435931 00:18:49.072 20:24:20 -- common/autotest_common.sh@945 -- # kill 3435931 00:18:49.072 Received shutdown signal, test time was about 10.000000 seconds 00:18:49.072 00:18:49.072 Latency(us) 00:18:49.072 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:49.072 =================================================================================================================== 00:18:49.072 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:49.072 20:24:20 -- common/autotest_common.sh@950 -- # wait 3435931 00:18:49.072 20:24:20 -- target/tls.sh@224 -- # killprocess 3435580 00:18:49.072 20:24:20 -- common/autotest_common.sh@926 -- # '[' -z 3435580 ']' 00:18:49.072 20:24:20 -- common/autotest_common.sh@930 -- # kill -0 3435580 00:18:49.072 20:24:20 -- common/autotest_common.sh@931 -- # uname 00:18:49.072 20:24:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:49.072 20:24:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3435580 00:18:49.331 20:24:21 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:49.331 20:24:21 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:49.331 20:24:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3435580' 00:18:49.331 killing process with pid 3435580 00:18:49.331 20:24:21 -- common/autotest_common.sh@945 -- # kill 3435580 00:18:49.331 20:24:21 -- common/autotest_common.sh@950 -- # wait 3435580 00:18:49.331 20:24:21 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:49.331 20:24:21 -- target/tls.sh@227 -- # cleanup 00:18:49.331 20:24:21 -- target/tls.sh@15 -- # process_shm --id 0 00:18:49.331 20:24:21 -- common/autotest_common.sh@796 -- # type=--id 00:18:49.331 20:24:21 -- common/autotest_common.sh@797 -- # id=0 00:18:49.331 20:24:21 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:18:49.331 20:24:21 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:49.331 20:24:21 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:18:49.331 20:24:21 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:18:49.331 20:24:21 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:18:49.331 20:24:21 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:49.331 nvmf_trace.0 00:18:49.589 20:24:21 -- common/autotest_common.sh@811 -- # return 0 00:18:49.589 20:24:21 -- target/tls.sh@16 -- # killprocess 3435931 00:18:49.589 20:24:21 -- common/autotest_common.sh@926 -- # '[' -z 3435931 ']' 00:18:49.589 20:24:21 -- common/autotest_common.sh@930 -- # kill -0 3435931 00:18:49.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3435931) - No such process 00:18:49.589 20:24:21 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3435931 is not found' 00:18:49.589 Process with pid 3435931 is not found 00:18:49.589 20:24:21 -- target/tls.sh@17 -- # nvmftestfini 00:18:49.589 20:24:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:49.589 20:24:21 -- nvmf/common.sh@116 -- # sync 00:18:49.589 20:24:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:49.589 20:24:21 -- nvmf/common.sh@119 -- # set +e 00:18:49.589 20:24:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:49.589 20:24:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:49.589 rmmod nvme_tcp 00:18:49.589 rmmod nvme_fabrics 00:18:49.589 rmmod nvme_keyring 00:18:49.589 20:24:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:49.589 20:24:21 -- nvmf/common.sh@123 -- # set -e 00:18:49.589 20:24:21 -- nvmf/common.sh@124 -- # return 0 00:18:49.589 20:24:21 -- nvmf/common.sh@477 -- # '[' -n 3435580 ']' 00:18:49.589 20:24:21 -- nvmf/common.sh@478 -- # killprocess 3435580 00:18:49.589 20:24:21 -- common/autotest_common.sh@926 -- # '[' -z 3435580 ']' 00:18:49.589 20:24:21 -- common/autotest_common.sh@930 -- # kill -0 3435580 00:18:49.589 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3435580) - No such process 00:18:49.589 20:24:21 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3435580 is not found' 00:18:49.589 Process with pid 3435580 is not found 00:18:49.589 20:24:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:49.589 20:24:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:49.589 20:24:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:49.589 20:24:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:49.589 20:24:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:49.589 20:24:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:49.589 20:24:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:49.589 20:24:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.542 20:24:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:51.542 20:24:23 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:51.542 00:18:51.542 real 1m11.949s 00:18:51.542 user 1m49.373s 00:18:51.542 sys 0m24.374s 00:18:51.542 20:24:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:51.542 20:24:23 -- common/autotest_common.sh@10 -- # set +x 00:18:51.542 ************************************ 00:18:51.542 END TEST nvmf_tls 00:18:51.542 ************************************ 00:18:51.542 20:24:23 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:51.542 20:24:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:51.542 20:24:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:51.542 20:24:23 -- common/autotest_common.sh@10 -- # set +x 00:18:51.542 ************************************ 00:18:51.542 START TEST nvmf_fips 00:18:51.542 ************************************ 00:18:51.542 20:24:23 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:51.800 * Looking for test storage... 00:18:51.800 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:51.800 20:24:23 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:51.800 20:24:23 -- nvmf/common.sh@7 -- # uname -s 00:18:51.800 20:24:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:51.800 20:24:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:51.800 20:24:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:51.800 20:24:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:51.800 20:24:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:51.800 20:24:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:51.800 20:24:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:51.800 20:24:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:51.800 20:24:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:51.800 20:24:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:51.800 20:24:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:18:51.800 20:24:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:18:51.800 20:24:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:51.800 20:24:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:51.800 20:24:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:51.800 20:24:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:51.800 20:24:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:51.800 20:24:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:51.800 20:24:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:51.800 20:24:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.801 20:24:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.801 20:24:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.801 20:24:23 -- paths/export.sh@5 -- # export PATH 00:18:51.801 20:24:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.801 20:24:23 -- nvmf/common.sh@46 -- # : 0 00:18:51.801 20:24:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:51.801 20:24:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:51.801 20:24:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:51.801 20:24:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:51.801 20:24:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:51.801 20:24:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:51.801 20:24:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:51.801 20:24:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:51.801 20:24:23 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:51.801 20:24:23 -- fips/fips.sh@89 -- # check_openssl_version 00:18:51.801 20:24:23 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:51.801 20:24:23 -- fips/fips.sh@85 -- # openssl version 00:18:51.801 20:24:23 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:51.801 20:24:23 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:18:51.801 20:24:23 -- scripts/common.sh@375 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:18:51.801 20:24:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:51.801 20:24:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:51.801 20:24:23 -- scripts/common.sh@335 -- # IFS=.-: 00:18:51.801 20:24:23 -- scripts/common.sh@335 -- # read -ra ver1 00:18:51.801 20:24:23 -- scripts/common.sh@336 -- # IFS=.-: 00:18:51.801 20:24:23 -- scripts/common.sh@336 -- # read -ra ver2 00:18:51.801 20:24:23 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:51.801 20:24:23 -- scripts/common.sh@339 -- # ver1_l=3 00:18:51.801 20:24:23 -- scripts/common.sh@340 -- # ver2_l=3 00:18:51.801 20:24:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:51.801 20:24:23 -- scripts/common.sh@343 -- # case "$op" in 00:18:51.801 20:24:23 -- scripts/common.sh@347 -- # : 1 00:18:51.801 20:24:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:51.801 20:24:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:51.801 20:24:23 -- scripts/common.sh@364 -- # decimal 3 00:18:51.801 20:24:23 -- scripts/common.sh@352 -- # local d=3 00:18:51.801 20:24:23 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:51.801 20:24:23 -- scripts/common.sh@354 -- # echo 3 00:18:51.801 20:24:23 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:51.801 20:24:23 -- scripts/common.sh@365 -- # decimal 3 00:18:51.801 20:24:23 -- scripts/common.sh@352 -- # local d=3 00:18:51.801 20:24:23 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:51.801 20:24:23 -- scripts/common.sh@354 -- # echo 3 00:18:51.801 20:24:23 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:51.801 20:24:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:51.801 20:24:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:51.801 20:24:23 -- scripts/common.sh@363 -- # (( v++ )) 00:18:51.801 20:24:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:51.801 20:24:23 -- scripts/common.sh@364 -- # decimal 0 00:18:51.801 20:24:23 -- scripts/common.sh@352 -- # local d=0 00:18:51.801 20:24:23 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:51.801 20:24:23 -- scripts/common.sh@354 -- # echo 0 00:18:51.801 20:24:23 -- scripts/common.sh@364 -- # ver1[v]=0 00:18:51.801 20:24:23 -- scripts/common.sh@365 -- # decimal 0 00:18:51.801 20:24:23 -- scripts/common.sh@352 -- # local d=0 00:18:51.801 20:24:23 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:51.801 20:24:23 -- scripts/common.sh@354 -- # echo 0 00:18:51.801 20:24:23 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:51.801 20:24:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:51.801 20:24:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:51.801 20:24:23 -- scripts/common.sh@363 -- # (( v++ )) 00:18:51.801 20:24:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:51.801 20:24:23 -- scripts/common.sh@364 -- # decimal 9 00:18:51.801 20:24:23 -- scripts/common.sh@352 -- # local d=9 00:18:51.801 20:24:23 -- scripts/common.sh@353 -- # [[ 9 =~ ^[0-9]+$ ]] 00:18:51.801 20:24:23 -- scripts/common.sh@354 -- # echo 9 00:18:51.801 20:24:23 -- scripts/common.sh@364 -- # ver1[v]=9 00:18:51.801 20:24:23 -- scripts/common.sh@365 -- # decimal 0 00:18:51.801 20:24:23 -- scripts/common.sh@352 -- # local d=0 00:18:51.801 20:24:23 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:51.801 20:24:23 -- scripts/common.sh@354 -- # echo 0 00:18:51.801 20:24:23 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:51.801 20:24:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:51.801 20:24:23 -- scripts/common.sh@366 -- # return 0 00:18:51.801 20:24:23 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:51.801 20:24:23 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:51.801 20:24:23 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:51.801 20:24:23 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:51.801 20:24:23 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:51.801 20:24:23 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:51.801 20:24:23 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:51.801 20:24:23 -- fips/fips.sh@105 -- # export OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:18:51.801 20:24:23 -- fips/fips.sh@105 -- # OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:18:51.801 20:24:23 -- fips/fips.sh@114 -- # build_openssl_config 00:18:51.801 20:24:23 -- fips/fips.sh@37 -- # cat 00:18:51.801 20:24:23 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:51.801 20:24:23 -- fips/fips.sh@58 -- # cat - 00:18:51.801 20:24:23 -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:51.801 20:24:23 -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:18:51.801 20:24:23 -- fips/fips.sh@117 -- # mapfile -t providers 00:18:51.801 20:24:23 -- fips/fips.sh@117 -- # OPENSSL_CONF=spdk_fips.conf 00:18:51.801 20:24:23 -- fips/fips.sh@117 -- # openssl list -providers 00:18:51.801 20:24:23 -- fips/fips.sh@117 -- # grep name 00:18:51.801 20:24:23 -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:18:51.801 20:24:23 -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:18:51.801 20:24:23 -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:51.801 20:24:23 -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:18:51.801 20:24:23 -- common/autotest_common.sh@640 -- # local es=0 00:18:51.801 20:24:23 -- fips/fips.sh@128 -- # : 00:18:51.801 20:24:23 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:51.801 20:24:23 -- common/autotest_common.sh@628 -- # local arg=openssl 00:18:51.801 20:24:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:51.801 20:24:23 -- common/autotest_common.sh@632 -- # type -t openssl 00:18:51.801 20:24:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:51.801 20:24:23 -- common/autotest_common.sh@634 -- # type -P openssl 00:18:51.801 20:24:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:51.801 20:24:23 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:18:51.801 20:24:23 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:18:51.801 20:24:23 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:18:51.801 Error setting digest 00:18:51.801 00F29B3FAC7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:18:51.801 00F29B3FAC7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:18:51.801 20:24:23 -- common/autotest_common.sh@643 -- # es=1 00:18:51.801 20:24:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:51.801 20:24:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:51.801 20:24:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:51.801 20:24:23 -- fips/fips.sh@131 -- # nvmftestinit 00:18:51.801 20:24:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:52.060 20:24:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:52.060 20:24:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:52.060 20:24:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:52.060 20:24:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:52.060 20:24:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:52.060 20:24:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:52.060 20:24:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:52.060 20:24:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:52.060 20:24:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:52.060 20:24:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:52.060 20:24:23 -- common/autotest_common.sh@10 -- # set +x 00:18:57.335 20:24:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:57.335 20:24:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:57.335 20:24:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:57.335 20:24:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:57.335 20:24:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:57.335 20:24:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:57.335 20:24:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:57.335 20:24:29 -- nvmf/common.sh@294 -- # net_devs=() 00:18:57.335 20:24:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:57.335 20:24:29 -- nvmf/common.sh@295 -- # e810=() 00:18:57.335 20:24:29 -- nvmf/common.sh@295 -- # local -ga e810 00:18:57.335 20:24:29 -- nvmf/common.sh@296 -- # x722=() 00:18:57.335 20:24:29 -- nvmf/common.sh@296 -- # local -ga x722 00:18:57.335 20:24:29 -- nvmf/common.sh@297 -- # mlx=() 00:18:57.335 20:24:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:57.335 20:24:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:57.335 20:24:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:57.335 20:24:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:57.335 20:24:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:57.335 20:24:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.335 20:24:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:18:57.335 Found 0000:86:00.0 (0x8086 - 0x159b) 00:18:57.335 20:24:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.335 20:24:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:18:57.335 Found 0000:86:00.1 (0x8086 - 0x159b) 00:18:57.335 20:24:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:57.335 20:24:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:57.335 20:24:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.335 20:24:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.336 20:24:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.336 20:24:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.336 20:24:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:18:57.336 Found net devices under 0000:86:00.0: cvl_0_0 00:18:57.336 20:24:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.336 20:24:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.336 20:24:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.336 20:24:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.336 20:24:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.336 20:24:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:18:57.336 Found net devices under 0000:86:00.1: cvl_0_1 00:18:57.336 20:24:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.336 20:24:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:57.336 20:24:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:57.336 20:24:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:57.336 20:24:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:57.336 20:24:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:57.336 20:24:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:57.336 20:24:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:57.336 20:24:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:57.336 20:24:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:57.336 20:24:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:57.336 20:24:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:57.336 20:24:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:57.336 20:24:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:57.336 20:24:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:57.336 20:24:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:57.336 20:24:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:57.336 20:24:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:57.336 20:24:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:57.596 20:24:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:57.596 20:24:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:57.596 20:24:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:57.596 20:24:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:57.596 20:24:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:57.596 20:24:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:57.596 20:24:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:57.596 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:57.596 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:18:57.596 00:18:57.596 --- 10.0.0.2 ping statistics --- 00:18:57.596 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:57.596 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:18:57.596 20:24:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:57.596 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:57.596 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:18:57.596 00:18:57.596 --- 10.0.0.1 ping statistics --- 00:18:57.596 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:57.596 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:18:57.596 20:24:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:57.596 20:24:29 -- nvmf/common.sh@410 -- # return 0 00:18:57.596 20:24:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:57.596 20:24:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:57.596 20:24:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:57.596 20:24:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:57.596 20:24:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:57.596 20:24:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:57.596 20:24:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:57.596 20:24:29 -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:18:57.596 20:24:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:57.596 20:24:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:57.596 20:24:29 -- common/autotest_common.sh@10 -- # set +x 00:18:57.596 20:24:29 -- nvmf/common.sh@469 -- # nvmfpid=3441416 00:18:57.596 20:24:29 -- nvmf/common.sh@470 -- # waitforlisten 3441416 00:18:57.596 20:24:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:57.596 20:24:29 -- common/autotest_common.sh@819 -- # '[' -z 3441416 ']' 00:18:57.596 20:24:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:57.596 20:24:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:57.596 20:24:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:57.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:57.596 20:24:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:57.596 20:24:29 -- common/autotest_common.sh@10 -- # set +x 00:18:57.596 [2024-07-22 20:24:29.529592] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:57.596 [2024-07-22 20:24:29.529636] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:57.855 EAL: No free 2048 kB hugepages reported on node 1 00:18:57.855 [2024-07-22 20:24:29.586347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:57.855 [2024-07-22 20:24:29.660545] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:57.855 [2024-07-22 20:24:29.660655] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:57.855 [2024-07-22 20:24:29.660663] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:57.855 [2024-07-22 20:24:29.660670] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:57.855 [2024-07-22 20:24:29.660690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:58.424 20:24:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:58.424 20:24:30 -- common/autotest_common.sh@852 -- # return 0 00:18:58.424 20:24:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:58.424 20:24:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:58.424 20:24:30 -- common/autotest_common.sh@10 -- # set +x 00:18:58.424 20:24:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:58.424 20:24:30 -- fips/fips.sh@134 -- # trap cleanup EXIT 00:18:58.424 20:24:30 -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:58.424 20:24:30 -- fips/fips.sh@138 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:58.424 20:24:30 -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:58.424 20:24:30 -- fips/fips.sh@140 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:58.424 20:24:30 -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:58.424 20:24:30 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:58.424 20:24:30 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:58.683 [2024-07-22 20:24:30.488391] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:58.683 [2024-07-22 20:24:30.504408] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:58.683 [2024-07-22 20:24:30.504584] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:58.683 malloc0 00:18:58.683 20:24:30 -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:58.683 20:24:30 -- fips/fips.sh@148 -- # bdevperf_pid=3441666 00:18:58.683 20:24:30 -- fips/fips.sh@149 -- # waitforlisten 3441666 /var/tmp/bdevperf.sock 00:18:58.683 20:24:30 -- fips/fips.sh@146 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:58.683 20:24:30 -- common/autotest_common.sh@819 -- # '[' -z 3441666 ']' 00:18:58.683 20:24:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:58.683 20:24:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:58.683 20:24:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:58.683 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:58.683 20:24:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:58.683 20:24:30 -- common/autotest_common.sh@10 -- # set +x 00:18:58.683 [2024-07-22 20:24:30.609563] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:18:58.683 [2024-07-22 20:24:30.609615] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3441666 ] 00:18:58.942 EAL: No free 2048 kB hugepages reported on node 1 00:18:58.942 [2024-07-22 20:24:30.659976] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:58.942 [2024-07-22 20:24:30.731082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:59.510 20:24:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:59.510 20:24:31 -- common/autotest_common.sh@852 -- # return 0 00:18:59.510 20:24:31 -- fips/fips.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:59.769 [2024-07-22 20:24:31.545714] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:59.769 TLSTESTn1 00:18:59.769 20:24:31 -- fips/fips.sh@155 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:19:00.029 Running I/O for 10 seconds... 00:19:10.010 00:19:10.010 Latency(us) 00:19:10.010 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:10.010 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:10.010 Verification LBA range: start 0x0 length 0x2000 00:19:10.010 TLSTESTn1 : 10.03 2053.43 8.02 0.00 0.00 62266.99 4017.64 79782.96 00:19:10.010 =================================================================================================================== 00:19:10.010 Total : 2053.43 8.02 0.00 0.00 62266.99 4017.64 79782.96 00:19:10.010 0 00:19:10.010 20:24:41 -- fips/fips.sh@1 -- # cleanup 00:19:10.010 20:24:41 -- fips/fips.sh@15 -- # process_shm --id 0 00:19:10.010 20:24:41 -- common/autotest_common.sh@796 -- # type=--id 00:19:10.010 20:24:41 -- common/autotest_common.sh@797 -- # id=0 00:19:10.010 20:24:41 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:19:10.010 20:24:41 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:19:10.010 20:24:41 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:19:10.010 20:24:41 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:19:10.010 20:24:41 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:19:10.010 20:24:41 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:19:10.010 nvmf_trace.0 00:19:10.010 20:24:41 -- common/autotest_common.sh@811 -- # return 0 00:19:10.010 20:24:41 -- fips/fips.sh@16 -- # killprocess 3441666 00:19:10.010 20:24:41 -- common/autotest_common.sh@926 -- # '[' -z 3441666 ']' 00:19:10.010 20:24:41 -- common/autotest_common.sh@930 -- # kill -0 3441666 00:19:10.010 20:24:41 -- common/autotest_common.sh@931 -- # uname 00:19:10.010 20:24:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:10.010 20:24:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3441666 00:19:10.010 20:24:41 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:10.010 20:24:41 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:10.010 20:24:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3441666' 00:19:10.010 killing process with pid 3441666 00:19:10.010 20:24:41 -- common/autotest_common.sh@945 -- # kill 3441666 00:19:10.010 Received shutdown signal, test time was about 10.000000 seconds 00:19:10.010 00:19:10.010 Latency(us) 00:19:10.010 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:10.010 =================================================================================================================== 00:19:10.010 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:10.010 20:24:41 -- common/autotest_common.sh@950 -- # wait 3441666 00:19:10.269 20:24:42 -- fips/fips.sh@17 -- # nvmftestfini 00:19:10.269 20:24:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:10.269 20:24:42 -- nvmf/common.sh@116 -- # sync 00:19:10.269 20:24:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:10.269 20:24:42 -- nvmf/common.sh@119 -- # set +e 00:19:10.269 20:24:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:10.269 20:24:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:10.269 rmmod nvme_tcp 00:19:10.269 rmmod nvme_fabrics 00:19:10.269 rmmod nvme_keyring 00:19:10.269 20:24:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:10.269 20:24:42 -- nvmf/common.sh@123 -- # set -e 00:19:10.269 20:24:42 -- nvmf/common.sh@124 -- # return 0 00:19:10.269 20:24:42 -- nvmf/common.sh@477 -- # '[' -n 3441416 ']' 00:19:10.269 20:24:42 -- nvmf/common.sh@478 -- # killprocess 3441416 00:19:10.269 20:24:42 -- common/autotest_common.sh@926 -- # '[' -z 3441416 ']' 00:19:10.269 20:24:42 -- common/autotest_common.sh@930 -- # kill -0 3441416 00:19:10.269 20:24:42 -- common/autotest_common.sh@931 -- # uname 00:19:10.269 20:24:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:10.269 20:24:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3441416 00:19:10.529 20:24:42 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:19:10.529 20:24:42 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:19:10.529 20:24:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3441416' 00:19:10.529 killing process with pid 3441416 00:19:10.529 20:24:42 -- common/autotest_common.sh@945 -- # kill 3441416 00:19:10.529 20:24:42 -- common/autotest_common.sh@950 -- # wait 3441416 00:19:10.529 20:24:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:10.529 20:24:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:10.529 20:24:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:10.529 20:24:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:10.529 20:24:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:10.529 20:24:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:10.529 20:24:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:10.529 20:24:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:13.062 20:24:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:13.062 20:24:44 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:13.062 00:19:13.062 real 0m21.035s 00:19:13.062 user 0m22.749s 00:19:13.062 sys 0m9.040s 00:19:13.062 20:24:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:13.062 20:24:44 -- common/autotest_common.sh@10 -- # set +x 00:19:13.062 ************************************ 00:19:13.062 END TEST nvmf_fips 00:19:13.062 ************************************ 00:19:13.062 20:24:44 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:19:13.062 20:24:44 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:19:13.062 20:24:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:13.062 20:24:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:13.062 20:24:44 -- common/autotest_common.sh@10 -- # set +x 00:19:13.062 ************************************ 00:19:13.062 START TEST nvmf_fuzz 00:19:13.062 ************************************ 00:19:13.062 20:24:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:19:13.062 * Looking for test storage... 00:19:13.062 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:13.062 20:24:44 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:13.062 20:24:44 -- nvmf/common.sh@7 -- # uname -s 00:19:13.062 20:24:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:13.062 20:24:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:13.062 20:24:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:13.062 20:24:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:13.062 20:24:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:13.062 20:24:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:13.062 20:24:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:13.062 20:24:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:13.062 20:24:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:13.062 20:24:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:13.062 20:24:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:19:13.062 20:24:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:19:13.062 20:24:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:13.062 20:24:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:13.062 20:24:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:13.062 20:24:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:13.062 20:24:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:13.062 20:24:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:13.062 20:24:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:13.062 20:24:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:13.063 20:24:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:13.063 20:24:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:13.063 20:24:44 -- paths/export.sh@5 -- # export PATH 00:19:13.063 20:24:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:13.063 20:24:44 -- nvmf/common.sh@46 -- # : 0 00:19:13.063 20:24:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:13.063 20:24:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:13.063 20:24:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:13.063 20:24:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:13.063 20:24:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:13.063 20:24:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:13.063 20:24:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:13.063 20:24:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:13.063 20:24:44 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:19:13.063 20:24:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:13.063 20:24:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:13.063 20:24:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:13.063 20:24:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:13.063 20:24:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:13.063 20:24:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:13.063 20:24:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:13.063 20:24:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:13.063 20:24:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:13.063 20:24:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:13.063 20:24:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:13.063 20:24:44 -- common/autotest_common.sh@10 -- # set +x 00:19:18.330 20:24:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:18.330 20:24:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:18.330 20:24:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:18.330 20:24:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:18.330 20:24:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:18.330 20:24:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:18.330 20:24:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:18.330 20:24:49 -- nvmf/common.sh@294 -- # net_devs=() 00:19:18.330 20:24:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:18.330 20:24:49 -- nvmf/common.sh@295 -- # e810=() 00:19:18.330 20:24:49 -- nvmf/common.sh@295 -- # local -ga e810 00:19:18.330 20:24:49 -- nvmf/common.sh@296 -- # x722=() 00:19:18.330 20:24:49 -- nvmf/common.sh@296 -- # local -ga x722 00:19:18.330 20:24:49 -- nvmf/common.sh@297 -- # mlx=() 00:19:18.330 20:24:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:18.330 20:24:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:18.330 20:24:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:18.330 20:24:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:18.330 20:24:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:18.330 20:24:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:18.330 20:24:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:19:18.330 Found 0000:86:00.0 (0x8086 - 0x159b) 00:19:18.330 20:24:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:18.330 20:24:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:19:18.330 Found 0000:86:00.1 (0x8086 - 0x159b) 00:19:18.330 20:24:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:18.330 20:24:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:18.330 20:24:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:18.330 20:24:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:18.330 20:24:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:18.330 20:24:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:19:18.330 Found net devices under 0000:86:00.0: cvl_0_0 00:19:18.330 20:24:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:18.330 20:24:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:18.330 20:24:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:18.330 20:24:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:18.330 20:24:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:18.330 20:24:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:19:18.330 Found net devices under 0000:86:00.1: cvl_0_1 00:19:18.330 20:24:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:18.330 20:24:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:18.330 20:24:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:18.330 20:24:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:18.330 20:24:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:18.330 20:24:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:18.330 20:24:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:18.330 20:24:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:18.330 20:24:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:18.330 20:24:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:18.330 20:24:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:18.330 20:24:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:18.330 20:24:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:18.330 20:24:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:18.330 20:24:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:18.330 20:24:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:18.330 20:24:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:18.331 20:24:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:18.331 20:24:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:18.331 20:24:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:18.331 20:24:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:18.331 20:24:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:18.331 20:24:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:18.331 20:24:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:18.331 20:24:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:18.331 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:18.331 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.158 ms 00:19:18.331 00:19:18.331 --- 10.0.0.2 ping statistics --- 00:19:18.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:18.331 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:19:18.331 20:24:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:18.331 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:18.331 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.230 ms 00:19:18.331 00:19:18.331 --- 10.0.0.1 ping statistics --- 00:19:18.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:18.331 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:19:18.331 20:24:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:18.331 20:24:49 -- nvmf/common.sh@410 -- # return 0 00:19:18.331 20:24:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:18.331 20:24:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:18.331 20:24:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:18.331 20:24:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:18.331 20:24:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:18.331 20:24:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:18.331 20:24:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:18.331 20:24:50 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:19:18.331 20:24:50 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3447068 00:19:18.331 20:24:50 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:18.331 20:24:50 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3447068 00:19:18.331 20:24:50 -- common/autotest_common.sh@819 -- # '[' -z 3447068 ']' 00:19:18.331 20:24:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:18.331 20:24:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:18.331 20:24:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:18.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:18.331 20:24:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:18.331 20:24:50 -- common/autotest_common.sh@10 -- # set +x 00:19:19.265 20:24:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:19.265 20:24:50 -- common/autotest_common.sh@852 -- # return 0 00:19:19.265 20:24:50 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:19.265 20:24:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:19.265 20:24:50 -- common/autotest_common.sh@10 -- # set +x 00:19:19.265 20:24:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:19.265 20:24:50 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:19:19.265 20:24:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:19.265 20:24:50 -- common/autotest_common.sh@10 -- # set +x 00:19:19.265 Malloc0 00:19:19.265 20:24:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:19.265 20:24:50 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:19.265 20:24:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:19.265 20:24:50 -- common/autotest_common.sh@10 -- # set +x 00:19:19.265 20:24:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:19.265 20:24:50 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:19.265 20:24:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:19.265 20:24:50 -- common/autotest_common.sh@10 -- # set +x 00:19:19.265 20:24:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:19.265 20:24:50 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:19.265 20:24:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:19.265 20:24:50 -- common/autotest_common.sh@10 -- # set +x 00:19:19.265 20:24:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:19.265 20:24:50 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:19:19.265 20:24:50 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:51.402 Fuzzing completed. Shutting down the fuzz application 00:19:51.402 00:19:51.402 Dumping successful admin opcodes: 00:19:51.402 8, 9, 10, 24, 00:19:51.402 Dumping successful io opcodes: 00:19:51.402 0, 9, 00:19:51.402 NS: 0x200003aeff00 I/O qp, Total commands completed: 900678, total successful commands: 5247, random_seed: 2622379968 00:19:51.402 NS: 0x200003aeff00 admin qp, Total commands completed: 96025, total successful commands: 783, random_seed: 680237504 00:19:51.402 20:25:21 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:51.402 Fuzzing completed. Shutting down the fuzz application 00:19:51.402 00:19:51.402 Dumping successful admin opcodes: 00:19:51.402 24, 00:19:51.402 Dumping successful io opcodes: 00:19:51.402 00:19:51.402 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 602220354 00:19:51.402 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 602313550 00:19:51.402 20:25:22 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:51.402 20:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:51.402 20:25:22 -- common/autotest_common.sh@10 -- # set +x 00:19:51.402 20:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:51.402 20:25:22 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:51.402 20:25:22 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:51.402 20:25:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:51.402 20:25:22 -- nvmf/common.sh@116 -- # sync 00:19:51.402 20:25:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:51.402 20:25:22 -- nvmf/common.sh@119 -- # set +e 00:19:51.402 20:25:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:51.402 20:25:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:51.402 rmmod nvme_tcp 00:19:51.402 rmmod nvme_fabrics 00:19:51.402 rmmod nvme_keyring 00:19:51.402 20:25:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:51.402 20:25:22 -- nvmf/common.sh@123 -- # set -e 00:19:51.402 20:25:22 -- nvmf/common.sh@124 -- # return 0 00:19:51.402 20:25:22 -- nvmf/common.sh@477 -- # '[' -n 3447068 ']' 00:19:51.402 20:25:22 -- nvmf/common.sh@478 -- # killprocess 3447068 00:19:51.402 20:25:22 -- common/autotest_common.sh@926 -- # '[' -z 3447068 ']' 00:19:51.402 20:25:22 -- common/autotest_common.sh@930 -- # kill -0 3447068 00:19:51.402 20:25:22 -- common/autotest_common.sh@931 -- # uname 00:19:51.402 20:25:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:51.402 20:25:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3447068 00:19:51.402 20:25:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:51.402 20:25:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:51.402 20:25:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3447068' 00:19:51.402 killing process with pid 3447068 00:19:51.402 20:25:22 -- common/autotest_common.sh@945 -- # kill 3447068 00:19:51.402 20:25:22 -- common/autotest_common.sh@950 -- # wait 3447068 00:19:51.402 20:25:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:51.402 20:25:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:51.402 20:25:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:51.402 20:25:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:51.402 20:25:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:51.402 20:25:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:51.402 20:25:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:51.402 20:25:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:53.304 20:25:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:53.304 20:25:25 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:53.304 00:19:53.304 real 0m40.625s 00:19:53.304 user 0m53.620s 00:19:53.304 sys 0m16.746s 00:19:53.304 20:25:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:53.304 20:25:25 -- common/autotest_common.sh@10 -- # set +x 00:19:53.304 ************************************ 00:19:53.304 END TEST nvmf_fuzz 00:19:53.304 ************************************ 00:19:53.304 20:25:25 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:53.304 20:25:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:53.304 20:25:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:53.304 20:25:25 -- common/autotest_common.sh@10 -- # set +x 00:19:53.304 ************************************ 00:19:53.305 START TEST nvmf_multiconnection 00:19:53.305 ************************************ 00:19:53.305 20:25:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:53.564 * Looking for test storage... 00:19:53.564 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:53.564 20:25:25 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:53.564 20:25:25 -- nvmf/common.sh@7 -- # uname -s 00:19:53.564 20:25:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:53.564 20:25:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:53.564 20:25:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:53.564 20:25:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:53.564 20:25:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:53.564 20:25:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:53.564 20:25:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:53.564 20:25:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:53.564 20:25:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:53.564 20:25:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:53.564 20:25:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:19:53.564 20:25:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:19:53.564 20:25:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:53.564 20:25:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:53.564 20:25:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:53.564 20:25:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:53.564 20:25:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:53.564 20:25:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:53.564 20:25:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:53.564 20:25:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:53.564 20:25:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:53.564 20:25:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:53.564 20:25:25 -- paths/export.sh@5 -- # export PATH 00:19:53.564 20:25:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:53.564 20:25:25 -- nvmf/common.sh@46 -- # : 0 00:19:53.564 20:25:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:53.564 20:25:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:53.564 20:25:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:53.564 20:25:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:53.564 20:25:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:53.564 20:25:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:53.564 20:25:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:53.564 20:25:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:53.564 20:25:25 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:53.564 20:25:25 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:53.564 20:25:25 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:53.564 20:25:25 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:53.564 20:25:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:53.564 20:25:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:53.564 20:25:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:53.564 20:25:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:53.564 20:25:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:53.564 20:25:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:53.564 20:25:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:53.564 20:25:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:53.564 20:25:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:53.564 20:25:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:53.564 20:25:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:53.564 20:25:25 -- common/autotest_common.sh@10 -- # set +x 00:19:58.828 20:25:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:58.828 20:25:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:58.828 20:25:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:58.828 20:25:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:58.828 20:25:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:58.828 20:25:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:58.828 20:25:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:58.828 20:25:30 -- nvmf/common.sh@294 -- # net_devs=() 00:19:58.828 20:25:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:58.828 20:25:30 -- nvmf/common.sh@295 -- # e810=() 00:19:58.828 20:25:30 -- nvmf/common.sh@295 -- # local -ga e810 00:19:58.828 20:25:30 -- nvmf/common.sh@296 -- # x722=() 00:19:58.828 20:25:30 -- nvmf/common.sh@296 -- # local -ga x722 00:19:58.828 20:25:30 -- nvmf/common.sh@297 -- # mlx=() 00:19:58.828 20:25:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:58.828 20:25:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:58.828 20:25:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:58.828 20:25:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:58.828 20:25:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:58.828 20:25:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:58.828 20:25:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:58.828 20:25:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:58.828 20:25:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:58.828 20:25:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:19:58.828 Found 0000:86:00.0 (0x8086 - 0x159b) 00:19:58.828 20:25:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:58.828 20:25:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:58.829 20:25:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:19:58.829 Found 0000:86:00.1 (0x8086 - 0x159b) 00:19:58.829 20:25:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:58.829 20:25:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:58.829 20:25:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:58.829 20:25:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:58.829 20:25:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:58.829 20:25:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:19:58.829 Found net devices under 0000:86:00.0: cvl_0_0 00:19:58.829 20:25:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:58.829 20:25:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:58.829 20:25:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:58.829 20:25:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:58.829 20:25:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:58.829 20:25:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:19:58.829 Found net devices under 0000:86:00.1: cvl_0_1 00:19:58.829 20:25:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:58.829 20:25:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:58.829 20:25:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:58.829 20:25:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:58.829 20:25:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:58.829 20:25:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:58.829 20:25:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:58.829 20:25:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:58.829 20:25:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:58.829 20:25:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:58.829 20:25:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:58.829 20:25:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:58.829 20:25:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:58.829 20:25:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:58.829 20:25:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:58.829 20:25:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:58.829 20:25:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:58.829 20:25:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:58.829 20:25:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:58.829 20:25:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:58.829 20:25:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:58.829 20:25:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:58.829 20:25:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:58.829 20:25:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:58.829 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:58.829 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.192 ms 00:19:58.829 00:19:58.829 --- 10.0.0.2 ping statistics --- 00:19:58.829 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:58.829 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:19:58.829 20:25:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:58.829 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:58.829 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.241 ms 00:19:58.829 00:19:58.829 --- 10.0.0.1 ping statistics --- 00:19:58.829 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:58.829 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:19:58.829 20:25:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:58.829 20:25:30 -- nvmf/common.sh@410 -- # return 0 00:19:58.829 20:25:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:58.829 20:25:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:58.829 20:25:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:58.829 20:25:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:58.829 20:25:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:58.829 20:25:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:58.829 20:25:30 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:58.829 20:25:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:58.829 20:25:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:58.829 20:25:30 -- common/autotest_common.sh@10 -- # set +x 00:19:58.829 20:25:30 -- nvmf/common.sh@469 -- # nvmfpid=3455734 00:19:58.829 20:25:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:58.829 20:25:30 -- nvmf/common.sh@470 -- # waitforlisten 3455734 00:19:58.829 20:25:30 -- common/autotest_common.sh@819 -- # '[' -z 3455734 ']' 00:19:58.829 20:25:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:58.829 20:25:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:58.829 20:25:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:58.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:58.829 20:25:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:58.829 20:25:30 -- common/autotest_common.sh@10 -- # set +x 00:19:58.829 [2024-07-22 20:25:30.653690] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:19:58.829 [2024-07-22 20:25:30.653739] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:58.829 EAL: No free 2048 kB hugepages reported on node 1 00:19:58.829 [2024-07-22 20:25:30.713465] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:59.089 [2024-07-22 20:25:30.794137] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:59.089 [2024-07-22 20:25:30.794251] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:59.089 [2024-07-22 20:25:30.794260] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:59.089 [2024-07-22 20:25:30.794266] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:59.089 [2024-07-22 20:25:30.794312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:59.089 [2024-07-22 20:25:30.794335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:59.089 [2024-07-22 20:25:30.794397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:59.089 [2024-07-22 20:25:30.794399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:59.656 20:25:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:59.656 20:25:31 -- common/autotest_common.sh@852 -- # return 0 00:19:59.656 20:25:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:59.656 20:25:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:59.656 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.656 20:25:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:59.656 20:25:31 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:59.656 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.656 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.656 [2024-07-22 20:25:31.504291] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:59.656 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.656 20:25:31 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:59.656 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.656 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:59.656 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.656 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.656 Malloc1 00:19:59.656 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.656 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:59.656 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.656 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.656 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.656 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:59.656 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.656 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.656 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.656 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:59.656 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.657 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.657 [2024-07-22 20:25:31.560294] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:59.657 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.657 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.657 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:59.657 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.657 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.657 Malloc2 00:19:59.657 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.657 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:59.657 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.657 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.915 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.915 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:59.915 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.915 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.915 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.915 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:59.915 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.915 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.915 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.915 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.915 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:59.915 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.915 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.915 Malloc3 00:19:59.915 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.915 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.916 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 Malloc4 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.916 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 Malloc5 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.916 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 Malloc6 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.916 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 Malloc7 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.916 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:19:59.916 Malloc8 00:19:59.916 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:59.916 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:59.916 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:59.916 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:00.175 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 Malloc9 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:00.175 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 Malloc10 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:00.175 20:25:31 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 Malloc11 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:31 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:20:00.175 20:25:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:00.175 20:25:31 -- common/autotest_common.sh@10 -- # set +x 00:20:00.175 20:25:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:00.175 20:25:32 -- target/multiconnection.sh@28 -- # seq 1 11 00:20:00.175 20:25:32 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:00.175 20:25:32 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:01.566 20:25:33 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:20:01.566 20:25:33 -- common/autotest_common.sh@1177 -- # local i=0 00:20:01.566 20:25:33 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:01.566 20:25:33 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:01.566 20:25:33 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:03.473 20:25:35 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:03.473 20:25:35 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:03.473 20:25:35 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:20:03.473 20:25:35 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:03.473 20:25:35 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:03.473 20:25:35 -- common/autotest_common.sh@1187 -- # return 0 00:20:03.473 20:25:35 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:03.473 20:25:35 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:20:04.407 20:25:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:20:04.407 20:25:36 -- common/autotest_common.sh@1177 -- # local i=0 00:20:04.407 20:25:36 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:04.407 20:25:36 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:04.407 20:25:36 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:06.938 20:25:38 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:06.938 20:25:38 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:06.938 20:25:38 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:20:06.938 20:25:38 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:06.938 20:25:38 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:06.938 20:25:38 -- common/autotest_common.sh@1187 -- # return 0 00:20:06.938 20:25:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:06.938 20:25:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:20:07.505 20:25:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:20:07.505 20:25:39 -- common/autotest_common.sh@1177 -- # local i=0 00:20:07.763 20:25:39 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:07.763 20:25:39 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:07.763 20:25:39 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:09.662 20:25:41 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:09.662 20:25:41 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:09.662 20:25:41 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:20:09.662 20:25:41 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:09.662 20:25:41 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:09.662 20:25:41 -- common/autotest_common.sh@1187 -- # return 0 00:20:09.662 20:25:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:09.663 20:25:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:20:11.036 20:25:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:20:11.036 20:25:42 -- common/autotest_common.sh@1177 -- # local i=0 00:20:11.036 20:25:42 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:11.036 20:25:42 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:11.036 20:25:42 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:12.951 20:25:44 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:12.951 20:25:44 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:12.951 20:25:44 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:20:12.951 20:25:44 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:12.951 20:25:44 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:12.951 20:25:44 -- common/autotest_common.sh@1187 -- # return 0 00:20:12.951 20:25:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:12.951 20:25:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:20:14.353 20:25:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:20:14.353 20:25:45 -- common/autotest_common.sh@1177 -- # local i=0 00:20:14.353 20:25:45 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:14.353 20:25:45 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:14.353 20:25:45 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:16.255 20:25:47 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:16.255 20:25:47 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:16.255 20:25:47 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:20:16.255 20:25:47 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:16.255 20:25:47 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:16.255 20:25:47 -- common/autotest_common.sh@1187 -- # return 0 00:20:16.255 20:25:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.255 20:25:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:20:17.188 20:25:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:20:17.189 20:25:49 -- common/autotest_common.sh@1177 -- # local i=0 00:20:17.189 20:25:49 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:17.189 20:25:49 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:17.189 20:25:49 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:19.718 20:25:51 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:19.718 20:25:51 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:19.718 20:25:51 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:20:19.718 20:25:51 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:19.718 20:25:51 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:19.718 20:25:51 -- common/autotest_common.sh@1187 -- # return 0 00:20:19.718 20:25:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:19.718 20:25:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:20:20.653 20:25:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:20:20.653 20:25:52 -- common/autotest_common.sh@1177 -- # local i=0 00:20:20.653 20:25:52 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:20.653 20:25:52 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:20.653 20:25:52 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:23.182 20:25:54 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:23.182 20:25:54 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:23.182 20:25:54 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:20:23.182 20:25:54 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:23.182 20:25:54 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:23.182 20:25:54 -- common/autotest_common.sh@1187 -- # return 0 00:20:23.182 20:25:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:23.182 20:25:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:20:24.116 20:25:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:20:24.116 20:25:55 -- common/autotest_common.sh@1177 -- # local i=0 00:20:24.116 20:25:55 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:24.116 20:25:55 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:24.116 20:25:55 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:26.646 20:25:57 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:26.646 20:25:57 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:26.646 20:25:57 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:20:26.646 20:25:57 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:26.646 20:25:57 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:26.646 20:25:57 -- common/autotest_common.sh@1187 -- # return 0 00:20:26.646 20:25:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.646 20:25:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:20:27.580 20:25:59 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:20:27.580 20:25:59 -- common/autotest_common.sh@1177 -- # local i=0 00:20:27.580 20:25:59 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:27.580 20:25:59 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:27.580 20:25:59 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:29.479 20:26:01 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:29.479 20:26:01 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:29.479 20:26:01 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:20:29.479 20:26:01 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:29.479 20:26:01 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:29.479 20:26:01 -- common/autotest_common.sh@1187 -- # return 0 00:20:29.479 20:26:01 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:29.479 20:26:01 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:20:30.903 20:26:02 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:30.903 20:26:02 -- common/autotest_common.sh@1177 -- # local i=0 00:20:30.903 20:26:02 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:30.903 20:26:02 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:30.903 20:26:02 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:32.800 20:26:04 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:32.800 20:26:04 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:32.800 20:26:04 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:20:32.800 20:26:04 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:32.800 20:26:04 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:32.800 20:26:04 -- common/autotest_common.sh@1187 -- # return 0 00:20:32.801 20:26:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:32.801 20:26:04 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:34.702 20:26:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:34.702 20:26:06 -- common/autotest_common.sh@1177 -- # local i=0 00:20:34.702 20:26:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:34.702 20:26:06 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:34.702 20:26:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:36.605 20:26:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:36.605 20:26:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:36.605 20:26:08 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:20:36.605 20:26:08 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:36.605 20:26:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:36.605 20:26:08 -- common/autotest_common.sh@1187 -- # return 0 00:20:36.605 20:26:08 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:36.605 [global] 00:20:36.605 thread=1 00:20:36.605 invalidate=1 00:20:36.605 rw=read 00:20:36.605 time_based=1 00:20:36.605 runtime=10 00:20:36.605 ioengine=libaio 00:20:36.605 direct=1 00:20:36.605 bs=262144 00:20:36.605 iodepth=64 00:20:36.605 norandommap=1 00:20:36.605 numjobs=1 00:20:36.605 00:20:36.605 [job0] 00:20:36.605 filename=/dev/nvme0n1 00:20:36.605 [job1] 00:20:36.605 filename=/dev/nvme10n1 00:20:36.605 [job2] 00:20:36.605 filename=/dev/nvme1n1 00:20:36.605 [job3] 00:20:36.605 filename=/dev/nvme2n1 00:20:36.605 [job4] 00:20:36.605 filename=/dev/nvme3n1 00:20:36.605 [job5] 00:20:36.605 filename=/dev/nvme4n1 00:20:36.605 [job6] 00:20:36.605 filename=/dev/nvme5n1 00:20:36.605 [job7] 00:20:36.605 filename=/dev/nvme6n1 00:20:36.605 [job8] 00:20:36.605 filename=/dev/nvme7n1 00:20:36.605 [job9] 00:20:36.605 filename=/dev/nvme8n1 00:20:36.605 [job10] 00:20:36.605 filename=/dev/nvme9n1 00:20:36.605 Could not set queue depth (nvme0n1) 00:20:36.605 Could not set queue depth (nvme10n1) 00:20:36.605 Could not set queue depth (nvme1n1) 00:20:36.605 Could not set queue depth (nvme2n1) 00:20:36.605 Could not set queue depth (nvme3n1) 00:20:36.605 Could not set queue depth (nvme4n1) 00:20:36.605 Could not set queue depth (nvme5n1) 00:20:36.605 Could not set queue depth (nvme6n1) 00:20:36.605 Could not set queue depth (nvme7n1) 00:20:36.605 Could not set queue depth (nvme8n1) 00:20:36.605 Could not set queue depth (nvme9n1) 00:20:36.894 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:36.894 fio-3.35 00:20:36.894 Starting 11 threads 00:20:49.177 00:20:49.177 job0: (groupid=0, jobs=1): err= 0: pid=3462524: Mon Jul 22 20:26:19 2024 00:20:49.177 read: IOPS=988, BW=247MiB/s (259MB/s)(2488MiB/10062msec) 00:20:49.177 slat (usec): min=8, max=157461, avg=662.46, stdev=3510.97 00:20:49.177 clat (msec): min=5, max=225, avg=63.97, stdev=44.34 00:20:49.177 lat (msec): min=5, max=347, avg=64.63, stdev=44.95 00:20:49.177 clat percentiles (msec): 00:20:49.177 | 1.00th=[ 15], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 32], 00:20:49.177 | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 57], 00:20:49.177 | 70.00th=[ 70], 80.00th=[ 94], 90.00th=[ 138], 95.00th=[ 163], 00:20:49.177 | 99.00th=[ 197], 99.50th=[ 213], 99.90th=[ 222], 99.95th=[ 224], 00:20:49.177 | 99.99th=[ 226] 00:20:49.177 bw ( KiB/s): min=93184, max=486912, per=11.54%, avg=253117.75, stdev=120351.16, samples=20 00:20:49.177 iops : min= 364, max= 1902, avg=988.70, stdev=470.13, samples=20 00:20:49.177 lat (msec) : 10=0.28%, 20=2.63%, 50=51.92%, 100=26.64%, 250=18.52% 00:20:49.177 cpu : usr=0.34%, sys=3.29%, ctx=2705, majf=0, minf=4097 00:20:49.177 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:49.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.177 issued rwts: total=9951,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.177 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.177 job1: (groupid=0, jobs=1): err= 0: pid=3462525: Mon Jul 22 20:26:19 2024 00:20:49.177 read: IOPS=975, BW=244MiB/s (256MB/s)(2461MiB/10095msec) 00:20:49.177 slat (usec): min=9, max=126430, avg=773.72, stdev=2927.95 00:20:49.177 clat (msec): min=3, max=245, avg=64.76, stdev=36.67 00:20:49.177 lat (msec): min=3, max=245, avg=65.54, stdev=37.07 00:20:49.177 clat percentiles (msec): 00:20:49.177 | 1.00th=[ 11], 5.00th=[ 20], 10.00th=[ 28], 20.00th=[ 35], 00:20:49.177 | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 59], 60.00th=[ 66], 00:20:49.177 | 70.00th=[ 74], 80.00th=[ 90], 90.00th=[ 109], 95.00th=[ 132], 00:20:49.177 | 99.00th=[ 194], 99.50th=[ 220], 99.90th=[ 239], 99.95th=[ 245], 00:20:49.177 | 99.99th=[ 245] 00:20:49.177 bw ( KiB/s): min=123904, max=450682, per=11.42%, avg=250348.50, stdev=73150.24, samples=20 00:20:49.177 iops : min= 484, max= 1760, avg=977.90, stdev=285.67, samples=20 00:20:49.177 lat (msec) : 4=0.02%, 10=0.82%, 20=4.86%, 50=30.96%, 100=49.62% 00:20:49.177 lat (msec) : 250=13.71% 00:20:49.177 cpu : usr=0.38%, sys=3.56%, ctx=2505, majf=0, minf=4097 00:20:49.177 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:49.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.177 issued rwts: total=9844,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.177 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.177 job2: (groupid=0, jobs=1): err= 0: pid=3462527: Mon Jul 22 20:26:19 2024 00:20:49.177 read: IOPS=1043, BW=261MiB/s (273MB/s)(2627MiB/10073msec) 00:20:49.177 slat (usec): min=7, max=180736, avg=816.60, stdev=3697.69 00:20:49.177 clat (usec): min=1103, max=353249, avg=60417.97, stdev=34890.41 00:20:49.177 lat (usec): min=1133, max=353279, avg=61234.58, stdev=35388.86 00:20:49.177 clat percentiles (msec): 00:20:49.177 | 1.00th=[ 14], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], 00:20:49.177 | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 59], 00:20:49.177 | 70.00th=[ 67], 80.00th=[ 77], 90.00th=[ 94], 95.00th=[ 144], 00:20:49.177 | 99.00th=[ 192], 99.50th=[ 199], 99.90th=[ 218], 99.95th=[ 218], 00:20:49.177 | 99.99th=[ 330] 00:20:49.177 bw ( KiB/s): min=89088, max=465408, per=12.19%, avg=267342.15, stdev=106692.70, samples=20 00:20:49.177 iops : min= 348, max= 1818, avg=1044.30, stdev=416.77, samples=20 00:20:49.177 lat (msec) : 2=0.05%, 4=0.10%, 10=0.49%, 20=1.98%, 50=42.07% 00:20:49.177 lat (msec) : 100=46.56%, 250=8.71%, 500=0.05% 00:20:49.177 cpu : usr=0.39%, sys=3.67%, ctx=2362, majf=0, minf=3347 00:20:49.177 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:49.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.177 issued rwts: total=10507,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.177 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.177 job3: (groupid=0, jobs=1): err= 0: pid=3462528: Mon Jul 22 20:26:19 2024 00:20:49.177 read: IOPS=608, BW=152MiB/s (160MB/s)(1531MiB/10060msec) 00:20:49.177 slat (usec): min=9, max=140270, avg=1517.41, stdev=5622.14 00:20:49.177 clat (msec): min=12, max=284, avg=103.47, stdev=51.26 00:20:49.177 lat (msec): min=12, max=297, avg=104.98, stdev=52.09 00:20:49.177 clat percentiles (msec): 00:20:49.177 | 1.00th=[ 25], 5.00th=[ 40], 10.00th=[ 48], 20.00th=[ 57], 00:20:49.177 | 30.00th=[ 66], 40.00th=[ 73], 50.00th=[ 85], 60.00th=[ 117], 00:20:49.177 | 70.00th=[ 140], 80.00th=[ 157], 90.00th=[ 174], 95.00th=[ 190], 00:20:49.177 | 99.00th=[ 224], 99.50th=[ 234], 99.90th=[ 259], 99.95th=[ 284], 00:20:49.177 | 99.99th=[ 284] 00:20:49.177 bw ( KiB/s): min=75264, max=328704, per=7.07%, avg=155105.70, stdev=70435.59, samples=20 00:20:49.177 iops : min= 294, max= 1284, avg=605.85, stdev=275.11, samples=20 00:20:49.177 lat (msec) : 20=0.41%, 50=11.50%, 100=44.09%, 250=43.84%, 500=0.16% 00:20:49.177 cpu : usr=0.27%, sys=2.18%, ctx=1382, majf=0, minf=4097 00:20:49.177 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:49.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.177 issued rwts: total=6122,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.177 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.177 job4: (groupid=0, jobs=1): err= 0: pid=3462529: Mon Jul 22 20:26:19 2024 00:20:49.177 read: IOPS=836, BW=209MiB/s (219MB/s)(2101MiB/10045msec) 00:20:49.177 slat (usec): min=8, max=206858, avg=859.47, stdev=5047.57 00:20:49.177 clat (msec): min=3, max=331, avg=75.58, stdev=46.98 00:20:49.177 lat (msec): min=4, max=332, avg=76.44, stdev=47.71 00:20:49.177 clat percentiles (msec): 00:20:49.177 | 1.00th=[ 8], 5.00th=[ 21], 10.00th=[ 28], 20.00th=[ 39], 00:20:49.177 | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 63], 60.00th=[ 70], 00:20:49.177 | 70.00th=[ 85], 80.00th=[ 122], 90.00th=[ 144], 95.00th=[ 167], 00:20:49.177 | 99.00th=[ 207], 99.50th=[ 247], 99.90th=[ 249], 99.95th=[ 262], 00:20:49.177 | 99.99th=[ 334] 00:20:49.177 bw ( KiB/s): min=105984, max=358400, per=9.73%, avg=213478.40, stdev=74161.34, samples=20 00:20:49.177 iops : min= 414, max= 1400, avg=833.90, stdev=289.69, samples=20 00:20:49.177 lat (msec) : 4=0.01%, 10=1.40%, 20=3.55%, 50=29.00%, 100=40.57% 00:20:49.177 lat (msec) : 250=25.37%, 500=0.08% 00:20:49.177 cpu : usr=0.28%, sys=2.46%, ctx=2317, majf=0, minf=4097 00:20:49.177 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:49.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.177 issued rwts: total=8402,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.177 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.177 job5: (groupid=0, jobs=1): err= 0: pid=3462530: Mon Jul 22 20:26:19 2024 00:20:49.177 read: IOPS=782, BW=196MiB/s (205MB/s)(1967MiB/10048msec) 00:20:49.177 slat (usec): min=9, max=141655, avg=879.22, stdev=4125.78 00:20:49.177 clat (usec): min=1285, max=286440, avg=80769.53, stdev=42839.89 00:20:49.177 lat (usec): min=1322, max=330776, avg=81648.75, stdev=43455.53 00:20:49.177 clat percentiles (msec): 00:20:49.177 | 1.00th=[ 11], 5.00th=[ 30], 10.00th=[ 39], 20.00th=[ 47], 00:20:49.177 | 30.00th=[ 56], 40.00th=[ 64], 50.00th=[ 72], 60.00th=[ 80], 00:20:49.177 | 70.00th=[ 90], 80.00th=[ 108], 90.00th=[ 153], 95.00th=[ 165], 00:20:49.177 | 99.00th=[ 215], 99.50th=[ 222], 99.90th=[ 228], 99.95th=[ 275], 00:20:49.177 | 99.99th=[ 288] 00:20:49.177 bw ( KiB/s): min=93696, max=362496, per=9.11%, avg=199743.10, stdev=79203.60, samples=20 00:20:49.177 iops : min= 366, max= 1416, avg=780.20, stdev=309.43, samples=20 00:20:49.177 lat (msec) : 2=0.15%, 4=0.19%, 10=0.60%, 20=0.52%, 50=22.69% 00:20:49.177 lat (msec) : 100=51.93%, 250=23.84%, 500=0.08% 00:20:49.177 cpu : usr=0.30%, sys=2.71%, ctx=2108, majf=0, minf=4097 00:20:49.177 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:49.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.177 issued rwts: total=7866,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.177 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.177 job6: (groupid=0, jobs=1): err= 0: pid=3462531: Mon Jul 22 20:26:19 2024 00:20:49.177 read: IOPS=633, BW=158MiB/s (166MB/s)(1594MiB/10063msec) 00:20:49.177 slat (usec): min=8, max=168162, avg=1161.24, stdev=4928.11 00:20:49.177 clat (msec): min=2, max=314, avg=99.67, stdev=50.17 00:20:49.177 lat (msec): min=2, max=314, avg=100.83, stdev=50.85 00:20:49.177 clat percentiles (msec): 00:20:49.177 | 1.00th=[ 16], 5.00th=[ 29], 10.00th=[ 39], 20.00th=[ 57], 00:20:49.177 | 30.00th=[ 68], 40.00th=[ 77], 50.00th=[ 88], 60.00th=[ 109], 00:20:49.177 | 70.00th=[ 130], 80.00th=[ 146], 90.00th=[ 167], 95.00th=[ 190], 00:20:49.177 | 99.00th=[ 226], 99.50th=[ 230], 99.90th=[ 251], 99.95th=[ 266], 00:20:49.177 | 99.99th=[ 317] 00:20:49.178 bw ( KiB/s): min=73728, max=297472, per=7.37%, avg=161590.55, stdev=60650.74, samples=20 00:20:49.178 iops : min= 288, max= 1162, avg=631.20, stdev=236.90, samples=20 00:20:49.178 lat (msec) : 4=0.08%, 10=0.24%, 20=1.43%, 50=13.52%, 100=41.19% 00:20:49.178 lat (msec) : 250=43.43%, 500=0.13% 00:20:49.178 cpu : usr=0.18%, sys=2.21%, ctx=1782, majf=0, minf=4097 00:20:49.178 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:49.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.178 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.178 issued rwts: total=6376,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.178 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.178 job7: (groupid=0, jobs=1): err= 0: pid=3462533: Mon Jul 22 20:26:19 2024 00:20:49.178 read: IOPS=568, BW=142MiB/s (149MB/s)(1430MiB/10066msec) 00:20:49.178 slat (usec): min=14, max=118137, avg=1574.13, stdev=5634.32 00:20:49.178 clat (msec): min=3, max=232, avg=110.94, stdev=51.05 00:20:49.178 lat (msec): min=3, max=283, avg=112.51, stdev=51.97 00:20:49.178 clat percentiles (msec): 00:20:49.178 | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 39], 20.00th=[ 65], 00:20:49.178 | 30.00th=[ 83], 40.00th=[ 100], 50.00th=[ 118], 60.00th=[ 133], 00:20:49.178 | 70.00th=[ 146], 80.00th=[ 159], 90.00th=[ 171], 95.00th=[ 184], 00:20:49.178 | 99.00th=[ 211], 99.50th=[ 222], 99.90th=[ 232], 99.95th=[ 232], 00:20:49.178 | 99.99th=[ 232] 00:20:49.178 bw ( KiB/s): min=81408, max=318976, per=6.60%, avg=144767.45, stdev=55283.80, samples=20 00:20:49.178 iops : min= 318, max= 1246, avg=565.45, stdev=215.94, samples=20 00:20:49.178 lat (msec) : 4=0.12%, 10=2.54%, 20=5.40%, 50=5.28%, 100=27.42% 00:20:49.178 lat (msec) : 250=59.23% 00:20:49.178 cpu : usr=0.29%, sys=2.39%, ctx=1435, majf=0, minf=4097 00:20:49.178 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:49.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.178 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.178 issued rwts: total=5718,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.178 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.178 job8: (groupid=0, jobs=1): err= 0: pid=3462535: Mon Jul 22 20:26:19 2024 00:20:49.178 read: IOPS=656, BW=164MiB/s (172MB/s)(1656MiB/10092msec) 00:20:49.178 slat (usec): min=8, max=112842, avg=1091.61, stdev=5261.15 00:20:49.178 clat (usec): min=1922, max=295756, avg=96252.39, stdev=52407.90 00:20:49.178 lat (usec): min=1947, max=295796, avg=97344.00, stdev=53322.26 00:20:49.178 clat percentiles (msec): 00:20:49.178 | 1.00th=[ 8], 5.00th=[ 21], 10.00th=[ 31], 20.00th=[ 45], 00:20:49.178 | 30.00th=[ 65], 40.00th=[ 75], 50.00th=[ 85], 60.00th=[ 107], 00:20:49.178 | 70.00th=[ 130], 80.00th=[ 150], 90.00th=[ 171], 95.00th=[ 184], 00:20:49.178 | 99.00th=[ 209], 99.50th=[ 224], 99.90th=[ 245], 99.95th=[ 275], 00:20:49.178 | 99.99th=[ 296] 00:20:49.178 bw ( KiB/s): min=71168, max=308224, per=7.65%, avg=167873.10, stdev=67995.66, samples=20 00:20:49.178 iops : min= 278, max= 1204, avg=655.75, stdev=265.61, samples=20 00:20:49.178 lat (msec) : 2=0.03%, 4=0.11%, 10=1.59%, 20=2.88%, 50=17.23% 00:20:49.178 lat (msec) : 100=36.02%, 250=42.06%, 500=0.09% 00:20:49.178 cpu : usr=0.24%, sys=2.30%, ctx=1922, majf=0, minf=4097 00:20:49.178 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:49.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.178 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.178 issued rwts: total=6622,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.178 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.178 job9: (groupid=0, jobs=1): err= 0: pid=3462536: Mon Jul 22 20:26:19 2024 00:20:49.178 read: IOPS=949, BW=237MiB/s (249MB/s)(2394MiB/10090msec) 00:20:49.178 slat (usec): min=9, max=103377, avg=854.60, stdev=3088.85 00:20:49.178 clat (msec): min=2, max=223, avg=66.48, stdev=33.80 00:20:49.178 lat (msec): min=2, max=223, avg=67.33, stdev=34.14 00:20:49.178 clat percentiles (msec): 00:20:49.178 | 1.00th=[ 8], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], 00:20:49.178 | 30.00th=[ 45], 40.00th=[ 55], 50.00th=[ 64], 60.00th=[ 72], 00:20:49.178 | 70.00th=[ 82], 80.00th=[ 92], 90.00th=[ 109], 95.00th=[ 129], 00:20:49.178 | 99.00th=[ 165], 99.50th=[ 182], 99.90th=[ 201], 99.95th=[ 203], 00:20:49.178 | 99.99th=[ 224] 00:20:49.178 bw ( KiB/s): min=118784, max=453632, per=11.11%, avg=243539.95, stdev=90106.95, samples=20 00:20:49.178 iops : min= 464, max= 1772, avg=951.30, stdev=352.00, samples=20 00:20:49.178 lat (msec) : 4=0.41%, 10=1.53%, 20=1.02%, 50=31.17%, 100=51.14% 00:20:49.178 lat (msec) : 250=14.72% 00:20:49.178 cpu : usr=0.38%, sys=3.31%, ctx=2263, majf=0, minf=4097 00:20:49.178 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:49.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.178 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.178 issued rwts: total=9577,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.178 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.178 job10: (groupid=0, jobs=1): err= 0: pid=3462537: Mon Jul 22 20:26:19 2024 00:20:49.178 read: IOPS=545, BW=136MiB/s (143MB/s)(1373MiB/10068msec) 00:20:49.178 slat (usec): min=8, max=143029, avg=1696.61, stdev=6562.00 00:20:49.178 clat (msec): min=8, max=301, avg=115.43, stdev=48.57 00:20:49.178 lat (msec): min=8, max=354, avg=117.12, stdev=49.50 00:20:49.178 clat percentiles (msec): 00:20:49.178 | 1.00th=[ 29], 5.00th=[ 44], 10.00th=[ 56], 20.00th=[ 71], 00:20:49.178 | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 111], 60.00th=[ 130], 00:20:49.178 | 70.00th=[ 144], 80.00th=[ 161], 90.00th=[ 180], 95.00th=[ 199], 00:20:49.178 | 99.00th=[ 230], 99.50th=[ 236], 99.90th=[ 271], 99.95th=[ 284], 00:20:49.178 | 99.99th=[ 300] 00:20:49.178 bw ( KiB/s): min=82432, max=256000, per=6.34%, avg=138995.95, stdev=46466.95, samples=20 00:20:49.178 iops : min= 322, max= 1000, avg=542.95, stdev=181.51, samples=20 00:20:49.178 lat (msec) : 10=0.13%, 20=0.05%, 50=7.19%, 100=36.90%, 250=55.51% 00:20:49.178 lat (msec) : 500=0.22% 00:20:49.178 cpu : usr=0.15%, sys=2.16%, ctx=1248, majf=0, minf=4097 00:20:49.178 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:49.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:49.178 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:49.178 issued rwts: total=5493,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:49.178 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:49.178 00:20:49.178 Run status group 0 (all jobs): 00:20:49.178 READ: bw=2142MiB/s (2246MB/s), 136MiB/s-261MiB/s (143MB/s-273MB/s), io=21.1GiB (22.7GB), run=10045-10095msec 00:20:49.178 00:20:49.178 Disk stats (read/write): 00:20:49.178 nvme0n1: ios=19647/0, merge=0/0, ticks=1238230/0, in_queue=1238230, util=97.25% 00:20:49.178 nvme10n1: ios=19508/0, merge=0/0, ticks=1230079/0, in_queue=1230079, util=97.47% 00:20:49.178 nvme1n1: ios=20869/0, merge=0/0, ticks=1230412/0, in_queue=1230412, util=97.67% 00:20:49.178 nvme2n1: ios=11995/0, merge=0/0, ticks=1226498/0, in_queue=1226498, util=97.75% 00:20:49.178 nvme3n1: ios=16497/0, merge=0/0, ticks=1235543/0, in_queue=1235543, util=97.91% 00:20:49.178 nvme4n1: ios=15464/0, merge=0/0, ticks=1235301/0, in_queue=1235301, util=98.26% 00:20:49.178 nvme5n1: ios=12579/0, merge=0/0, ticks=1231614/0, in_queue=1231614, util=98.41% 00:20:49.178 nvme6n1: ios=11284/0, merge=0/0, ticks=1225998/0, in_queue=1225998, util=98.52% 00:20:49.178 nvme7n1: ios=13025/0, merge=0/0, ticks=1228305/0, in_queue=1228305, util=98.89% 00:20:49.178 nvme8n1: ios=18989/0, merge=0/0, ticks=1232113/0, in_queue=1232113, util=99.07% 00:20:49.178 nvme9n1: ios=10753/0, merge=0/0, ticks=1228315/0, in_queue=1228315, util=99.23% 00:20:49.178 20:26:19 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:49.178 [global] 00:20:49.178 thread=1 00:20:49.178 invalidate=1 00:20:49.178 rw=randwrite 00:20:49.178 time_based=1 00:20:49.178 runtime=10 00:20:49.178 ioengine=libaio 00:20:49.178 direct=1 00:20:49.178 bs=262144 00:20:49.178 iodepth=64 00:20:49.178 norandommap=1 00:20:49.178 numjobs=1 00:20:49.178 00:20:49.178 [job0] 00:20:49.178 filename=/dev/nvme0n1 00:20:49.178 [job1] 00:20:49.178 filename=/dev/nvme10n1 00:20:49.178 [job2] 00:20:49.178 filename=/dev/nvme1n1 00:20:49.178 [job3] 00:20:49.178 filename=/dev/nvme2n1 00:20:49.178 [job4] 00:20:49.178 filename=/dev/nvme3n1 00:20:49.178 [job5] 00:20:49.178 filename=/dev/nvme4n1 00:20:49.178 [job6] 00:20:49.178 filename=/dev/nvme5n1 00:20:49.178 [job7] 00:20:49.178 filename=/dev/nvme6n1 00:20:49.178 [job8] 00:20:49.178 filename=/dev/nvme7n1 00:20:49.178 [job9] 00:20:49.178 filename=/dev/nvme8n1 00:20:49.178 [job10] 00:20:49.178 filename=/dev/nvme9n1 00:20:49.178 Could not set queue depth (nvme0n1) 00:20:49.178 Could not set queue depth (nvme10n1) 00:20:49.178 Could not set queue depth (nvme1n1) 00:20:49.178 Could not set queue depth (nvme2n1) 00:20:49.178 Could not set queue depth (nvme3n1) 00:20:49.178 Could not set queue depth (nvme4n1) 00:20:49.178 Could not set queue depth (nvme5n1) 00:20:49.178 Could not set queue depth (nvme6n1) 00:20:49.178 Could not set queue depth (nvme7n1) 00:20:49.178 Could not set queue depth (nvme8n1) 00:20:49.178 Could not set queue depth (nvme9n1) 00:20:49.178 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.178 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.178 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:49.179 fio-3.35 00:20:49.179 Starting 11 threads 00:20:59.162 00:20:59.162 job0: (groupid=0, jobs=1): err= 0: pid=3464091: Mon Jul 22 20:26:30 2024 00:20:59.162 write: IOPS=481, BW=120MiB/s (126MB/s)(1215MiB/10097msec); 0 zone resets 00:20:59.162 slat (usec): min=23, max=92331, avg=1642.07, stdev=4040.73 00:20:59.162 clat (msec): min=3, max=292, avg=131.30, stdev=57.17 00:20:59.162 lat (msec): min=3, max=292, avg=132.94, stdev=57.85 00:20:59.162 clat percentiles (msec): 00:20:59.163 | 1.00th=[ 19], 5.00th=[ 44], 10.00th=[ 61], 20.00th=[ 82], 00:20:59.163 | 30.00th=[ 103], 40.00th=[ 112], 50.00th=[ 127], 60.00th=[ 140], 00:20:59.163 | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 215], 95.00th=[ 243], 00:20:59.163 | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 292], 99.95th=[ 292], 00:20:59.163 | 99.99th=[ 292] 00:20:59.163 bw ( KiB/s): min=65536, max=196096, per=8.14%, avg=122777.60, stdev=38971.73, samples=20 00:20:59.163 iops : min= 256, max= 766, avg=479.60, stdev=152.23, samples=20 00:20:59.163 lat (msec) : 4=0.04%, 10=0.21%, 20=1.13%, 50=5.62%, 100=20.87% 00:20:59.163 lat (msec) : 250=68.70%, 500=3.44% 00:20:59.163 cpu : usr=1.63%, sys=1.55%, ctx=2092, majf=0, minf=1 00:20:59.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:59.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.163 issued rwts: total=0,4859,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.163 job1: (groupid=0, jobs=1): err= 0: pid=3464103: Mon Jul 22 20:26:30 2024 00:20:59.163 write: IOPS=491, BW=123MiB/s (129MB/s)(1240MiB/10096msec); 0 zone resets 00:20:59.163 slat (usec): min=21, max=89490, avg=1510.25, stdev=4522.50 00:20:59.163 clat (msec): min=5, max=402, avg=128.74, stdev=72.46 00:20:59.163 lat (msec): min=5, max=415, avg=130.26, stdev=73.61 00:20:59.163 clat percentiles (msec): 00:20:59.163 | 1.00th=[ 15], 5.00th=[ 31], 10.00th=[ 42], 20.00th=[ 59], 00:20:59.163 | 30.00th=[ 81], 40.00th=[ 100], 50.00th=[ 117], 60.00th=[ 150], 00:20:59.163 | 70.00th=[ 169], 80.00th=[ 186], 90.00th=[ 224], 95.00th=[ 262], 00:20:59.163 | 99.00th=[ 321], 99.50th=[ 384], 99.90th=[ 401], 99.95th=[ 401], 00:20:59.163 | 99.99th=[ 401] 00:20:59.163 bw ( KiB/s): min=48640, max=241152, per=8.31%, avg=125337.60, stdev=56339.74, samples=20 00:20:59.163 iops : min= 190, max= 942, avg=489.60, stdev=220.08, samples=20 00:20:59.163 lat (msec) : 10=0.10%, 20=1.69%, 50=14.06%, 100=24.94%, 250=52.33% 00:20:59.163 lat (msec) : 500=6.88% 00:20:59.163 cpu : usr=1.39%, sys=1.57%, ctx=2825, majf=0, minf=1 00:20:59.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:59.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.163 issued rwts: total=0,4959,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.163 job2: (groupid=0, jobs=1): err= 0: pid=3464104: Mon Jul 22 20:26:30 2024 00:20:59.163 write: IOPS=505, BW=126MiB/s (132MB/s)(1279MiB/10121msec); 0 zone resets 00:20:59.163 slat (usec): min=20, max=80443, avg=1364.33, stdev=4237.13 00:20:59.163 clat (usec): min=1764, max=361745, avg=125156.76, stdev=67003.28 00:20:59.163 lat (usec): min=1814, max=361809, avg=126521.09, stdev=67883.11 00:20:59.163 clat percentiles (msec): 00:20:59.163 | 1.00th=[ 10], 5.00th=[ 22], 10.00th=[ 38], 20.00th=[ 62], 00:20:59.163 | 30.00th=[ 80], 40.00th=[ 103], 50.00th=[ 128], 60.00th=[ 150], 00:20:59.163 | 70.00th=[ 163], 80.00th=[ 178], 90.00th=[ 205], 95.00th=[ 236], 00:20:59.163 | 99.00th=[ 313], 99.50th=[ 338], 99.90th=[ 351], 99.95th=[ 363], 00:20:59.163 | 99.99th=[ 363] 00:20:59.163 bw ( KiB/s): min=57344, max=238592, per=8.57%, avg=129305.60, stdev=48471.78, samples=20 00:20:59.163 iops : min= 224, max= 932, avg=505.10, stdev=189.34, samples=20 00:20:59.163 lat (msec) : 2=0.02%, 4=0.10%, 10=0.90%, 20=3.48%, 50=10.38% 00:20:59.163 lat (msec) : 100=23.77%, 250=57.48%, 500=3.87% 00:20:59.163 cpu : usr=1.20%, sys=1.57%, ctx=3008, majf=0, minf=1 00:20:59.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:59.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.163 issued rwts: total=0,5115,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.163 job3: (groupid=0, jobs=1): err= 0: pid=3464105: Mon Jul 22 20:26:30 2024 00:20:59.163 write: IOPS=626, BW=157MiB/s (164MB/s)(1581MiB/10097msec); 0 zone resets 00:20:59.163 slat (usec): min=21, max=66548, avg=913.57, stdev=2968.60 00:20:59.163 clat (msec): min=2, max=289, avg=101.26, stdev=51.40 00:20:59.163 lat (msec): min=2, max=315, avg=102.17, stdev=51.92 00:20:59.163 clat percentiles (msec): 00:20:59.163 | 1.00th=[ 16], 5.00th=[ 25], 10.00th=[ 36], 20.00th=[ 55], 00:20:59.163 | 30.00th=[ 68], 40.00th=[ 83], 50.00th=[ 101], 60.00th=[ 112], 00:20:59.163 | 70.00th=[ 128], 80.00th=[ 144], 90.00th=[ 165], 95.00th=[ 192], 00:20:59.163 | 99.00th=[ 247], 99.50th=[ 264], 99.90th=[ 284], 99.95th=[ 288], 00:20:59.163 | 99.99th=[ 288] 00:20:59.163 bw ( KiB/s): min=108544, max=237568, per=10.62%, avg=160256.00, stdev=31088.76, samples=20 00:20:59.163 iops : min= 424, max= 928, avg=626.00, stdev=121.44, samples=20 00:20:59.163 lat (msec) : 4=0.03%, 10=0.38%, 20=2.66%, 50=14.19%, 100=32.67% 00:20:59.163 lat (msec) : 250=49.19%, 500=0.89% 00:20:59.163 cpu : usr=1.37%, sys=2.07%, ctx=3936, majf=0, minf=1 00:20:59.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:59.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.163 issued rwts: total=0,6323,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.163 job4: (groupid=0, jobs=1): err= 0: pid=3464106: Mon Jul 22 20:26:30 2024 00:20:59.163 write: IOPS=422, BW=106MiB/s (111MB/s)(1066MiB/10096msec); 0 zone resets 00:20:59.163 slat (usec): min=21, max=104641, avg=1944.35, stdev=5230.78 00:20:59.163 clat (msec): min=4, max=403, avg=149.47, stdev=60.80 00:20:59.163 lat (msec): min=4, max=403, avg=151.41, stdev=61.47 00:20:59.163 clat percentiles (msec): 00:20:59.163 | 1.00th=[ 13], 5.00th=[ 29], 10.00th=[ 62], 20.00th=[ 107], 00:20:59.163 | 30.00th=[ 124], 40.00th=[ 138], 50.00th=[ 150], 60.00th=[ 167], 00:20:59.163 | 70.00th=[ 180], 80.00th=[ 194], 90.00th=[ 228], 95.00th=[ 247], 00:20:59.163 | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 393], 99.95th=[ 397], 00:20:59.163 | 99.99th=[ 405] 00:20:59.163 bw ( KiB/s): min=64000, max=174080, per=7.13%, avg=107520.00, stdev=28255.62, samples=20 00:20:59.163 iops : min= 250, max= 680, avg=420.00, stdev=110.37, samples=20 00:20:59.163 lat (msec) : 10=0.56%, 20=1.78%, 50=6.36%, 100=7.06%, 250=79.66% 00:20:59.163 lat (msec) : 500=4.57% 00:20:59.163 cpu : usr=1.16%, sys=1.44%, ctx=1928, majf=0, minf=1 00:20:59.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:59.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.163 issued rwts: total=0,4263,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.163 job5: (groupid=0, jobs=1): err= 0: pid=3464107: Mon Jul 22 20:26:30 2024 00:20:59.163 write: IOPS=514, BW=129MiB/s (135MB/s)(1302MiB/10121msec); 0 zone resets 00:20:59.163 slat (usec): min=24, max=105274, avg=1167.72, stdev=4222.82 00:20:59.163 clat (msec): min=2, max=335, avg=122.79, stdev=70.58 00:20:59.163 lat (msec): min=2, max=335, avg=123.96, stdev=71.40 00:20:59.163 clat percentiles (msec): 00:20:59.163 | 1.00th=[ 9], 5.00th=[ 20], 10.00th=[ 33], 20.00th=[ 46], 00:20:59.163 | 30.00th=[ 65], 40.00th=[ 110], 50.00th=[ 138], 60.00th=[ 150], 00:20:59.163 | 70.00th=[ 157], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 257], 00:20:59.163 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 321], 99.95th=[ 330], 00:20:59.163 | 99.99th=[ 338] 00:20:59.163 bw ( KiB/s): min=67584, max=221184, per=8.73%, avg=131671.65, stdev=37557.44, samples=20 00:20:59.163 iops : min= 264, max= 864, avg=514.30, stdev=146.74, samples=20 00:20:59.163 lat (msec) : 4=0.15%, 10=0.98%, 20=4.03%, 50=18.23%, 100=14.60% 00:20:59.163 lat (msec) : 250=56.16%, 500=5.86% 00:20:59.163 cpu : usr=1.17%, sys=1.56%, ctx=3465, majf=0, minf=1 00:20:59.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:59.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.163 issued rwts: total=0,5207,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.163 job6: (groupid=0, jobs=1): err= 0: pid=3464108: Mon Jul 22 20:26:30 2024 00:20:59.163 write: IOPS=655, BW=164MiB/s (172MB/s)(1648MiB/10055msec); 0 zone resets 00:20:59.163 slat (usec): min=20, max=86064, avg=1054.30, stdev=3191.60 00:20:59.163 clat (usec): min=1878, max=304374, avg=96542.17, stdev=56657.43 00:20:59.163 lat (usec): min=1913, max=304424, avg=97596.47, stdev=57468.32 00:20:59.163 clat percentiles (msec): 00:20:59.163 | 1.00th=[ 9], 5.00th=[ 18], 10.00th=[ 28], 20.00th=[ 47], 00:20:59.163 | 30.00th=[ 61], 40.00th=[ 70], 50.00th=[ 85], 60.00th=[ 104], 00:20:59.163 | 70.00th=[ 128], 80.00th=[ 153], 90.00th=[ 174], 95.00th=[ 197], 00:20:59.163 | 99.00th=[ 232], 99.50th=[ 279], 99.90th=[ 296], 99.95th=[ 305], 00:20:59.163 | 99.99th=[ 305] 00:20:59.163 bw ( KiB/s): min=75776, max=276992, per=11.08%, avg=167142.40, stdev=69773.82, samples=20 00:20:59.163 iops : min= 296, max= 1082, avg=652.90, stdev=272.55, samples=20 00:20:59.163 lat (msec) : 2=0.02%, 4=0.18%, 10=1.44%, 20=4.43%, 50=15.06% 00:20:59.163 lat (msec) : 100=37.70%, 250=40.28%, 500=0.90% 00:20:59.163 cpu : usr=1.67%, sys=1.95%, ctx=3772, majf=0, minf=1 00:20:59.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:59.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.163 issued rwts: total=0,6592,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.163 job7: (groupid=0, jobs=1): err= 0: pid=3464109: Mon Jul 22 20:26:30 2024 00:20:59.163 write: IOPS=633, BW=158MiB/s (166MB/s)(1602MiB/10120msec); 0 zone resets 00:20:59.163 slat (usec): min=22, max=90869, avg=841.32, stdev=3406.89 00:20:59.163 clat (usec): min=1606, max=344055, avg=100178.87, stdev=60299.04 00:20:59.163 lat (usec): min=1734, max=344103, avg=101020.19, stdev=61024.22 00:20:59.163 clat percentiles (msec): 00:20:59.164 | 1.00th=[ 9], 5.00th=[ 20], 10.00th=[ 29], 20.00th=[ 45], 00:20:59.164 | 30.00th=[ 59], 40.00th=[ 74], 50.00th=[ 93], 60.00th=[ 112], 00:20:59.164 | 70.00th=[ 129], 80.00th=[ 150], 90.00th=[ 180], 95.00th=[ 211], 00:20:59.164 | 99.00th=[ 268], 99.50th=[ 292], 99.90th=[ 334], 99.95th=[ 342], 00:20:59.164 | 99.99th=[ 347] 00:20:59.164 bw ( KiB/s): min=94208, max=241152, per=10.77%, avg=162468.95, stdev=44940.70, samples=20 00:20:59.164 iops : min= 368, max= 942, avg=634.60, stdev=175.60, samples=20 00:20:59.164 lat (msec) : 2=0.02%, 4=0.17%, 10=1.12%, 20=3.96%, 50=19.22% 00:20:59.164 lat (msec) : 100=29.69%, 250=44.23%, 500=1.58% 00:20:59.164 cpu : usr=1.28%, sys=2.09%, ctx=4458, majf=0, minf=1 00:20:59.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:59.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.164 issued rwts: total=0,6409,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.164 job8: (groupid=0, jobs=1): err= 0: pid=3464110: Mon Jul 22 20:26:30 2024 00:20:59.164 write: IOPS=437, BW=109MiB/s (115MB/s)(1108MiB/10120msec); 0 zone resets 00:20:59.164 slat (usec): min=24, max=78630, avg=1983.66, stdev=4531.84 00:20:59.164 clat (usec): min=1884, max=287630, avg=144039.46, stdev=55306.36 00:20:59.164 lat (usec): min=1963, max=287705, avg=146023.12, stdev=56126.59 00:20:59.164 clat percentiles (msec): 00:20:59.164 | 1.00th=[ 11], 5.00th=[ 36], 10.00th=[ 68], 20.00th=[ 109], 00:20:59.164 | 30.00th=[ 129], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 157], 00:20:59.164 | 70.00th=[ 167], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 241], 00:20:59.164 | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 284], 00:20:59.164 | 99.99th=[ 288] 00:20:59.164 bw ( KiB/s): min=63488, max=196096, per=7.41%, avg=111814.00, stdev=34628.73, samples=20 00:20:59.164 iops : min= 248, max= 766, avg=436.75, stdev=135.21, samples=20 00:20:59.164 lat (msec) : 2=0.02%, 4=0.07%, 10=0.77%, 20=1.15%, 50=5.66% 00:20:59.164 lat (msec) : 100=10.27%, 250=78.22%, 500=3.84% 00:20:59.164 cpu : usr=1.18%, sys=1.58%, ctx=1865, majf=0, minf=1 00:20:59.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:59.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.164 issued rwts: total=0,4431,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.164 job9: (groupid=0, jobs=1): err= 0: pid=3464111: Mon Jul 22 20:26:30 2024 00:20:59.164 write: IOPS=586, BW=147MiB/s (154MB/s)(1480MiB/10095msec); 0 zone resets 00:20:59.164 slat (usec): min=19, max=112717, avg=1110.19, stdev=4148.09 00:20:59.164 clat (usec): min=1430, max=310021, avg=107941.52, stdev=61466.87 00:20:59.164 lat (usec): min=1469, max=310076, avg=109051.70, stdev=62064.71 00:20:59.164 clat percentiles (msec): 00:20:59.164 | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 28], 20.00th=[ 53], 00:20:59.164 | 30.00th=[ 68], 40.00th=[ 85], 50.00th=[ 104], 60.00th=[ 125], 00:20:59.164 | 70.00th=[ 140], 80.00th=[ 155], 90.00th=[ 190], 95.00th=[ 222], 00:20:59.164 | 99.00th=[ 275], 99.50th=[ 288], 99.90th=[ 296], 99.95th=[ 305], 00:20:59.164 | 99.99th=[ 309] 00:20:59.164 bw ( KiB/s): min=84480, max=247808, per=9.94%, avg=149913.60, stdev=39721.78, samples=20 00:20:59.164 iops : min= 330, max= 968, avg=585.60, stdev=155.16, samples=20 00:20:59.164 lat (msec) : 2=0.10%, 4=0.15%, 10=0.68%, 20=5.85%, 50=11.88% 00:20:59.164 lat (msec) : 100=28.75%, 250=50.14%, 500=2.45% 00:20:59.164 cpu : usr=1.29%, sys=1.70%, ctx=3432, majf=0, minf=1 00:20:59.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:59.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.164 issued rwts: total=0,5919,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.164 job10: (groupid=0, jobs=1): err= 0: pid=3464112: Mon Jul 22 20:26:30 2024 00:20:59.164 write: IOPS=551, BW=138MiB/s (145MB/s)(1392MiB/10097msec); 0 zone resets 00:20:59.164 slat (usec): min=17, max=107492, avg=1062.78, stdev=4236.23 00:20:59.164 clat (usec): min=1967, max=299072, avg=114628.31, stdev=64182.67 00:20:59.164 lat (usec): min=1998, max=311607, avg=115691.09, stdev=65055.91 00:20:59.164 clat percentiles (msec): 00:20:59.164 | 1.00th=[ 10], 5.00th=[ 24], 10.00th=[ 31], 20.00th=[ 47], 00:20:59.164 | 30.00th=[ 72], 40.00th=[ 89], 50.00th=[ 114], 60.00th=[ 129], 00:20:59.164 | 70.00th=[ 157], 80.00th=[ 174], 90.00th=[ 199], 95.00th=[ 224], 00:20:59.164 | 99.00th=[ 262], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 292], 00:20:59.164 | 99.99th=[ 300] 00:20:59.164 bw ( KiB/s): min=71680, max=327168, per=9.34%, avg=140953.60, stdev=61545.92, samples=20 00:20:59.164 iops : min= 280, max= 1278, avg=550.60, stdev=240.41, samples=20 00:20:59.164 lat (msec) : 2=0.02%, 4=0.16%, 10=0.92%, 20=2.41%, 50=17.94% 00:20:59.164 lat (msec) : 100=21.76%, 250=55.02%, 500=1.78% 00:20:59.164 cpu : usr=1.12%, sys=1.64%, ctx=3828, majf=0, minf=1 00:20:59.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:59.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:59.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:59.164 issued rwts: total=0,5569,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:59.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:59.164 00:20:59.164 Run status group 0 (all jobs): 00:20:59.164 WRITE: bw=1473MiB/s (1545MB/s), 106MiB/s-164MiB/s (111MB/s-172MB/s), io=14.6GiB (15.6GB), run=10055-10121msec 00:20:59.164 00:20:59.164 Disk stats (read/write): 00:20:59.164 nvme0n1: ios=48/9508, merge=0/0, ticks=1637/1216863, in_queue=1218500, util=100.00% 00:20:59.164 nvme10n1: ios=44/9712, merge=0/0, ticks=292/1218168, in_queue=1218460, util=99.72% 00:20:59.164 nvme1n1: ios=27/10035, merge=0/0, ticks=508/1219979, in_queue=1220487, util=100.00% 00:20:59.164 nvme2n1: ios=0/12433, merge=0/0, ticks=0/1226112, in_queue=1226112, util=97.65% 00:20:59.164 nvme3n1: ios=49/8309, merge=0/0, ticks=1035/1216607, in_queue=1217642, util=100.00% 00:20:59.164 nvme4n1: ios=46/10216, merge=0/0, ticks=1065/1219872, in_queue=1220937, util=100.00% 00:20:59.164 nvme5n1: ios=0/12896, merge=0/0, ticks=0/1224425, in_queue=1224425, util=98.30% 00:20:59.164 nvme6n1: ios=0/12621, merge=0/0, ticks=0/1228355, in_queue=1228355, util=98.42% 00:20:59.164 nvme7n1: ios=42/8664, merge=0/0, ticks=1180/1211219, in_queue=1212399, util=100.00% 00:20:59.164 nvme8n1: ios=49/11621, merge=0/0, ticks=3568/1196139, in_queue=1199707, util=100.00% 00:20:59.164 nvme9n1: ios=40/10927, merge=0/0, ticks=1213/1218414, in_queue=1219627, util=100.00% 00:20:59.164 20:26:30 -- target/multiconnection.sh@36 -- # sync 00:20:59.164 20:26:30 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:59.164 20:26:30 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:59.164 20:26:30 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:59.164 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:59.164 20:26:30 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:59.164 20:26:30 -- common/autotest_common.sh@1198 -- # local i=0 00:20:59.164 20:26:30 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:59.164 20:26:30 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:20:59.164 20:26:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:20:59.164 20:26:30 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:59.164 20:26:30 -- common/autotest_common.sh@1210 -- # return 0 00:20:59.164 20:26:30 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:59.164 20:26:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:59.164 20:26:30 -- common/autotest_common.sh@10 -- # set +x 00:20:59.164 20:26:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:59.164 20:26:30 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:59.164 20:26:30 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:59.164 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:59.164 20:26:30 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:59.164 20:26:30 -- common/autotest_common.sh@1198 -- # local i=0 00:20:59.164 20:26:30 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:59.164 20:26:30 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:20:59.164 20:26:30 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:59.164 20:26:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:20:59.164 20:26:30 -- common/autotest_common.sh@1210 -- # return 0 00:20:59.164 20:26:30 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:59.164 20:26:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:59.164 20:26:30 -- common/autotest_common.sh@10 -- # set +x 00:20:59.164 20:26:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:59.164 20:26:30 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:59.164 20:26:30 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:59.164 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:59.164 20:26:30 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:59.164 20:26:30 -- common/autotest_common.sh@1198 -- # local i=0 00:20:59.164 20:26:30 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:59.164 20:26:30 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:20:59.164 20:26:30 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:59.164 20:26:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:20:59.164 20:26:30 -- common/autotest_common.sh@1210 -- # return 0 00:20:59.164 20:26:30 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:59.164 20:26:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:59.164 20:26:30 -- common/autotest_common.sh@10 -- # set +x 00:20:59.164 20:26:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:59.164 20:26:30 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:59.164 20:26:30 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:59.423 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:59.423 20:26:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:59.423 20:26:31 -- common/autotest_common.sh@1198 -- # local i=0 00:20:59.423 20:26:31 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:59.423 20:26:31 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:20:59.423 20:26:31 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:59.423 20:26:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:20:59.423 20:26:31 -- common/autotest_common.sh@1210 -- # return 0 00:20:59.423 20:26:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:59.423 20:26:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:59.423 20:26:31 -- common/autotest_common.sh@10 -- # set +x 00:20:59.423 20:26:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:59.423 20:26:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:59.423 20:26:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:59.681 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:59.681 20:26:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:59.681 20:26:31 -- common/autotest_common.sh@1198 -- # local i=0 00:20:59.681 20:26:31 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:59.681 20:26:31 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:20:59.681 20:26:31 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:59.681 20:26:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:20:59.681 20:26:31 -- common/autotest_common.sh@1210 -- # return 0 00:20:59.940 20:26:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:59.940 20:26:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:59.940 20:26:31 -- common/autotest_common.sh@10 -- # set +x 00:20:59.940 20:26:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:59.940 20:26:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:59.940 20:26:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:59.940 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:59.940 20:26:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:59.940 20:26:31 -- common/autotest_common.sh@1198 -- # local i=0 00:20:59.940 20:26:31 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:59.940 20:26:31 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:20:59.940 20:26:31 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:59.940 20:26:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:21:00.199 20:26:31 -- common/autotest_common.sh@1210 -- # return 0 00:21:00.199 20:26:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:21:00.199 20:26:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.199 20:26:31 -- common/autotest_common.sh@10 -- # set +x 00:21:00.199 20:26:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.199 20:26:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.199 20:26:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:21:00.199 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:21:00.199 20:26:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:21:00.199 20:26:32 -- common/autotest_common.sh@1198 -- # local i=0 00:21:00.199 20:26:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:21:00.199 20:26:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:21:00.200 20:26:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:21:00.200 20:26:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:21:00.200 20:26:32 -- common/autotest_common.sh@1210 -- # return 0 00:21:00.200 20:26:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:21:00.200 20:26:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.200 20:26:32 -- common/autotest_common.sh@10 -- # set +x 00:21:00.200 20:26:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.200 20:26:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.200 20:26:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:21:00.458 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:21:00.458 20:26:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:21:00.458 20:26:32 -- common/autotest_common.sh@1198 -- # local i=0 00:21:00.459 20:26:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:21:00.459 20:26:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:21:00.459 20:26:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:21:00.459 20:26:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:21:00.459 20:26:32 -- common/autotest_common.sh@1210 -- # return 0 00:21:00.459 20:26:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:21:00.459 20:26:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.459 20:26:32 -- common/autotest_common.sh@10 -- # set +x 00:21:00.459 20:26:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.459 20:26:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.459 20:26:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:21:00.459 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:21:00.459 20:26:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:21:00.459 20:26:32 -- common/autotest_common.sh@1198 -- # local i=0 00:21:00.459 20:26:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:21:00.459 20:26:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:21:00.717 20:26:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:21:00.717 20:26:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:21:00.717 20:26:32 -- common/autotest_common.sh@1210 -- # return 0 00:21:00.717 20:26:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:21:00.717 20:26:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.717 20:26:32 -- common/autotest_common.sh@10 -- # set +x 00:21:00.717 20:26:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.717 20:26:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.717 20:26:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:21:00.717 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:21:00.717 20:26:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:21:00.717 20:26:32 -- common/autotest_common.sh@1198 -- # local i=0 00:21:00.976 20:26:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:21:00.976 20:26:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:21:00.976 20:26:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:21:00.976 20:26:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:21:00.976 20:26:32 -- common/autotest_common.sh@1210 -- # return 0 00:21:00.976 20:26:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:21:00.976 20:26:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.976 20:26:32 -- common/autotest_common.sh@10 -- # set +x 00:21:00.976 20:26:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.976 20:26:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.976 20:26:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:21:00.976 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:21:00.976 20:26:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:21:00.976 20:26:32 -- common/autotest_common.sh@1198 -- # local i=0 00:21:00.976 20:26:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:21:00.976 20:26:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:21:00.976 20:26:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:21:00.976 20:26:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:21:00.976 20:26:32 -- common/autotest_common.sh@1210 -- # return 0 00:21:00.976 20:26:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:21:00.976 20:26:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.976 20:26:32 -- common/autotest_common.sh@10 -- # set +x 00:21:00.976 20:26:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.976 20:26:32 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:21:00.976 20:26:32 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:21:00.976 20:26:32 -- target/multiconnection.sh@47 -- # nvmftestfini 00:21:00.976 20:26:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:00.976 20:26:32 -- nvmf/common.sh@116 -- # sync 00:21:00.976 20:26:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:00.976 20:26:32 -- nvmf/common.sh@119 -- # set +e 00:21:00.976 20:26:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:00.976 20:26:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:00.976 rmmod nvme_tcp 00:21:00.976 rmmod nvme_fabrics 00:21:00.976 rmmod nvme_keyring 00:21:00.976 20:26:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:00.976 20:26:32 -- nvmf/common.sh@123 -- # set -e 00:21:00.976 20:26:32 -- nvmf/common.sh@124 -- # return 0 00:21:00.976 20:26:32 -- nvmf/common.sh@477 -- # '[' -n 3455734 ']' 00:21:00.976 20:26:32 -- nvmf/common.sh@478 -- # killprocess 3455734 00:21:00.976 20:26:32 -- common/autotest_common.sh@926 -- # '[' -z 3455734 ']' 00:21:00.976 20:26:32 -- common/autotest_common.sh@930 -- # kill -0 3455734 00:21:00.976 20:26:32 -- common/autotest_common.sh@931 -- # uname 00:21:00.976 20:26:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:00.976 20:26:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3455734 00:21:01.235 20:26:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:01.235 20:26:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:01.235 20:26:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3455734' 00:21:01.235 killing process with pid 3455734 00:21:01.235 20:26:32 -- common/autotest_common.sh@945 -- # kill 3455734 00:21:01.235 20:26:32 -- common/autotest_common.sh@950 -- # wait 3455734 00:21:01.493 20:26:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:01.493 20:26:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:01.493 20:26:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:01.493 20:26:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:01.493 20:26:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:01.493 20:26:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:01.493 20:26:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:01.493 20:26:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:04.025 20:26:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:04.025 00:21:04.025 real 1m10.267s 00:21:04.025 user 4m11.006s 00:21:04.025 sys 0m22.733s 00:21:04.025 20:26:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:04.025 20:26:35 -- common/autotest_common.sh@10 -- # set +x 00:21:04.025 ************************************ 00:21:04.025 END TEST nvmf_multiconnection 00:21:04.025 ************************************ 00:21:04.025 20:26:35 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:21:04.025 20:26:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:04.025 20:26:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:04.025 20:26:35 -- common/autotest_common.sh@10 -- # set +x 00:21:04.025 ************************************ 00:21:04.025 START TEST nvmf_initiator_timeout 00:21:04.025 ************************************ 00:21:04.025 20:26:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:21:04.025 * Looking for test storage... 00:21:04.025 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:04.025 20:26:35 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:04.025 20:26:35 -- nvmf/common.sh@7 -- # uname -s 00:21:04.025 20:26:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:04.025 20:26:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:04.025 20:26:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:04.025 20:26:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:04.025 20:26:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:04.025 20:26:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:04.025 20:26:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:04.025 20:26:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:04.025 20:26:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:04.025 20:26:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:04.025 20:26:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:21:04.025 20:26:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:21:04.025 20:26:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:04.025 20:26:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:04.025 20:26:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:04.025 20:26:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:04.025 20:26:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:04.025 20:26:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:04.025 20:26:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:04.025 20:26:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.025 20:26:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.025 20:26:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.025 20:26:35 -- paths/export.sh@5 -- # export PATH 00:21:04.025 20:26:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.025 20:26:35 -- nvmf/common.sh@46 -- # : 0 00:21:04.025 20:26:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:04.025 20:26:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:04.025 20:26:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:04.025 20:26:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:04.025 20:26:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:04.025 20:26:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:04.025 20:26:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:04.025 20:26:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:04.026 20:26:35 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:04.026 20:26:35 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:04.026 20:26:35 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:21:04.026 20:26:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:04.026 20:26:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:04.026 20:26:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:04.026 20:26:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:04.026 20:26:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:04.026 20:26:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:04.026 20:26:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:04.026 20:26:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:04.026 20:26:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:04.026 20:26:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:04.026 20:26:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:04.026 20:26:35 -- common/autotest_common.sh@10 -- # set +x 00:21:09.296 20:26:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:09.296 20:26:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:09.296 20:26:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:09.296 20:26:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:09.296 20:26:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:09.296 20:26:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:09.296 20:26:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:09.296 20:26:40 -- nvmf/common.sh@294 -- # net_devs=() 00:21:09.296 20:26:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:09.296 20:26:40 -- nvmf/common.sh@295 -- # e810=() 00:21:09.296 20:26:40 -- nvmf/common.sh@295 -- # local -ga e810 00:21:09.296 20:26:40 -- nvmf/common.sh@296 -- # x722=() 00:21:09.296 20:26:40 -- nvmf/common.sh@296 -- # local -ga x722 00:21:09.296 20:26:40 -- nvmf/common.sh@297 -- # mlx=() 00:21:09.296 20:26:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:09.296 20:26:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:09.296 20:26:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:09.296 20:26:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:09.296 20:26:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:09.296 20:26:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:09.296 20:26:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:21:09.296 Found 0000:86:00.0 (0x8086 - 0x159b) 00:21:09.296 20:26:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:09.296 20:26:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:21:09.296 Found 0000:86:00.1 (0x8086 - 0x159b) 00:21:09.296 20:26:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:09.296 20:26:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:09.296 20:26:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:09.297 20:26:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:09.297 20:26:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:09.297 20:26:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:09.297 20:26:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:09.297 20:26:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:09.297 20:26:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:21:09.297 Found net devices under 0000:86:00.0: cvl_0_0 00:21:09.297 20:26:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:09.297 20:26:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:09.297 20:26:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:09.297 20:26:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:09.297 20:26:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:09.297 20:26:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:21:09.297 Found net devices under 0000:86:00.1: cvl_0_1 00:21:09.297 20:26:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:09.297 20:26:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:09.297 20:26:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:09.297 20:26:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:09.297 20:26:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:09.297 20:26:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:09.297 20:26:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:09.297 20:26:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:09.297 20:26:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:09.297 20:26:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:09.297 20:26:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:09.297 20:26:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:09.297 20:26:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:09.297 20:26:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:09.297 20:26:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:09.297 20:26:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:09.297 20:26:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:09.297 20:26:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:09.297 20:26:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:09.297 20:26:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:09.297 20:26:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:09.297 20:26:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:09.297 20:26:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:09.297 20:26:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:09.297 20:26:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:09.297 20:26:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:09.297 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:09.297 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:21:09.297 00:21:09.297 --- 10.0.0.2 ping statistics --- 00:21:09.297 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:09.297 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:21:09.297 20:26:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:09.297 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:09.297 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.238 ms 00:21:09.297 00:21:09.297 --- 10.0.0.1 ping statistics --- 00:21:09.297 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:09.297 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:21:09.297 20:26:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:09.297 20:26:40 -- nvmf/common.sh@410 -- # return 0 00:21:09.297 20:26:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:09.297 20:26:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:09.297 20:26:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:09.297 20:26:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:09.297 20:26:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:09.297 20:26:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:09.297 20:26:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:09.297 20:26:40 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:21:09.297 20:26:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:09.297 20:26:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:09.297 20:26:40 -- common/autotest_common.sh@10 -- # set +x 00:21:09.297 20:26:40 -- nvmf/common.sh@469 -- # nvmfpid=3469480 00:21:09.297 20:26:40 -- nvmf/common.sh@470 -- # waitforlisten 3469480 00:21:09.297 20:26:40 -- common/autotest_common.sh@819 -- # '[' -z 3469480 ']' 00:21:09.297 20:26:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:09.297 20:26:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:09.297 20:26:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:09.297 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:09.297 20:26:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:09.297 20:26:40 -- common/autotest_common.sh@10 -- # set +x 00:21:09.297 20:26:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:09.297 [2024-07-22 20:26:40.982897] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:21:09.297 [2024-07-22 20:26:40.982940] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:09.297 EAL: No free 2048 kB hugepages reported on node 1 00:21:09.297 [2024-07-22 20:26:41.039966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:09.297 [2024-07-22 20:26:41.118584] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:09.297 [2024-07-22 20:26:41.118692] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:09.297 [2024-07-22 20:26:41.118701] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:09.297 [2024-07-22 20:26:41.118708] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:09.297 [2024-07-22 20:26:41.118751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:09.297 [2024-07-22 20:26:41.118767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:09.297 [2024-07-22 20:26:41.118857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:09.297 [2024-07-22 20:26:41.118858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:09.865 20:26:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:09.865 20:26:41 -- common/autotest_common.sh@852 -- # return 0 00:21:09.865 20:26:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:09.865 20:26:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:09.865 20:26:41 -- common/autotest_common.sh@10 -- # set +x 00:21:10.124 20:26:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:10.124 20:26:41 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:10.124 20:26:41 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:10.124 20:26:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:10.124 20:26:41 -- common/autotest_common.sh@10 -- # set +x 00:21:10.124 Malloc0 00:21:10.124 20:26:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:10.124 20:26:41 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:21:10.124 20:26:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:10.124 20:26:41 -- common/autotest_common.sh@10 -- # set +x 00:21:10.124 Delay0 00:21:10.124 20:26:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:10.124 20:26:41 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:10.124 20:26:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:10.124 20:26:41 -- common/autotest_common.sh@10 -- # set +x 00:21:10.124 [2024-07-22 20:26:41.860331] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:10.124 20:26:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:10.124 20:26:41 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:21:10.124 20:26:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:10.124 20:26:41 -- common/autotest_common.sh@10 -- # set +x 00:21:10.124 20:26:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:10.124 20:26:41 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:21:10.124 20:26:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:10.124 20:26:41 -- common/autotest_common.sh@10 -- # set +x 00:21:10.124 20:26:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:10.124 20:26:41 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:10.124 20:26:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:10.124 20:26:41 -- common/autotest_common.sh@10 -- # set +x 00:21:10.124 [2024-07-22 20:26:41.885309] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:10.124 20:26:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:10.124 20:26:41 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:11.060 20:26:42 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:21:11.060 20:26:42 -- common/autotest_common.sh@1177 -- # local i=0 00:21:11.060 20:26:42 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:11.060 20:26:42 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:11.060 20:26:42 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:13.592 20:26:44 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:13.592 20:26:44 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:13.592 20:26:44 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:21:13.592 20:26:44 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:13.592 20:26:44 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:13.592 20:26:44 -- common/autotest_common.sh@1187 -- # return 0 00:21:13.592 20:26:44 -- target/initiator_timeout.sh@35 -- # fio_pid=3470097 00:21:13.592 20:26:44 -- target/initiator_timeout.sh@37 -- # sleep 3 00:21:13.592 20:26:44 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:21:13.592 [global] 00:21:13.592 thread=1 00:21:13.592 invalidate=1 00:21:13.592 rw=write 00:21:13.592 time_based=1 00:21:13.592 runtime=60 00:21:13.592 ioengine=libaio 00:21:13.592 direct=1 00:21:13.592 bs=4096 00:21:13.592 iodepth=1 00:21:13.592 norandommap=0 00:21:13.592 numjobs=1 00:21:13.592 00:21:13.592 verify_dump=1 00:21:13.592 verify_backlog=512 00:21:13.592 verify_state_save=0 00:21:13.592 do_verify=1 00:21:13.592 verify=crc32c-intel 00:21:13.592 [job0] 00:21:13.592 filename=/dev/nvme0n1 00:21:13.592 Could not set queue depth (nvme0n1) 00:21:13.592 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:21:13.592 fio-3.35 00:21:13.592 Starting 1 thread 00:21:16.125 20:26:47 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:21:16.125 20:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:16.125 20:26:47 -- common/autotest_common.sh@10 -- # set +x 00:21:16.125 true 00:21:16.125 20:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:16.125 20:26:48 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:21:16.125 20:26:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:16.125 20:26:48 -- common/autotest_common.sh@10 -- # set +x 00:21:16.125 true 00:21:16.125 20:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:16.125 20:26:48 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:21:16.125 20:26:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:16.125 20:26:48 -- common/autotest_common.sh@10 -- # set +x 00:21:16.125 true 00:21:16.125 20:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:16.125 20:26:48 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:21:16.125 20:26:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:16.125 20:26:48 -- common/autotest_common.sh@10 -- # set +x 00:21:16.125 true 00:21:16.125 20:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:16.125 20:26:48 -- target/initiator_timeout.sh@45 -- # sleep 3 00:21:19.411 20:26:51 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:21:19.411 20:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.411 20:26:51 -- common/autotest_common.sh@10 -- # set +x 00:21:19.411 true 00:21:19.411 20:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.411 20:26:51 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:21:19.411 20:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.411 20:26:51 -- common/autotest_common.sh@10 -- # set +x 00:21:19.411 true 00:21:19.411 20:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.411 20:26:51 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:21:19.411 20:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.411 20:26:51 -- common/autotest_common.sh@10 -- # set +x 00:21:19.411 true 00:21:19.411 20:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.411 20:26:51 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:21:19.411 20:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.411 20:26:51 -- common/autotest_common.sh@10 -- # set +x 00:21:19.411 true 00:21:19.411 20:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.411 20:26:51 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:21:19.411 20:26:51 -- target/initiator_timeout.sh@54 -- # wait 3470097 00:22:15.645 00:22:15.645 job0: (groupid=0, jobs=1): err= 0: pid=3470342: Mon Jul 22 20:27:45 2024 00:22:15.645 read: IOPS=16, BW=64.8KiB/s (66.3kB/s)(3888KiB/60008msec) 00:22:15.645 slat (usec): min=3, max=13509, avg=48.24, stdev=572.94 00:22:15.645 clat (usec): min=469, max=41642k, avg=61310.40, stdev=1335224.20 00:22:15.645 lat (usec): min=492, max=41642k, avg=61358.64, stdev=1335223.11 00:22:15.645 clat percentiles (usec): 00:22:15.645 | 1.00th=[ 750], 5.00th=[ 832], 10.00th=[ 857], 00:22:15.645 | 20.00th=[ 955], 30.00th=[ 979], 40.00th=[ 988], 00:22:15.645 | 50.00th=[ 1004], 60.00th=[ 41681], 70.00th=[ 41681], 00:22:15.645 | 80.00th=[ 42206], 90.00th=[ 42206], 95.00th=[ 42206], 00:22:15.645 | 99.00th=[ 42730], 99.50th=[ 42730], 99.90th=[17112761], 00:22:15.645 | 99.95th=[17112761], 99.99th=[17112761] 00:22:15.645 write: IOPS=17, BW=68.3KiB/s (69.9kB/s)(4096KiB/60008msec); 0 zone resets 00:22:15.645 slat (nsec): min=8782, max=43750, avg=10349.46, stdev=2642.85 00:22:15.645 clat (usec): min=235, max=725, avg=337.93, stdev=67.84 00:22:15.645 lat (usec): min=245, max=741, avg=348.28, stdev=68.56 00:22:15.645 clat percentiles (usec): 00:22:15.645 | 1.00th=[ 243], 5.00th=[ 251], 10.00th=[ 258], 20.00th=[ 273], 00:22:15.645 | 30.00th=[ 289], 40.00th=[ 306], 50.00th=[ 334], 60.00th=[ 355], 00:22:15.645 | 70.00th=[ 375], 80.00th=[ 416], 90.00th=[ 424], 95.00th=[ 429], 00:22:15.645 | 99.00th=[ 469], 99.50th=[ 627], 99.90th=[ 709], 99.95th=[ 725], 00:22:15.645 | 99.99th=[ 725] 00:22:15.645 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=2 00:22:15.645 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:22:15.645 lat (usec) : 250=2.15%, 500=48.80%, 750=0.80%, 1000=21.69% 00:22:15.645 lat (msec) : 2=5.66%, 4=0.05%, 50=20.79%, >=2000=0.05% 00:22:15.645 cpu : usr=0.04%, sys=0.05%, ctx=1999, majf=0, minf=2 00:22:15.645 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:15.645 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.645 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.645 issued rwts: total=972,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.645 latency : target=0, window=0, percentile=100.00%, depth=1 00:22:15.645 00:22:15.645 Run status group 0 (all jobs): 00:22:15.645 READ: bw=64.8KiB/s (66.3kB/s), 64.8KiB/s-64.8KiB/s (66.3kB/s-66.3kB/s), io=3888KiB (3981kB), run=60008-60008msec 00:22:15.645 WRITE: bw=68.3KiB/s (69.9kB/s), 68.3KiB/s-68.3KiB/s (69.9kB/s-69.9kB/s), io=4096KiB (4194kB), run=60008-60008msec 00:22:15.645 00:22:15.645 Disk stats (read/write): 00:22:15.645 nvme0n1: ios=1068/1024, merge=0/0, ticks=18041/344, in_queue=18385, util=99.75% 00:22:15.645 20:27:45 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:15.645 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:15.645 20:27:45 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:22:15.645 20:27:45 -- common/autotest_common.sh@1198 -- # local i=0 00:22:15.645 20:27:45 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:15.645 20:27:45 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:22:15.645 20:27:45 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:15.645 20:27:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:22:15.645 20:27:45 -- common/autotest_common.sh@1210 -- # return 0 00:22:15.645 20:27:45 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:22:15.645 20:27:45 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:22:15.645 nvmf hotplug test: fio successful as expected 00:22:15.645 20:27:45 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:15.645 20:27:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:15.645 20:27:45 -- common/autotest_common.sh@10 -- # set +x 00:22:15.645 20:27:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:15.645 20:27:45 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:22:15.645 20:27:45 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:22:15.645 20:27:45 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:22:15.645 20:27:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:15.645 20:27:45 -- nvmf/common.sh@116 -- # sync 00:22:15.645 20:27:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:15.645 20:27:45 -- nvmf/common.sh@119 -- # set +e 00:22:15.645 20:27:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:15.645 20:27:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:15.645 rmmod nvme_tcp 00:22:15.645 rmmod nvme_fabrics 00:22:15.645 rmmod nvme_keyring 00:22:15.645 20:27:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:15.645 20:27:45 -- nvmf/common.sh@123 -- # set -e 00:22:15.645 20:27:45 -- nvmf/common.sh@124 -- # return 0 00:22:15.645 20:27:45 -- nvmf/common.sh@477 -- # '[' -n 3469480 ']' 00:22:15.645 20:27:45 -- nvmf/common.sh@478 -- # killprocess 3469480 00:22:15.645 20:27:45 -- common/autotest_common.sh@926 -- # '[' -z 3469480 ']' 00:22:15.645 20:27:45 -- common/autotest_common.sh@930 -- # kill -0 3469480 00:22:15.645 20:27:45 -- common/autotest_common.sh@931 -- # uname 00:22:15.645 20:27:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:15.645 20:27:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3469480 00:22:15.645 20:27:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:15.645 20:27:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:15.645 20:27:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3469480' 00:22:15.645 killing process with pid 3469480 00:22:15.645 20:27:45 -- common/autotest_common.sh@945 -- # kill 3469480 00:22:15.645 20:27:45 -- common/autotest_common.sh@950 -- # wait 3469480 00:22:15.645 20:27:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:15.645 20:27:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:15.645 20:27:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:15.645 20:27:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:15.645 20:27:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:15.645 20:27:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.645 20:27:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.645 20:27:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:16.214 20:27:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:16.214 00:22:16.214 real 1m12.464s 00:22:16.214 user 4m23.959s 00:22:16.214 sys 0m5.601s 00:22:16.214 20:27:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:16.214 20:27:47 -- common/autotest_common.sh@10 -- # set +x 00:22:16.214 ************************************ 00:22:16.214 END TEST nvmf_initiator_timeout 00:22:16.214 ************************************ 00:22:16.214 20:27:47 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:22:16.214 20:27:47 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:22:16.214 20:27:47 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:22:16.214 20:27:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:16.214 20:27:47 -- common/autotest_common.sh@10 -- # set +x 00:22:21.499 20:27:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:21.499 20:27:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:21.499 20:27:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:21.499 20:27:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:21.499 20:27:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:21.499 20:27:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:21.499 20:27:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:21.499 20:27:52 -- nvmf/common.sh@294 -- # net_devs=() 00:22:21.499 20:27:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:21.499 20:27:52 -- nvmf/common.sh@295 -- # e810=() 00:22:21.499 20:27:52 -- nvmf/common.sh@295 -- # local -ga e810 00:22:21.499 20:27:52 -- nvmf/common.sh@296 -- # x722=() 00:22:21.499 20:27:52 -- nvmf/common.sh@296 -- # local -ga x722 00:22:21.499 20:27:52 -- nvmf/common.sh@297 -- # mlx=() 00:22:21.499 20:27:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:21.499 20:27:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:21.499 20:27:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:21.500 20:27:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:21.500 20:27:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:21.500 20:27:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:21.500 20:27:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:21.500 20:27:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:22:21.500 Found 0000:86:00.0 (0x8086 - 0x159b) 00:22:21.500 20:27:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:21.500 20:27:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:22:21.500 Found 0000:86:00.1 (0x8086 - 0x159b) 00:22:21.500 20:27:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:21.500 20:27:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:21.500 20:27:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:21.500 20:27:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:21.500 20:27:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:21.500 20:27:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:21.500 20:27:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:22:21.500 Found net devices under 0000:86:00.0: cvl_0_0 00:22:21.500 20:27:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:21.500 20:27:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:21.500 20:27:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:21.500 20:27:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:21.500 20:27:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:21.500 20:27:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:22:21.500 Found net devices under 0000:86:00.1: cvl_0_1 00:22:21.500 20:27:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:21.500 20:27:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:21.500 20:27:52 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:21.500 20:27:52 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:22:21.501 20:27:52 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:22:21.501 20:27:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:21.501 20:27:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:21.501 20:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:21.501 ************************************ 00:22:21.501 START TEST nvmf_perf_adq 00:22:21.501 ************************************ 00:22:21.501 20:27:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:22:21.501 * Looking for test storage... 00:22:21.501 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:21.501 20:27:52 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:21.501 20:27:52 -- nvmf/common.sh@7 -- # uname -s 00:22:21.501 20:27:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:21.501 20:27:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:21.501 20:27:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:21.501 20:27:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:21.501 20:27:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:21.501 20:27:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:21.501 20:27:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:21.501 20:27:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:21.501 20:27:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:21.501 20:27:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:21.501 20:27:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:22:21.501 20:27:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:22:21.501 20:27:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:21.501 20:27:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:21.501 20:27:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:21.501 20:27:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:21.501 20:27:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:21.501 20:27:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:21.501 20:27:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:21.501 20:27:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:21.501 20:27:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:21.501 20:27:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:21.501 20:27:52 -- paths/export.sh@5 -- # export PATH 00:22:21.501 20:27:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:21.501 20:27:52 -- nvmf/common.sh@46 -- # : 0 00:22:21.501 20:27:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:21.501 20:27:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:21.501 20:27:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:21.502 20:27:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:21.502 20:27:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:21.502 20:27:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:21.502 20:27:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:21.502 20:27:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:21.502 20:27:52 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:22:21.502 20:27:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:21.502 20:27:52 -- common/autotest_common.sh@10 -- # set +x 00:22:26.894 20:27:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:26.894 20:27:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:26.894 20:27:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:26.894 20:27:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:26.894 20:27:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:26.894 20:27:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:26.894 20:27:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:26.894 20:27:58 -- nvmf/common.sh@294 -- # net_devs=() 00:22:26.894 20:27:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:26.894 20:27:58 -- nvmf/common.sh@295 -- # e810=() 00:22:26.894 20:27:58 -- nvmf/common.sh@295 -- # local -ga e810 00:22:26.894 20:27:58 -- nvmf/common.sh@296 -- # x722=() 00:22:26.894 20:27:58 -- nvmf/common.sh@296 -- # local -ga x722 00:22:26.894 20:27:58 -- nvmf/common.sh@297 -- # mlx=() 00:22:26.894 20:27:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:26.894 20:27:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:26.894 20:27:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:26.894 20:27:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:26.894 20:27:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:26.894 20:27:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:26.894 20:27:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:22:26.894 Found 0000:86:00.0 (0x8086 - 0x159b) 00:22:26.894 20:27:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:26.894 20:27:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:22:26.894 Found 0000:86:00.1 (0x8086 - 0x159b) 00:22:26.894 20:27:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:26.894 20:27:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:26.894 20:27:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:26.894 20:27:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:26.894 20:27:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:26.894 20:27:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:26.894 20:27:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:22:26.894 Found net devices under 0000:86:00.0: cvl_0_0 00:22:26.894 20:27:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:26.895 20:27:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:26.895 20:27:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:26.895 20:27:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:26.895 20:27:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:26.895 20:27:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:22:26.895 Found net devices under 0000:86:00.1: cvl_0_1 00:22:26.895 20:27:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:26.895 20:27:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:26.895 20:27:58 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:26.895 20:27:58 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:22:26.895 20:27:58 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:22:26.895 20:27:58 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:22:26.895 20:27:58 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:27.834 20:27:59 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:29.215 20:28:01 -- target/perf_adq.sh@54 -- # sleep 5 00:22:34.495 20:28:06 -- target/perf_adq.sh@67 -- # nvmftestinit 00:22:34.495 20:28:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:34.495 20:28:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:34.495 20:28:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:34.495 20:28:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:34.495 20:28:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:34.495 20:28:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.495 20:28:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:34.495 20:28:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.495 20:28:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:34.495 20:28:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:34.495 20:28:06 -- common/autotest_common.sh@10 -- # set +x 00:22:34.495 20:28:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:34.495 20:28:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:34.495 20:28:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:34.495 20:28:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:34.495 20:28:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:34.495 20:28:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:34.495 20:28:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:34.495 20:28:06 -- nvmf/common.sh@294 -- # net_devs=() 00:22:34.495 20:28:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:34.495 20:28:06 -- nvmf/common.sh@295 -- # e810=() 00:22:34.495 20:28:06 -- nvmf/common.sh@295 -- # local -ga e810 00:22:34.495 20:28:06 -- nvmf/common.sh@296 -- # x722=() 00:22:34.495 20:28:06 -- nvmf/common.sh@296 -- # local -ga x722 00:22:34.495 20:28:06 -- nvmf/common.sh@297 -- # mlx=() 00:22:34.495 20:28:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:34.495 20:28:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:34.495 20:28:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:34.495 20:28:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:34.495 20:28:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:34.495 20:28:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:34.495 20:28:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:22:34.495 Found 0000:86:00.0 (0x8086 - 0x159b) 00:22:34.495 20:28:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:34.495 20:28:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:22:34.495 Found 0000:86:00.1 (0x8086 - 0x159b) 00:22:34.495 20:28:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:34.495 20:28:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:34.495 20:28:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:34.495 20:28:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:34.495 20:28:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:34.495 20:28:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:22:34.495 Found net devices under 0000:86:00.0: cvl_0_0 00:22:34.495 20:28:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:34.495 20:28:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:34.495 20:28:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:34.495 20:28:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:34.495 20:28:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:34.495 20:28:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:22:34.495 Found net devices under 0000:86:00.1: cvl_0_1 00:22:34.495 20:28:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:34.495 20:28:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:34.495 20:28:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:34.495 20:28:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:34.495 20:28:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:34.495 20:28:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:34.495 20:28:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:34.495 20:28:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:34.495 20:28:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:34.495 20:28:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:34.495 20:28:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:34.495 20:28:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:34.496 20:28:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:34.496 20:28:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:34.496 20:28:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:34.496 20:28:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:34.496 20:28:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:34.496 20:28:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:34.496 20:28:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:34.496 20:28:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:34.496 20:28:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:34.496 20:28:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:34.496 20:28:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:34.496 20:28:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:34.496 20:28:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:34.496 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:34.496 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:22:34.496 00:22:34.496 --- 10.0.0.2 ping statistics --- 00:22:34.496 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:34.496 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:22:34.496 20:28:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:34.496 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:34.496 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.228 ms 00:22:34.496 00:22:34.496 --- 10.0.0.1 ping statistics --- 00:22:34.496 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:34.496 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:22:34.496 20:28:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:34.496 20:28:06 -- nvmf/common.sh@410 -- # return 0 00:22:34.496 20:28:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:34.496 20:28:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:34.496 20:28:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:34.496 20:28:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:34.496 20:28:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:34.496 20:28:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:34.496 20:28:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:34.756 20:28:06 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:34.756 20:28:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:34.756 20:28:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:34.756 20:28:06 -- common/autotest_common.sh@10 -- # set +x 00:22:34.756 20:28:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:34.756 20:28:06 -- nvmf/common.sh@469 -- # nvmfpid=3488523 00:22:34.756 20:28:06 -- nvmf/common.sh@470 -- # waitforlisten 3488523 00:22:34.756 20:28:06 -- common/autotest_common.sh@819 -- # '[' -z 3488523 ']' 00:22:34.756 20:28:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:34.756 20:28:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:34.756 20:28:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:34.756 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:34.756 20:28:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:34.756 20:28:06 -- common/autotest_common.sh@10 -- # set +x 00:22:34.756 [2024-07-22 20:28:06.471243] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:22:34.756 [2024-07-22 20:28:06.471283] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:34.756 EAL: No free 2048 kB hugepages reported on node 1 00:22:34.756 [2024-07-22 20:28:06.529907] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:34.756 [2024-07-22 20:28:06.600234] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:34.756 [2024-07-22 20:28:06.600345] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:34.756 [2024-07-22 20:28:06.600353] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:34.756 [2024-07-22 20:28:06.600359] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:34.756 [2024-07-22 20:28:06.600415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:34.756 [2024-07-22 20:28:06.600512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:34.756 [2024-07-22 20:28:06.600596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:34.756 [2024-07-22 20:28:06.600597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:35.695 20:28:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:35.695 20:28:07 -- common/autotest_common.sh@852 -- # return 0 00:22:35.695 20:28:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:35.695 20:28:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:35.695 20:28:07 -- common/autotest_common.sh@10 -- # set +x 00:22:35.695 20:28:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:35.695 20:28:07 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:22:35.695 20:28:07 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:22:35.695 20:28:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.695 20:28:07 -- common/autotest_common.sh@10 -- # set +x 00:22:35.695 20:28:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.695 20:28:07 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:35.695 20:28:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.695 20:28:07 -- common/autotest_common.sh@10 -- # set +x 00:22:35.695 20:28:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.695 20:28:07 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:22:35.695 20:28:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.695 20:28:07 -- common/autotest_common.sh@10 -- # set +x 00:22:35.695 [2024-07-22 20:28:07.419559] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:35.695 20:28:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.695 20:28:07 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:35.695 20:28:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.695 20:28:07 -- common/autotest_common.sh@10 -- # set +x 00:22:35.695 Malloc1 00:22:35.695 20:28:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.695 20:28:07 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:35.695 20:28:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.695 20:28:07 -- common/autotest_common.sh@10 -- # set +x 00:22:35.695 20:28:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.695 20:28:07 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:35.695 20:28:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.695 20:28:07 -- common/autotest_common.sh@10 -- # set +x 00:22:35.695 20:28:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.695 20:28:07 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:35.695 20:28:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.695 20:28:07 -- common/autotest_common.sh@10 -- # set +x 00:22:35.695 [2024-07-22 20:28:07.463212] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:35.695 20:28:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.695 20:28:07 -- target/perf_adq.sh@73 -- # perfpid=3488776 00:22:35.695 20:28:07 -- target/perf_adq.sh@74 -- # sleep 2 00:22:35.695 20:28:07 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:35.695 EAL: No free 2048 kB hugepages reported on node 1 00:22:37.602 20:28:09 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:22:37.602 20:28:09 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:22:37.602 20:28:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:37.602 20:28:09 -- target/perf_adq.sh@76 -- # wc -l 00:22:37.602 20:28:09 -- common/autotest_common.sh@10 -- # set +x 00:22:37.602 20:28:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:37.602 20:28:09 -- target/perf_adq.sh@76 -- # count=4 00:22:37.602 20:28:09 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:22:37.602 20:28:09 -- target/perf_adq.sh@81 -- # wait 3488776 00:22:45.727 Initializing NVMe Controllers 00:22:45.727 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:45.727 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:45.727 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:45.727 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:45.727 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:45.727 Initialization complete. Launching workers. 00:22:45.727 ======================================================== 00:22:45.727 Latency(us) 00:22:45.727 Device Information : IOPS MiB/s Average min max 00:22:45.727 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11181.24 43.68 5724.11 1919.82 9671.65 00:22:45.727 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11207.04 43.78 5710.66 2254.43 11233.48 00:22:45.727 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11018.45 43.04 5808.33 1640.84 14677.09 00:22:45.727 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11141.04 43.52 5744.81 2209.49 11135.43 00:22:45.727 ======================================================== 00:22:45.727 Total : 44547.78 174.01 5746.74 1640.84 14677.09 00:22:45.727 00:22:45.727 20:28:17 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:45.727 20:28:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:45.727 20:28:17 -- nvmf/common.sh@116 -- # sync 00:22:45.727 20:28:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:45.727 20:28:17 -- nvmf/common.sh@119 -- # set +e 00:22:45.727 20:28:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:45.727 20:28:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:45.727 rmmod nvme_tcp 00:22:45.727 rmmod nvme_fabrics 00:22:45.727 rmmod nvme_keyring 00:22:45.987 20:28:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:45.987 20:28:17 -- nvmf/common.sh@123 -- # set -e 00:22:45.987 20:28:17 -- nvmf/common.sh@124 -- # return 0 00:22:45.987 20:28:17 -- nvmf/common.sh@477 -- # '[' -n 3488523 ']' 00:22:45.987 20:28:17 -- nvmf/common.sh@478 -- # killprocess 3488523 00:22:45.987 20:28:17 -- common/autotest_common.sh@926 -- # '[' -z 3488523 ']' 00:22:45.987 20:28:17 -- common/autotest_common.sh@930 -- # kill -0 3488523 00:22:45.987 20:28:17 -- common/autotest_common.sh@931 -- # uname 00:22:45.987 20:28:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:45.987 20:28:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3488523 00:22:45.987 20:28:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:45.987 20:28:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:45.987 20:28:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3488523' 00:22:45.987 killing process with pid 3488523 00:22:45.987 20:28:17 -- common/autotest_common.sh@945 -- # kill 3488523 00:22:45.987 20:28:17 -- common/autotest_common.sh@950 -- # wait 3488523 00:22:46.247 20:28:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:46.247 20:28:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:46.247 20:28:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:46.247 20:28:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:46.247 20:28:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:46.247 20:28:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:46.247 20:28:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:46.247 20:28:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:48.155 20:28:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:48.155 20:28:19 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:48.155 20:28:19 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:49.094 20:28:20 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:51.002 20:28:22 -- target/perf_adq.sh@54 -- # sleep 5 00:22:56.321 20:28:27 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:56.321 20:28:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:56.321 20:28:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:56.321 20:28:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:56.321 20:28:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:56.321 20:28:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:56.321 20:28:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:56.321 20:28:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:56.321 20:28:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:56.321 20:28:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:56.321 20:28:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:56.321 20:28:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:56.321 20:28:27 -- common/autotest_common.sh@10 -- # set +x 00:22:56.321 20:28:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:56.321 20:28:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:56.321 20:28:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:56.321 20:28:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:56.321 20:28:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:56.321 20:28:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:56.321 20:28:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:56.321 20:28:27 -- nvmf/common.sh@294 -- # net_devs=() 00:22:56.321 20:28:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:56.321 20:28:27 -- nvmf/common.sh@295 -- # e810=() 00:22:56.321 20:28:27 -- nvmf/common.sh@295 -- # local -ga e810 00:22:56.321 20:28:27 -- nvmf/common.sh@296 -- # x722=() 00:22:56.321 20:28:27 -- nvmf/common.sh@296 -- # local -ga x722 00:22:56.321 20:28:27 -- nvmf/common.sh@297 -- # mlx=() 00:22:56.321 20:28:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:56.321 20:28:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:56.321 20:28:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:56.321 20:28:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:56.321 20:28:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:56.321 20:28:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:56.321 20:28:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:56.321 20:28:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:56.321 20:28:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:56.321 20:28:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:22:56.321 Found 0000:86:00.0 (0x8086 - 0x159b) 00:22:56.321 20:28:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:56.321 20:28:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:56.321 20:28:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:56.321 20:28:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:56.322 20:28:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:22:56.322 Found 0000:86:00.1 (0x8086 - 0x159b) 00:22:56.322 20:28:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:56.322 20:28:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:56.322 20:28:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:56.322 20:28:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:56.322 20:28:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:56.322 20:28:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:22:56.322 Found net devices under 0000:86:00.0: cvl_0_0 00:22:56.322 20:28:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:56.322 20:28:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:56.322 20:28:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:56.322 20:28:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:56.322 20:28:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:56.322 20:28:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:22:56.322 Found net devices under 0000:86:00.1: cvl_0_1 00:22:56.322 20:28:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:56.322 20:28:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:56.322 20:28:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:56.322 20:28:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:56.322 20:28:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:56.322 20:28:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:56.322 20:28:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:56.322 20:28:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:56.322 20:28:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:56.322 20:28:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:56.322 20:28:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:56.322 20:28:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:56.322 20:28:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:56.322 20:28:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:56.322 20:28:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:56.322 20:28:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:56.322 20:28:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:56.322 20:28:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:56.322 20:28:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:56.322 20:28:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:56.322 20:28:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:56.322 20:28:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:56.322 20:28:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:56.322 20:28:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:56.322 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:56.322 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.172 ms 00:22:56.322 00:22:56.322 --- 10.0.0.2 ping statistics --- 00:22:56.322 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.322 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:22:56.322 20:28:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:56.322 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:56.322 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.303 ms 00:22:56.322 00:22:56.322 --- 10.0.0.1 ping statistics --- 00:22:56.322 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.322 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:22:56.322 20:28:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:56.322 20:28:27 -- nvmf/common.sh@410 -- # return 0 00:22:56.322 20:28:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:56.322 20:28:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:56.322 20:28:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:56.322 20:28:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:56.322 20:28:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:56.322 20:28:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:56.322 20:28:27 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:56.322 20:28:27 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:56.322 20:28:27 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:56.322 20:28:27 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:56.322 net.core.busy_poll = 1 00:22:56.322 20:28:27 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:56.322 net.core.busy_read = 1 00:22:56.322 20:28:27 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:56.322 20:28:27 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:56.322 20:28:28 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:56.322 20:28:28 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:56.322 20:28:28 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:56.322 20:28:28 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:56.322 20:28:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:56.322 20:28:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:56.322 20:28:28 -- common/autotest_common.sh@10 -- # set +x 00:22:56.322 20:28:28 -- nvmf/common.sh@469 -- # nvmfpid=3492391 00:22:56.322 20:28:28 -- nvmf/common.sh@470 -- # waitforlisten 3492391 00:22:56.322 20:28:28 -- common/autotest_common.sh@819 -- # '[' -z 3492391 ']' 00:22:56.322 20:28:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:56.322 20:28:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:56.322 20:28:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:56.322 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:56.322 20:28:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:56.322 20:28:28 -- common/autotest_common.sh@10 -- # set +x 00:22:56.322 20:28:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:56.322 [2024-07-22 20:28:28.193486] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:22:56.322 [2024-07-22 20:28:28.193529] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:56.322 EAL: No free 2048 kB hugepages reported on node 1 00:22:56.322 [2024-07-22 20:28:28.248989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:56.582 [2024-07-22 20:28:28.330302] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:56.582 [2024-07-22 20:28:28.330405] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:56.582 [2024-07-22 20:28:28.330415] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:56.582 [2024-07-22 20:28:28.330422] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:56.582 [2024-07-22 20:28:28.330459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:56.582 [2024-07-22 20:28:28.330476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:56.582 [2024-07-22 20:28:28.330567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:56.582 [2024-07-22 20:28:28.330568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:57.151 20:28:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:57.151 20:28:28 -- common/autotest_common.sh@852 -- # return 0 00:22:57.151 20:28:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:57.151 20:28:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:57.151 20:28:28 -- common/autotest_common.sh@10 -- # set +x 00:22:57.151 20:28:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:57.151 20:28:29 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:57.151 20:28:29 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:57.151 20:28:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:57.151 20:28:29 -- common/autotest_common.sh@10 -- # set +x 00:22:57.151 20:28:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:57.151 20:28:29 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:57.151 20:28:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:57.151 20:28:29 -- common/autotest_common.sh@10 -- # set +x 00:22:57.410 20:28:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:57.410 20:28:29 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:57.410 20:28:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:57.410 20:28:29 -- common/autotest_common.sh@10 -- # set +x 00:22:57.411 [2024-07-22 20:28:29.128621] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:57.411 20:28:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:57.411 20:28:29 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:57.411 20:28:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:57.411 20:28:29 -- common/autotest_common.sh@10 -- # set +x 00:22:57.411 Malloc1 00:22:57.411 20:28:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:57.411 20:28:29 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:57.411 20:28:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:57.411 20:28:29 -- common/autotest_common.sh@10 -- # set +x 00:22:57.411 20:28:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:57.411 20:28:29 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:57.411 20:28:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:57.411 20:28:29 -- common/autotest_common.sh@10 -- # set +x 00:22:57.411 20:28:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:57.411 20:28:29 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:57.411 20:28:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:57.411 20:28:29 -- common/autotest_common.sh@10 -- # set +x 00:22:57.411 [2024-07-22 20:28:29.172322] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:57.411 20:28:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:57.411 20:28:29 -- target/perf_adq.sh@94 -- # perfpid=3492643 00:22:57.411 20:28:29 -- target/perf_adq.sh@95 -- # sleep 2 00:22:57.411 20:28:29 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:57.411 EAL: No free 2048 kB hugepages reported on node 1 00:22:59.316 20:28:31 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:59.316 20:28:31 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:59.316 20:28:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.316 20:28:31 -- target/perf_adq.sh@97 -- # wc -l 00:22:59.316 20:28:31 -- common/autotest_common.sh@10 -- # set +x 00:22:59.316 20:28:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.316 20:28:31 -- target/perf_adq.sh@97 -- # count=2 00:22:59.316 20:28:31 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:59.317 20:28:31 -- target/perf_adq.sh@103 -- # wait 3492643 00:23:07.440 Initializing NVMe Controllers 00:23:07.440 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:07.440 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:23:07.440 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:23:07.440 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:23:07.440 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:23:07.440 Initialization complete. Launching workers. 00:23:07.440 ======================================================== 00:23:07.440 Latency(us) 00:23:07.440 Device Information : IOPS MiB/s Average min max 00:23:07.440 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7409.10 28.94 8638.55 1333.14 54237.94 00:23:07.440 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 7794.20 30.45 8236.37 1730.72 54110.41 00:23:07.440 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 6738.50 26.32 9497.72 1652.46 56390.71 00:23:07.440 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 8812.30 34.42 7262.80 1780.01 52210.11 00:23:07.440 ======================================================== 00:23:07.440 Total : 30754.10 120.13 8330.67 1333.14 56390.71 00:23:07.440 00:23:07.440 20:28:39 -- target/perf_adq.sh@104 -- # nvmftestfini 00:23:07.440 20:28:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:07.440 20:28:39 -- nvmf/common.sh@116 -- # sync 00:23:07.440 20:28:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:07.440 20:28:39 -- nvmf/common.sh@119 -- # set +e 00:23:07.440 20:28:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:07.440 20:28:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:07.699 rmmod nvme_tcp 00:23:07.699 rmmod nvme_fabrics 00:23:07.699 rmmod nvme_keyring 00:23:07.700 20:28:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:07.700 20:28:39 -- nvmf/common.sh@123 -- # set -e 00:23:07.700 20:28:39 -- nvmf/common.sh@124 -- # return 0 00:23:07.700 20:28:39 -- nvmf/common.sh@477 -- # '[' -n 3492391 ']' 00:23:07.700 20:28:39 -- nvmf/common.sh@478 -- # killprocess 3492391 00:23:07.700 20:28:39 -- common/autotest_common.sh@926 -- # '[' -z 3492391 ']' 00:23:07.700 20:28:39 -- common/autotest_common.sh@930 -- # kill -0 3492391 00:23:07.700 20:28:39 -- common/autotest_common.sh@931 -- # uname 00:23:07.700 20:28:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:07.700 20:28:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3492391 00:23:07.700 20:28:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:07.700 20:28:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:07.700 20:28:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3492391' 00:23:07.700 killing process with pid 3492391 00:23:07.700 20:28:39 -- common/autotest_common.sh@945 -- # kill 3492391 00:23:07.700 20:28:39 -- common/autotest_common.sh@950 -- # wait 3492391 00:23:07.959 20:28:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:07.959 20:28:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:07.959 20:28:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:07.959 20:28:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:07.959 20:28:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:07.959 20:28:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:07.959 20:28:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:07.959 20:28:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:11.252 20:28:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:11.252 20:28:42 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:23:11.252 00:23:11.252 real 0m49.961s 00:23:11.252 user 2m48.336s 00:23:11.252 sys 0m9.828s 00:23:11.252 20:28:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:11.252 20:28:42 -- common/autotest_common.sh@10 -- # set +x 00:23:11.252 ************************************ 00:23:11.252 END TEST nvmf_perf_adq 00:23:11.252 ************************************ 00:23:11.252 20:28:42 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:23:11.252 20:28:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:11.252 20:28:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:11.252 20:28:42 -- common/autotest_common.sh@10 -- # set +x 00:23:11.252 ************************************ 00:23:11.252 START TEST nvmf_shutdown 00:23:11.252 ************************************ 00:23:11.252 20:28:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:23:11.252 * Looking for test storage... 00:23:11.252 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:11.252 20:28:42 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:11.252 20:28:42 -- nvmf/common.sh@7 -- # uname -s 00:23:11.252 20:28:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:11.252 20:28:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:11.252 20:28:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:11.252 20:28:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:11.252 20:28:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:11.252 20:28:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:11.252 20:28:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:11.252 20:28:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:11.252 20:28:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:11.252 20:28:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:11.252 20:28:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:23:11.252 20:28:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:23:11.252 20:28:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:11.252 20:28:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:11.252 20:28:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:11.252 20:28:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:11.252 20:28:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:11.252 20:28:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:11.252 20:28:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:11.252 20:28:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.252 20:28:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.252 20:28:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.252 20:28:42 -- paths/export.sh@5 -- # export PATH 00:23:11.252 20:28:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.252 20:28:42 -- nvmf/common.sh@46 -- # : 0 00:23:11.252 20:28:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:11.252 20:28:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:11.252 20:28:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:11.252 20:28:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:11.252 20:28:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:11.252 20:28:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:11.252 20:28:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:11.252 20:28:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:11.252 20:28:42 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:11.252 20:28:42 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:11.252 20:28:42 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:23:11.252 20:28:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:23:11.252 20:28:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:11.252 20:28:42 -- common/autotest_common.sh@10 -- # set +x 00:23:11.252 ************************************ 00:23:11.252 START TEST nvmf_shutdown_tc1 00:23:11.252 ************************************ 00:23:11.252 20:28:42 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:23:11.252 20:28:42 -- target/shutdown.sh@74 -- # starttarget 00:23:11.253 20:28:42 -- target/shutdown.sh@15 -- # nvmftestinit 00:23:11.253 20:28:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:11.253 20:28:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:11.253 20:28:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:11.253 20:28:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:11.253 20:28:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:11.253 20:28:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:11.253 20:28:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:11.253 20:28:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:11.253 20:28:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:11.253 20:28:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:11.253 20:28:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:11.253 20:28:42 -- common/autotest_common.sh@10 -- # set +x 00:23:16.526 20:28:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:16.526 20:28:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:16.526 20:28:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:16.526 20:28:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:16.526 20:28:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:16.526 20:28:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:16.526 20:28:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:16.526 20:28:47 -- nvmf/common.sh@294 -- # net_devs=() 00:23:16.526 20:28:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:16.526 20:28:47 -- nvmf/common.sh@295 -- # e810=() 00:23:16.526 20:28:47 -- nvmf/common.sh@295 -- # local -ga e810 00:23:16.526 20:28:47 -- nvmf/common.sh@296 -- # x722=() 00:23:16.526 20:28:47 -- nvmf/common.sh@296 -- # local -ga x722 00:23:16.526 20:28:47 -- nvmf/common.sh@297 -- # mlx=() 00:23:16.526 20:28:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:16.526 20:28:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:16.526 20:28:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:16.526 20:28:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:16.526 20:28:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:16.526 20:28:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.526 20:28:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:23:16.526 Found 0000:86:00.0 (0x8086 - 0x159b) 00:23:16.526 20:28:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.526 20:28:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:23:16.526 Found 0000:86:00.1 (0x8086 - 0x159b) 00:23:16.526 20:28:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:16.526 20:28:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.526 20:28:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.526 20:28:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.526 20:28:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.526 20:28:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:23:16.526 Found net devices under 0000:86:00.0: cvl_0_0 00:23:16.526 20:28:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.526 20:28:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.526 20:28:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.526 20:28:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.526 20:28:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.526 20:28:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:23:16.526 Found net devices under 0000:86:00.1: cvl_0_1 00:23:16.526 20:28:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.526 20:28:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:16.526 20:28:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:16.526 20:28:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:16.526 20:28:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:16.526 20:28:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:16.526 20:28:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:16.526 20:28:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:16.526 20:28:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:16.526 20:28:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:16.526 20:28:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:16.526 20:28:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:16.526 20:28:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:16.526 20:28:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:16.526 20:28:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:16.526 20:28:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:16.526 20:28:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:16.526 20:28:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:16.526 20:28:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:16.526 20:28:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:16.526 20:28:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:16.526 20:28:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:16.526 20:28:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:16.526 20:28:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:16.526 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:16.526 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:23:16.526 00:23:16.526 --- 10.0.0.2 ping statistics --- 00:23:16.526 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:16.526 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:23:16.526 20:28:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:16.526 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:16.526 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.303 ms 00:23:16.526 00:23:16.526 --- 10.0.0.1 ping statistics --- 00:23:16.526 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:16.526 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:23:16.526 20:28:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:16.526 20:28:47 -- nvmf/common.sh@410 -- # return 0 00:23:16.526 20:28:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:16.526 20:28:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:16.526 20:28:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:16.526 20:28:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:16.526 20:28:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:16.526 20:28:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:16.526 20:28:47 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:23:16.526 20:28:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:16.526 20:28:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:16.526 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:23:16.526 20:28:47 -- nvmf/common.sh@469 -- # nvmfpid=3497905 00:23:16.526 20:28:47 -- nvmf/common.sh@470 -- # waitforlisten 3497905 00:23:16.526 20:28:47 -- common/autotest_common.sh@819 -- # '[' -z 3497905 ']' 00:23:16.526 20:28:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:16.526 20:28:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:16.526 20:28:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:16.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:16.526 20:28:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:16.526 20:28:47 -- common/autotest_common.sh@10 -- # set +x 00:23:16.526 20:28:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:23:16.526 [2024-07-22 20:28:47.806225] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:16.526 [2024-07-22 20:28:47.806270] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:16.526 EAL: No free 2048 kB hugepages reported on node 1 00:23:16.526 [2024-07-22 20:28:47.862881] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:16.526 [2024-07-22 20:28:47.938989] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:16.526 [2024-07-22 20:28:47.939101] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:16.527 [2024-07-22 20:28:47.939109] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:16.527 [2024-07-22 20:28:47.939116] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:16.527 [2024-07-22 20:28:47.939153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:16.527 [2024-07-22 20:28:47.939251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:16.527 [2024-07-22 20:28:47.939357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:16.527 [2024-07-22 20:28:47.939358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:23:16.786 20:28:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:16.786 20:28:48 -- common/autotest_common.sh@852 -- # return 0 00:23:16.786 20:28:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:16.786 20:28:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:16.786 20:28:48 -- common/autotest_common.sh@10 -- # set +x 00:23:16.786 20:28:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:16.786 20:28:48 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:16.786 20:28:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:16.786 20:28:48 -- common/autotest_common.sh@10 -- # set +x 00:23:16.786 [2024-07-22 20:28:48.640346] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:16.786 20:28:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:16.786 20:28:48 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:23:16.786 20:28:48 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:23:16.786 20:28:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:16.786 20:28:48 -- common/autotest_common.sh@10 -- # set +x 00:23:16.786 20:28:48 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:16.786 20:28:48 -- target/shutdown.sh@28 -- # cat 00:23:16.786 20:28:48 -- target/shutdown.sh@35 -- # rpc_cmd 00:23:16.786 20:28:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:16.786 20:28:48 -- common/autotest_common.sh@10 -- # set +x 00:23:16.786 Malloc1 00:23:17.046 [2024-07-22 20:28:48.740352] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:17.046 Malloc2 00:23:17.046 Malloc3 00:23:17.046 Malloc4 00:23:17.046 Malloc5 00:23:17.046 Malloc6 00:23:17.046 Malloc7 00:23:17.305 Malloc8 00:23:17.305 Malloc9 00:23:17.305 Malloc10 00:23:17.305 20:28:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:17.305 20:28:49 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:23:17.305 20:28:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:17.305 20:28:49 -- common/autotest_common.sh@10 -- # set +x 00:23:17.305 20:28:49 -- target/shutdown.sh@78 -- # perfpid=3498192 00:23:17.305 20:28:49 -- target/shutdown.sh@79 -- # waitforlisten 3498192 /var/tmp/bdevperf.sock 00:23:17.305 20:28:49 -- common/autotest_common.sh@819 -- # '[' -z 3498192 ']' 00:23:17.305 20:28:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:17.305 20:28:49 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:23:17.305 20:28:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:17.305 20:28:49 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:23:17.305 20:28:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:17.305 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:17.305 20:28:49 -- nvmf/common.sh@520 -- # config=() 00:23:17.305 20:28:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:17.305 20:28:49 -- nvmf/common.sh@520 -- # local subsystem config 00:23:17.305 20:28:49 -- common/autotest_common.sh@10 -- # set +x 00:23:17.305 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.305 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.305 { 00:23:17.305 "params": { 00:23:17.305 "name": "Nvme$subsystem", 00:23:17.305 "trtype": "$TEST_TRANSPORT", 00:23:17.305 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.305 "adrfam": "ipv4", 00:23:17.305 "trsvcid": "$NVMF_PORT", 00:23:17.305 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.305 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.305 "hdgst": ${hdgst:-false}, 00:23:17.305 "ddgst": ${ddgst:-false} 00:23:17.305 }, 00:23:17.305 "method": "bdev_nvme_attach_controller" 00:23:17.305 } 00:23:17.305 EOF 00:23:17.305 )") 00:23:17.305 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.305 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.305 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 [2024-07-22 20:28:49.204439] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:17.306 [2024-07-22 20:28:49.204489] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:23:17.306 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 20:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:17.306 { 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme$subsystem", 00:23:17.306 "trtype": "$TEST_TRANSPORT", 00:23:17.306 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "$NVMF_PORT", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:17.306 "hdgst": ${hdgst:-false}, 00:23:17.306 "ddgst": ${ddgst:-false} 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 } 00:23:17.306 EOF 00:23:17.306 )") 00:23:17.306 EAL: No free 2048 kB hugepages reported on node 1 00:23:17.306 20:28:49 -- nvmf/common.sh@542 -- # cat 00:23:17.306 20:28:49 -- nvmf/common.sh@544 -- # jq . 00:23:17.306 20:28:49 -- nvmf/common.sh@545 -- # IFS=, 00:23:17.306 20:28:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme1", 00:23:17.306 "trtype": "tcp", 00:23:17.306 "traddr": "10.0.0.2", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "4420", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:23:17.306 "hdgst": false, 00:23:17.306 "ddgst": false 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 },{ 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme2", 00:23:17.306 "trtype": "tcp", 00:23:17.306 "traddr": "10.0.0.2", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "4420", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:23:17.306 "hdgst": false, 00:23:17.306 "ddgst": false 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 },{ 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme3", 00:23:17.306 "trtype": "tcp", 00:23:17.306 "traddr": "10.0.0.2", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "4420", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:23:17.306 "hdgst": false, 00:23:17.306 "ddgst": false 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 },{ 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme4", 00:23:17.306 "trtype": "tcp", 00:23:17.306 "traddr": "10.0.0.2", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "4420", 00:23:17.306 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:23:17.306 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:23:17.306 "hdgst": false, 00:23:17.306 "ddgst": false 00:23:17.306 }, 00:23:17.306 "method": "bdev_nvme_attach_controller" 00:23:17.306 },{ 00:23:17.306 "params": { 00:23:17.306 "name": "Nvme5", 00:23:17.306 "trtype": "tcp", 00:23:17.306 "traddr": "10.0.0.2", 00:23:17.306 "adrfam": "ipv4", 00:23:17.306 "trsvcid": "4420", 00:23:17.307 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:23:17.307 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:23:17.307 "hdgst": false, 00:23:17.307 "ddgst": false 00:23:17.307 }, 00:23:17.307 "method": "bdev_nvme_attach_controller" 00:23:17.307 },{ 00:23:17.307 "params": { 00:23:17.307 "name": "Nvme6", 00:23:17.307 "trtype": "tcp", 00:23:17.307 "traddr": "10.0.0.2", 00:23:17.307 "adrfam": "ipv4", 00:23:17.307 "trsvcid": "4420", 00:23:17.307 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:23:17.307 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:23:17.307 "hdgst": false, 00:23:17.307 "ddgst": false 00:23:17.307 }, 00:23:17.307 "method": "bdev_nvme_attach_controller" 00:23:17.307 },{ 00:23:17.307 "params": { 00:23:17.307 "name": "Nvme7", 00:23:17.307 "trtype": "tcp", 00:23:17.307 "traddr": "10.0.0.2", 00:23:17.307 "adrfam": "ipv4", 00:23:17.307 "trsvcid": "4420", 00:23:17.307 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:23:17.307 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:23:17.307 "hdgst": false, 00:23:17.307 "ddgst": false 00:23:17.307 }, 00:23:17.307 "method": "bdev_nvme_attach_controller" 00:23:17.307 },{ 00:23:17.307 "params": { 00:23:17.307 "name": "Nvme8", 00:23:17.307 "trtype": "tcp", 00:23:17.307 "traddr": "10.0.0.2", 00:23:17.307 "adrfam": "ipv4", 00:23:17.307 "trsvcid": "4420", 00:23:17.307 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:23:17.307 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:23:17.307 "hdgst": false, 00:23:17.307 "ddgst": false 00:23:17.307 }, 00:23:17.307 "method": "bdev_nvme_attach_controller" 00:23:17.307 },{ 00:23:17.307 "params": { 00:23:17.307 "name": "Nvme9", 00:23:17.307 "trtype": "tcp", 00:23:17.307 "traddr": "10.0.0.2", 00:23:17.307 "adrfam": "ipv4", 00:23:17.307 "trsvcid": "4420", 00:23:17.307 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:23:17.307 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:23:17.307 "hdgst": false, 00:23:17.307 "ddgst": false 00:23:17.307 }, 00:23:17.307 "method": "bdev_nvme_attach_controller" 00:23:17.307 },{ 00:23:17.307 "params": { 00:23:17.307 "name": "Nvme10", 00:23:17.307 "trtype": "tcp", 00:23:17.307 "traddr": "10.0.0.2", 00:23:17.307 "adrfam": "ipv4", 00:23:17.307 "trsvcid": "4420", 00:23:17.307 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:23:17.307 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:23:17.307 "hdgst": false, 00:23:17.307 "ddgst": false 00:23:17.307 }, 00:23:17.307 "method": "bdev_nvme_attach_controller" 00:23:17.307 }' 00:23:17.566 [2024-07-22 20:28:49.261117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:17.566 [2024-07-22 20:28:49.333644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:18.945 20:28:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:18.945 20:28:50 -- common/autotest_common.sh@852 -- # return 0 00:23:18.945 20:28:50 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:23:18.945 20:28:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:18.945 20:28:50 -- common/autotest_common.sh@10 -- # set +x 00:23:18.945 20:28:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:18.945 20:28:50 -- target/shutdown.sh@83 -- # kill -9 3498192 00:23:18.945 20:28:50 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:23:18.945 20:28:50 -- target/shutdown.sh@87 -- # sleep 1 00:23:19.884 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3498192 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:23:19.884 20:28:51 -- target/shutdown.sh@88 -- # kill -0 3497905 00:23:19.884 20:28:51 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:23:19.884 20:28:51 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:23:19.884 20:28:51 -- nvmf/common.sh@520 -- # config=() 00:23:19.884 20:28:51 -- nvmf/common.sh@520 -- # local subsystem config 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 [2024-07-22 20:28:51.731896] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:19.884 [2024-07-22 20:28:51.731948] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3498684 ] 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 20:28:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:19.884 { 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme$subsystem", 00:23:19.884 "trtype": "$TEST_TRANSPORT", 00:23:19.884 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "$NVMF_PORT", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:19.884 "hdgst": ${hdgst:-false}, 00:23:19.884 "ddgst": ${ddgst:-false} 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 } 00:23:19.884 EOF 00:23:19.884 )") 00:23:19.884 20:28:51 -- nvmf/common.sh@542 -- # cat 00:23:19.884 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.884 20:28:51 -- nvmf/common.sh@544 -- # jq . 00:23:19.884 20:28:51 -- nvmf/common.sh@545 -- # IFS=, 00:23:19.884 20:28:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:23:19.884 "params": { 00:23:19.884 "name": "Nvme1", 00:23:19.884 "trtype": "tcp", 00:23:19.884 "traddr": "10.0.0.2", 00:23:19.884 "adrfam": "ipv4", 00:23:19.884 "trsvcid": "4420", 00:23:19.884 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:19.884 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:23:19.884 "hdgst": false, 00:23:19.884 "ddgst": false 00:23:19.884 }, 00:23:19.884 "method": "bdev_nvme_attach_controller" 00:23:19.884 },{ 00:23:19.884 "params": { 00:23:19.885 "name": "Nvme2", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 },{ 00:23:19.885 "params": { 00:23:19.885 "name": "Nvme3", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 },{ 00:23:19.885 "params": { 00:23:19.885 "name": "Nvme4", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 },{ 00:23:19.885 "params": { 00:23:19.885 "name": "Nvme5", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 },{ 00:23:19.885 "params": { 00:23:19.885 "name": "Nvme6", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 },{ 00:23:19.885 "params": { 00:23:19.885 "name": "Nvme7", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 },{ 00:23:19.885 "params": { 00:23:19.885 "name": "Nvme8", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 },{ 00:23:19.885 "params": { 00:23:19.885 "name": "Nvme9", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 },{ 00:23:19.885 "params": { 00:23:19.885 "name": "Nvme10", 00:23:19.885 "trtype": "tcp", 00:23:19.885 "traddr": "10.0.0.2", 00:23:19.885 "adrfam": "ipv4", 00:23:19.885 "trsvcid": "4420", 00:23:19.885 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:23:19.885 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:23:19.885 "hdgst": false, 00:23:19.885 "ddgst": false 00:23:19.885 }, 00:23:19.885 "method": "bdev_nvme_attach_controller" 00:23:19.885 }' 00:23:19.885 [2024-07-22 20:28:51.789217] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:20.144 [2024-07-22 20:28:51.860635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:22.051 Running I/O for 1 seconds... 00:23:22.989 00:23:22.989 Latency(us) 00:23:22.989 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:22.989 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme1n1 : 1.09 483.95 30.25 0.00 0.00 124934.29 15272.74 115799.26 00:23:22.989 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme2n1 : 1.08 446.58 27.91 0.00 0.00 140470.51 15500.69 130388.15 00:23:22.989 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme3n1 : 1.06 490.57 30.66 0.00 0.00 126694.96 17894.18 106225.31 00:23:22.989 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme4n1 : 1.08 527.06 32.94 0.00 0.00 117384.73 2849.39 94827.74 00:23:22.989 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme5n1 : 1.09 443.12 27.70 0.00 0.00 139024.70 12708.29 120358.29 00:23:22.989 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme6n1 : 1.13 499.15 31.20 0.00 0.00 118541.84 12480.33 100298.57 00:23:22.989 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme7n1 : 1.07 414.43 25.90 0.00 0.00 146532.22 10713.71 133123.56 00:23:22.989 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme8n1 : 1.08 447.04 27.94 0.00 0.00 135018.61 15158.76 113519.75 00:23:22.989 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme9n1 : 1.08 404.46 25.28 0.00 0.00 148562.90 14132.98 134035.37 00:23:22.989 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:22.989 Verification LBA range: start 0x0 length 0x400 00:23:22.989 Nvme10n1 : 1.09 527.67 32.98 0.00 0.00 113729.50 7094.98 110328.43 00:23:22.989 =================================================================================================================== 00:23:22.989 Total : 4684.03 292.75 0.00 0.00 129984.08 2849.39 134035.37 00:23:22.989 20:28:54 -- target/shutdown.sh@93 -- # stoptarget 00:23:22.989 20:28:54 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:23:22.989 20:28:54 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:23:22.989 20:28:54 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:23:22.989 20:28:54 -- target/shutdown.sh@45 -- # nvmftestfini 00:23:22.989 20:28:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:22.989 20:28:54 -- nvmf/common.sh@116 -- # sync 00:23:22.989 20:28:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:22.989 20:28:54 -- nvmf/common.sh@119 -- # set +e 00:23:22.989 20:28:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:22.989 20:28:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:22.989 rmmod nvme_tcp 00:23:23.249 rmmod nvme_fabrics 00:23:23.249 rmmod nvme_keyring 00:23:23.249 20:28:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:23.249 20:28:54 -- nvmf/common.sh@123 -- # set -e 00:23:23.249 20:28:54 -- nvmf/common.sh@124 -- # return 0 00:23:23.249 20:28:54 -- nvmf/common.sh@477 -- # '[' -n 3497905 ']' 00:23:23.249 20:28:54 -- nvmf/common.sh@478 -- # killprocess 3497905 00:23:23.250 20:28:54 -- common/autotest_common.sh@926 -- # '[' -z 3497905 ']' 00:23:23.250 20:28:54 -- common/autotest_common.sh@930 -- # kill -0 3497905 00:23:23.250 20:28:54 -- common/autotest_common.sh@931 -- # uname 00:23:23.250 20:28:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:23.250 20:28:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3497905 00:23:23.250 20:28:55 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:23:23.250 20:28:55 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:23:23.250 20:28:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3497905' 00:23:23.250 killing process with pid 3497905 00:23:23.250 20:28:55 -- common/autotest_common.sh@945 -- # kill 3497905 00:23:23.250 20:28:55 -- common/autotest_common.sh@950 -- # wait 3497905 00:23:23.510 20:28:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:23.510 20:28:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:23.510 20:28:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:23.510 20:28:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:23.510 20:28:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:23.510 20:28:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:23.510 20:28:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:23.510 20:28:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:26.051 20:28:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:26.051 00:23:26.051 real 0m14.564s 00:23:26.051 user 0m35.252s 00:23:26.051 sys 0m4.980s 00:23:26.051 20:28:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:26.051 20:28:57 -- common/autotest_common.sh@10 -- # set +x 00:23:26.051 ************************************ 00:23:26.051 END TEST nvmf_shutdown_tc1 00:23:26.051 ************************************ 00:23:26.051 20:28:57 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:23:26.051 20:28:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:23:26.051 20:28:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:26.051 20:28:57 -- common/autotest_common.sh@10 -- # set +x 00:23:26.051 ************************************ 00:23:26.051 START TEST nvmf_shutdown_tc2 00:23:26.051 ************************************ 00:23:26.051 20:28:57 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:23:26.051 20:28:57 -- target/shutdown.sh@98 -- # starttarget 00:23:26.051 20:28:57 -- target/shutdown.sh@15 -- # nvmftestinit 00:23:26.051 20:28:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:26.051 20:28:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:26.051 20:28:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:26.051 20:28:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:26.051 20:28:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:26.051 20:28:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:26.051 20:28:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:26.051 20:28:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:26.051 20:28:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:26.051 20:28:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:26.051 20:28:57 -- common/autotest_common.sh@10 -- # set +x 00:23:26.051 20:28:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:26.051 20:28:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:26.051 20:28:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:26.051 20:28:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:26.051 20:28:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:26.051 20:28:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:26.051 20:28:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:26.051 20:28:57 -- nvmf/common.sh@294 -- # net_devs=() 00:23:26.051 20:28:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:26.051 20:28:57 -- nvmf/common.sh@295 -- # e810=() 00:23:26.051 20:28:57 -- nvmf/common.sh@295 -- # local -ga e810 00:23:26.051 20:28:57 -- nvmf/common.sh@296 -- # x722=() 00:23:26.051 20:28:57 -- nvmf/common.sh@296 -- # local -ga x722 00:23:26.051 20:28:57 -- nvmf/common.sh@297 -- # mlx=() 00:23:26.051 20:28:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:26.051 20:28:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:26.051 20:28:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:26.051 20:28:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:26.051 20:28:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:26.051 20:28:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:26.051 20:28:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:23:26.051 Found 0000:86:00.0 (0x8086 - 0x159b) 00:23:26.051 20:28:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:26.051 20:28:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:23:26.051 Found 0000:86:00.1 (0x8086 - 0x159b) 00:23:26.051 20:28:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:26.051 20:28:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:26.051 20:28:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:26.051 20:28:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:26.051 20:28:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:26.051 20:28:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:23:26.051 Found net devices under 0000:86:00.0: cvl_0_0 00:23:26.051 20:28:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:26.051 20:28:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:26.051 20:28:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:26.051 20:28:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:26.051 20:28:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:26.051 20:28:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:23:26.051 Found net devices under 0000:86:00.1: cvl_0_1 00:23:26.051 20:28:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:26.051 20:28:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:26.051 20:28:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:26.051 20:28:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:26.051 20:28:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:26.051 20:28:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:26.051 20:28:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:26.051 20:28:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:26.051 20:28:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:26.051 20:28:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:26.051 20:28:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:26.051 20:28:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:26.051 20:28:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:26.051 20:28:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:26.051 20:28:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:26.051 20:28:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:26.051 20:28:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:26.051 20:28:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:26.051 20:28:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:26.051 20:28:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:26.051 20:28:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:26.051 20:28:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:26.052 20:28:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:26.052 20:28:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:26.052 20:28:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:26.052 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:26.052 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:23:26.052 00:23:26.052 --- 10.0.0.2 ping statistics --- 00:23:26.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:26.052 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:23:26.052 20:28:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:26.052 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:26.052 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.304 ms 00:23:26.052 00:23:26.052 --- 10.0.0.1 ping statistics --- 00:23:26.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:26.052 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:23:26.052 20:28:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:26.052 20:28:57 -- nvmf/common.sh@410 -- # return 0 00:23:26.052 20:28:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:26.052 20:28:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:26.052 20:28:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:26.052 20:28:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:26.052 20:28:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:26.052 20:28:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:26.052 20:28:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:26.052 20:28:57 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:23:26.052 20:28:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:26.052 20:28:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:26.052 20:28:57 -- common/autotest_common.sh@10 -- # set +x 00:23:26.052 20:28:57 -- nvmf/common.sh@469 -- # nvmfpid=3499726 00:23:26.052 20:28:57 -- nvmf/common.sh@470 -- # waitforlisten 3499726 00:23:26.052 20:28:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:23:26.052 20:28:57 -- common/autotest_common.sh@819 -- # '[' -z 3499726 ']' 00:23:26.052 20:28:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:26.052 20:28:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:26.052 20:28:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:26.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:26.052 20:28:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:26.052 20:28:57 -- common/autotest_common.sh@10 -- # set +x 00:23:26.052 [2024-07-22 20:28:57.881339] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:26.052 [2024-07-22 20:28:57.881384] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:26.052 EAL: No free 2048 kB hugepages reported on node 1 00:23:26.052 [2024-07-22 20:28:57.938624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:26.311 [2024-07-22 20:28:58.017224] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:26.311 [2024-07-22 20:28:58.017327] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:26.311 [2024-07-22 20:28:58.017335] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:26.311 [2024-07-22 20:28:58.017341] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:26.311 [2024-07-22 20:28:58.017433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:26.311 [2024-07-22 20:28:58.017523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:26.311 [2024-07-22 20:28:58.017631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:26.311 [2024-07-22 20:28:58.017633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:23:26.880 20:28:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:26.880 20:28:58 -- common/autotest_common.sh@852 -- # return 0 00:23:26.880 20:28:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:26.880 20:28:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:26.880 20:28:58 -- common/autotest_common.sh@10 -- # set +x 00:23:26.880 20:28:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:26.880 20:28:58 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:26.880 20:28:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:26.880 20:28:58 -- common/autotest_common.sh@10 -- # set +x 00:23:26.880 [2024-07-22 20:28:58.724335] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:26.880 20:28:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:26.880 20:28:58 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:23:26.880 20:28:58 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:23:26.880 20:28:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:26.880 20:28:58 -- common/autotest_common.sh@10 -- # set +x 00:23:26.880 20:28:58 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:26.880 20:28:58 -- target/shutdown.sh@28 -- # cat 00:23:26.880 20:28:58 -- target/shutdown.sh@35 -- # rpc_cmd 00:23:26.880 20:28:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:26.880 20:28:58 -- common/autotest_common.sh@10 -- # set +x 00:23:26.880 Malloc1 00:23:27.139 [2024-07-22 20:28:58.820274] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:27.139 Malloc2 00:23:27.139 Malloc3 00:23:27.139 Malloc4 00:23:27.139 Malloc5 00:23:27.139 Malloc6 00:23:27.139 Malloc7 00:23:27.399 Malloc8 00:23:27.399 Malloc9 00:23:27.399 Malloc10 00:23:27.399 20:28:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:27.399 20:28:59 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:23:27.399 20:28:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:27.399 20:28:59 -- common/autotest_common.sh@10 -- # set +x 00:23:27.399 20:28:59 -- target/shutdown.sh@102 -- # perfpid=3500016 00:23:27.399 20:28:59 -- target/shutdown.sh@103 -- # waitforlisten 3500016 /var/tmp/bdevperf.sock 00:23:27.399 20:28:59 -- common/autotest_common.sh@819 -- # '[' -z 3500016 ']' 00:23:27.399 20:28:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:27.399 20:28:59 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:23:27.399 20:28:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:27.399 20:28:59 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:23:27.399 20:28:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:27.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:27.399 20:28:59 -- nvmf/common.sh@520 -- # config=() 00:23:27.399 20:28:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:27.399 20:28:59 -- nvmf/common.sh@520 -- # local subsystem config 00:23:27.399 20:28:59 -- common/autotest_common.sh@10 -- # set +x 00:23:27.399 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.399 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.399 { 00:23:27.399 "params": { 00:23:27.399 "name": "Nvme$subsystem", 00:23:27.399 "trtype": "$TEST_TRANSPORT", 00:23:27.399 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.399 "adrfam": "ipv4", 00:23:27.399 "trsvcid": "$NVMF_PORT", 00:23:27.399 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.399 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.399 "hdgst": ${hdgst:-false}, 00:23:27.399 "ddgst": ${ddgst:-false} 00:23:27.399 }, 00:23:27.399 "method": "bdev_nvme_attach_controller" 00:23:27.399 } 00:23:27.399 EOF 00:23:27.399 )") 00:23:27.399 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.399 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.399 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.399 { 00:23:27.399 "params": { 00:23:27.399 "name": "Nvme$subsystem", 00:23:27.399 "trtype": "$TEST_TRANSPORT", 00:23:27.399 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.399 "adrfam": "ipv4", 00:23:27.399 "trsvcid": "$NVMF_PORT", 00:23:27.399 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.399 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.399 "hdgst": ${hdgst:-false}, 00:23:27.399 "ddgst": ${ddgst:-false} 00:23:27.399 }, 00:23:27.399 "method": "bdev_nvme_attach_controller" 00:23:27.399 } 00:23:27.399 EOF 00:23:27.399 )") 00:23:27.399 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.399 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.399 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.399 { 00:23:27.399 "params": { 00:23:27.399 "name": "Nvme$subsystem", 00:23:27.399 "trtype": "$TEST_TRANSPORT", 00:23:27.399 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.399 "adrfam": "ipv4", 00:23:27.399 "trsvcid": "$NVMF_PORT", 00:23:27.399 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.399 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.399 "hdgst": ${hdgst:-false}, 00:23:27.399 "ddgst": ${ddgst:-false} 00:23:27.399 }, 00:23:27.399 "method": "bdev_nvme_attach_controller" 00:23:27.399 } 00:23:27.399 EOF 00:23:27.399 )") 00:23:27.399 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.399 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.399 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.399 { 00:23:27.399 "params": { 00:23:27.399 "name": "Nvme$subsystem", 00:23:27.399 "trtype": "$TEST_TRANSPORT", 00:23:27.399 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.399 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "$NVMF_PORT", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.400 "hdgst": ${hdgst:-false}, 00:23:27.400 "ddgst": ${ddgst:-false} 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 } 00:23:27.400 EOF 00:23:27.400 )") 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.400 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.400 { 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme$subsystem", 00:23:27.400 "trtype": "$TEST_TRANSPORT", 00:23:27.400 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "$NVMF_PORT", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.400 "hdgst": ${hdgst:-false}, 00:23:27.400 "ddgst": ${ddgst:-false} 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 } 00:23:27.400 EOF 00:23:27.400 )") 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.400 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.400 { 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme$subsystem", 00:23:27.400 "trtype": "$TEST_TRANSPORT", 00:23:27.400 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "$NVMF_PORT", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.400 "hdgst": ${hdgst:-false}, 00:23:27.400 "ddgst": ${ddgst:-false} 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 } 00:23:27.400 EOF 00:23:27.400 )") 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.400 [2024-07-22 20:28:59.282968] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:27.400 [2024-07-22 20:28:59.283015] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3500016 ] 00:23:27.400 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.400 { 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme$subsystem", 00:23:27.400 "trtype": "$TEST_TRANSPORT", 00:23:27.400 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "$NVMF_PORT", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.400 "hdgst": ${hdgst:-false}, 00:23:27.400 "ddgst": ${ddgst:-false} 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 } 00:23:27.400 EOF 00:23:27.400 )") 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.400 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.400 { 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme$subsystem", 00:23:27.400 "trtype": "$TEST_TRANSPORT", 00:23:27.400 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "$NVMF_PORT", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.400 "hdgst": ${hdgst:-false}, 00:23:27.400 "ddgst": ${ddgst:-false} 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 } 00:23:27.400 EOF 00:23:27.400 )") 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.400 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.400 { 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme$subsystem", 00:23:27.400 "trtype": "$TEST_TRANSPORT", 00:23:27.400 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "$NVMF_PORT", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.400 "hdgst": ${hdgst:-false}, 00:23:27.400 "ddgst": ${ddgst:-false} 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 } 00:23:27.400 EOF 00:23:27.400 )") 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.400 20:28:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:27.400 { 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme$subsystem", 00:23:27.400 "trtype": "$TEST_TRANSPORT", 00:23:27.400 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "$NVMF_PORT", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:27.400 "hdgst": ${hdgst:-false}, 00:23:27.400 "ddgst": ${ddgst:-false} 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 } 00:23:27.400 EOF 00:23:27.400 )") 00:23:27.400 EAL: No free 2048 kB hugepages reported on node 1 00:23:27.400 20:28:59 -- nvmf/common.sh@542 -- # cat 00:23:27.400 20:28:59 -- nvmf/common.sh@544 -- # jq . 00:23:27.400 20:28:59 -- nvmf/common.sh@545 -- # IFS=, 00:23:27.400 20:28:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme1", 00:23:27.400 "trtype": "tcp", 00:23:27.400 "traddr": "10.0.0.2", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "4420", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:23:27.400 "hdgst": false, 00:23:27.400 "ddgst": false 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 },{ 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme2", 00:23:27.400 "trtype": "tcp", 00:23:27.400 "traddr": "10.0.0.2", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "4420", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:23:27.400 "hdgst": false, 00:23:27.400 "ddgst": false 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 },{ 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme3", 00:23:27.400 "trtype": "tcp", 00:23:27.400 "traddr": "10.0.0.2", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "4420", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:23:27.400 "hdgst": false, 00:23:27.400 "ddgst": false 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 },{ 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme4", 00:23:27.400 "trtype": "tcp", 00:23:27.400 "traddr": "10.0.0.2", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "4420", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:23:27.400 "hdgst": false, 00:23:27.400 "ddgst": false 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 },{ 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme5", 00:23:27.400 "trtype": "tcp", 00:23:27.400 "traddr": "10.0.0.2", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "4420", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:23:27.400 "hdgst": false, 00:23:27.400 "ddgst": false 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 },{ 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme6", 00:23:27.400 "trtype": "tcp", 00:23:27.400 "traddr": "10.0.0.2", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "4420", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:23:27.400 "hdgst": false, 00:23:27.400 "ddgst": false 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 },{ 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme7", 00:23:27.400 "trtype": "tcp", 00:23:27.400 "traddr": "10.0.0.2", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "4420", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:23:27.400 "hdgst": false, 00:23:27.400 "ddgst": false 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 },{ 00:23:27.400 "params": { 00:23:27.400 "name": "Nvme8", 00:23:27.400 "trtype": "tcp", 00:23:27.400 "traddr": "10.0.0.2", 00:23:27.400 "adrfam": "ipv4", 00:23:27.400 "trsvcid": "4420", 00:23:27.400 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:23:27.400 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:23:27.400 "hdgst": false, 00:23:27.400 "ddgst": false 00:23:27.400 }, 00:23:27.400 "method": "bdev_nvme_attach_controller" 00:23:27.400 },{ 00:23:27.401 "params": { 00:23:27.401 "name": "Nvme9", 00:23:27.401 "trtype": "tcp", 00:23:27.401 "traddr": "10.0.0.2", 00:23:27.401 "adrfam": "ipv4", 00:23:27.401 "trsvcid": "4420", 00:23:27.401 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:23:27.401 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:23:27.401 "hdgst": false, 00:23:27.401 "ddgst": false 00:23:27.401 }, 00:23:27.401 "method": "bdev_nvme_attach_controller" 00:23:27.401 },{ 00:23:27.401 "params": { 00:23:27.401 "name": "Nvme10", 00:23:27.401 "trtype": "tcp", 00:23:27.401 "traddr": "10.0.0.2", 00:23:27.401 "adrfam": "ipv4", 00:23:27.401 "trsvcid": "4420", 00:23:27.401 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:23:27.401 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:23:27.401 "hdgst": false, 00:23:27.401 "ddgst": false 00:23:27.401 }, 00:23:27.401 "method": "bdev_nvme_attach_controller" 00:23:27.401 }' 00:23:27.660 [2024-07-22 20:28:59.337599] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:27.660 [2024-07-22 20:28:59.408444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:29.093 Running I/O for 10 seconds... 00:23:29.663 20:29:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:29.663 20:29:01 -- common/autotest_common.sh@852 -- # return 0 00:23:29.663 20:29:01 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:23:29.663 20:29:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:29.663 20:29:01 -- common/autotest_common.sh@10 -- # set +x 00:23:29.663 20:29:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:29.663 20:29:01 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:23:29.663 20:29:01 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:23:29.663 20:29:01 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:23:29.663 20:29:01 -- target/shutdown.sh@57 -- # local ret=1 00:23:29.663 20:29:01 -- target/shutdown.sh@58 -- # local i 00:23:29.663 20:29:01 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:23:29.663 20:29:01 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:23:29.663 20:29:01 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:23:29.663 20:29:01 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:23:29.663 20:29:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:29.663 20:29:01 -- common/autotest_common.sh@10 -- # set +x 00:23:29.663 20:29:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:29.663 20:29:01 -- target/shutdown.sh@60 -- # read_io_count=211 00:23:29.663 20:29:01 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:23:29.663 20:29:01 -- target/shutdown.sh@64 -- # ret=0 00:23:29.663 20:29:01 -- target/shutdown.sh@65 -- # break 00:23:29.663 20:29:01 -- target/shutdown.sh@69 -- # return 0 00:23:29.663 20:29:01 -- target/shutdown.sh@109 -- # killprocess 3500016 00:23:29.663 20:29:01 -- common/autotest_common.sh@926 -- # '[' -z 3500016 ']' 00:23:29.663 20:29:01 -- common/autotest_common.sh@930 -- # kill -0 3500016 00:23:29.663 20:29:01 -- common/autotest_common.sh@931 -- # uname 00:23:29.663 20:29:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:29.663 20:29:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3500016 00:23:29.663 20:29:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:29.663 20:29:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:29.663 20:29:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3500016' 00:23:29.663 killing process with pid 3500016 00:23:29.663 20:29:01 -- common/autotest_common.sh@945 -- # kill 3500016 00:23:29.663 20:29:01 -- common/autotest_common.sh@950 -- # wait 3500016 00:23:29.924 Received shutdown signal, test time was about 0.700579 seconds 00:23:29.924 00:23:29.924 Latency(us) 00:23:29.924 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:29.924 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme1n1 : 0.66 474.06 29.63 0.00 0.00 131506.92 17324.30 114887.46 00:23:29.924 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme2n1 : 0.68 514.83 32.18 0.00 0.00 120675.77 10656.72 104857.60 00:23:29.924 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme3n1 : 0.70 450.06 28.13 0.00 0.00 128394.84 18578.03 99842.67 00:23:29.924 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme4n1 : 0.68 523.53 32.72 0.00 0.00 115866.85 15614.66 95283.65 00:23:29.924 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme5n1 : 0.66 414.30 25.89 0.00 0.00 144259.33 6154.69 125829.12 00:23:29.924 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme6n1 : 0.67 471.28 29.45 0.00 0.00 125914.15 18464.06 105769.41 00:23:29.924 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme7n1 : 0.67 469.25 29.33 0.00 0.00 125064.58 18464.06 98930.87 00:23:29.924 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme8n1 : 0.67 467.19 29.20 0.00 0.00 124273.26 19261.89 104401.70 00:23:29.924 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme9n1 : 0.68 468.32 29.27 0.00 0.00 123479.58 9630.94 108960.72 00:23:29.924 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:29.924 Verification LBA range: start 0x0 length 0x400 00:23:29.924 Nvme10n1 : 0.68 466.02 29.13 0.00 0.00 122054.90 17210.32 101666.28 00:23:29.924 =================================================================================================================== 00:23:29.924 Total : 4718.85 294.93 0.00 0.00 125720.49 6154.69 125829.12 00:23:29.924 20:29:01 -- target/shutdown.sh@112 -- # sleep 1 00:23:31.312 20:29:02 -- target/shutdown.sh@113 -- # kill -0 3499726 00:23:31.312 20:29:02 -- target/shutdown.sh@115 -- # stoptarget 00:23:31.312 20:29:02 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:23:31.312 20:29:02 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:23:31.312 20:29:02 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:23:31.312 20:29:02 -- target/shutdown.sh@45 -- # nvmftestfini 00:23:31.312 20:29:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:31.312 20:29:02 -- nvmf/common.sh@116 -- # sync 00:23:31.312 20:29:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:31.312 20:29:02 -- nvmf/common.sh@119 -- # set +e 00:23:31.312 20:29:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:31.312 20:29:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:31.312 rmmod nvme_tcp 00:23:31.312 rmmod nvme_fabrics 00:23:31.312 rmmod nvme_keyring 00:23:31.312 20:29:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:31.312 20:29:02 -- nvmf/common.sh@123 -- # set -e 00:23:31.312 20:29:02 -- nvmf/common.sh@124 -- # return 0 00:23:31.312 20:29:02 -- nvmf/common.sh@477 -- # '[' -n 3499726 ']' 00:23:31.312 20:29:02 -- nvmf/common.sh@478 -- # killprocess 3499726 00:23:31.312 20:29:02 -- common/autotest_common.sh@926 -- # '[' -z 3499726 ']' 00:23:31.312 20:29:02 -- common/autotest_common.sh@930 -- # kill -0 3499726 00:23:31.312 20:29:02 -- common/autotest_common.sh@931 -- # uname 00:23:31.312 20:29:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:31.312 20:29:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3499726 00:23:31.312 20:29:02 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:23:31.312 20:29:02 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:23:31.312 20:29:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3499726' 00:23:31.312 killing process with pid 3499726 00:23:31.312 20:29:02 -- common/autotest_common.sh@945 -- # kill 3499726 00:23:31.312 20:29:02 -- common/autotest_common.sh@950 -- # wait 3499726 00:23:31.571 20:29:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:31.571 20:29:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:31.571 20:29:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:31.571 20:29:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:31.571 20:29:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:31.571 20:29:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:31.571 20:29:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:31.571 20:29:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:34.109 20:29:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:34.109 00:23:34.109 real 0m7.898s 00:23:34.109 user 0m24.063s 00:23:34.109 sys 0m1.301s 00:23:34.109 20:29:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:34.109 20:29:05 -- common/autotest_common.sh@10 -- # set +x 00:23:34.109 ************************************ 00:23:34.109 END TEST nvmf_shutdown_tc2 00:23:34.109 ************************************ 00:23:34.109 20:29:05 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:23:34.109 20:29:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:23:34.109 20:29:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:34.109 20:29:05 -- common/autotest_common.sh@10 -- # set +x 00:23:34.109 ************************************ 00:23:34.109 START TEST nvmf_shutdown_tc3 00:23:34.109 ************************************ 00:23:34.109 20:29:05 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:23:34.109 20:29:05 -- target/shutdown.sh@120 -- # starttarget 00:23:34.109 20:29:05 -- target/shutdown.sh@15 -- # nvmftestinit 00:23:34.109 20:29:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:34.110 20:29:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:34.110 20:29:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:34.110 20:29:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:34.110 20:29:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:34.110 20:29:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:34.110 20:29:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:34.110 20:29:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:34.110 20:29:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:34.110 20:29:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:34.110 20:29:05 -- common/autotest_common.sh@10 -- # set +x 00:23:34.110 20:29:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:34.110 20:29:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:34.110 20:29:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:34.110 20:29:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:34.110 20:29:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:34.110 20:29:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:34.110 20:29:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:34.110 20:29:05 -- nvmf/common.sh@294 -- # net_devs=() 00:23:34.110 20:29:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:34.110 20:29:05 -- nvmf/common.sh@295 -- # e810=() 00:23:34.110 20:29:05 -- nvmf/common.sh@295 -- # local -ga e810 00:23:34.110 20:29:05 -- nvmf/common.sh@296 -- # x722=() 00:23:34.110 20:29:05 -- nvmf/common.sh@296 -- # local -ga x722 00:23:34.110 20:29:05 -- nvmf/common.sh@297 -- # mlx=() 00:23:34.110 20:29:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:34.110 20:29:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:34.110 20:29:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:34.110 20:29:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:34.110 20:29:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:34.110 20:29:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:34.110 20:29:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:23:34.110 Found 0000:86:00.0 (0x8086 - 0x159b) 00:23:34.110 20:29:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:34.110 20:29:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:23:34.110 Found 0000:86:00.1 (0x8086 - 0x159b) 00:23:34.110 20:29:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:34.110 20:29:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:34.110 20:29:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:34.110 20:29:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:34.110 20:29:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:34.110 20:29:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:23:34.110 Found net devices under 0000:86:00.0: cvl_0_0 00:23:34.110 20:29:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:34.110 20:29:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:34.110 20:29:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:34.110 20:29:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:34.110 20:29:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:34.110 20:29:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:23:34.110 Found net devices under 0000:86:00.1: cvl_0_1 00:23:34.110 20:29:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:34.110 20:29:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:34.110 20:29:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:34.110 20:29:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:34.110 20:29:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:34.110 20:29:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:34.110 20:29:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:34.110 20:29:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:34.110 20:29:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:34.110 20:29:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:34.110 20:29:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:34.110 20:29:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:34.110 20:29:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:34.110 20:29:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:34.110 20:29:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:34.110 20:29:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:34.110 20:29:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:34.110 20:29:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:34.110 20:29:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:34.110 20:29:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:34.110 20:29:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:34.110 20:29:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:34.110 20:29:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:34.110 20:29:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:34.110 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:34.110 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.151 ms 00:23:34.110 00:23:34.110 --- 10.0.0.2 ping statistics --- 00:23:34.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:34.110 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:23:34.110 20:29:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:34.110 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:34.110 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.218 ms 00:23:34.110 00:23:34.110 --- 10.0.0.1 ping statistics --- 00:23:34.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:34.110 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:23:34.110 20:29:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:34.110 20:29:05 -- nvmf/common.sh@410 -- # return 0 00:23:34.110 20:29:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:34.110 20:29:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:34.110 20:29:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:34.110 20:29:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:34.110 20:29:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:34.110 20:29:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:34.110 20:29:05 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:23:34.110 20:29:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:34.110 20:29:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:34.110 20:29:05 -- common/autotest_common.sh@10 -- # set +x 00:23:34.110 20:29:05 -- nvmf/common.sh@469 -- # nvmfpid=3501297 00:23:34.110 20:29:05 -- nvmf/common.sh@470 -- # waitforlisten 3501297 00:23:34.110 20:29:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:23:34.110 20:29:05 -- common/autotest_common.sh@819 -- # '[' -z 3501297 ']' 00:23:34.110 20:29:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:34.110 20:29:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:34.110 20:29:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:34.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:34.110 20:29:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:34.110 20:29:05 -- common/autotest_common.sh@10 -- # set +x 00:23:34.110 [2024-07-22 20:29:05.816250] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:34.110 [2024-07-22 20:29:05.816303] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:34.110 EAL: No free 2048 kB hugepages reported on node 1 00:23:34.110 [2024-07-22 20:29:05.874016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:34.110 [2024-07-22 20:29:05.950744] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:34.110 [2024-07-22 20:29:05.950852] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:34.110 [2024-07-22 20:29:05.950860] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:34.110 [2024-07-22 20:29:05.950866] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:34.111 [2024-07-22 20:29:05.950968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:34.111 [2024-07-22 20:29:05.951088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:34.111 [2024-07-22 20:29:05.951197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:23:34.111 [2024-07-22 20:29:05.951203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:34.679 20:29:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:34.679 20:29:06 -- common/autotest_common.sh@852 -- # return 0 00:23:34.679 20:29:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:34.679 20:29:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:34.679 20:29:06 -- common/autotest_common.sh@10 -- # set +x 00:23:34.939 20:29:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:34.939 20:29:06 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:34.939 20:29:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:34.939 20:29:06 -- common/autotest_common.sh@10 -- # set +x 00:23:34.939 [2024-07-22 20:29:06.658363] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:34.939 20:29:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:34.939 20:29:06 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:23:34.939 20:29:06 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:23:34.939 20:29:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:34.939 20:29:06 -- common/autotest_common.sh@10 -- # set +x 00:23:34.939 20:29:06 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:23:34.939 20:29:06 -- target/shutdown.sh@28 -- # cat 00:23:34.939 20:29:06 -- target/shutdown.sh@35 -- # rpc_cmd 00:23:34.939 20:29:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:34.939 20:29:06 -- common/autotest_common.sh@10 -- # set +x 00:23:34.939 Malloc1 00:23:34.939 [2024-07-22 20:29:06.754404] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:34.939 Malloc2 00:23:34.939 Malloc3 00:23:34.939 Malloc4 00:23:35.199 Malloc5 00:23:35.199 Malloc6 00:23:35.199 Malloc7 00:23:35.199 Malloc8 00:23:35.199 Malloc9 00:23:35.199 Malloc10 00:23:35.459 20:29:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:35.459 20:29:07 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:23:35.459 20:29:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:35.459 20:29:07 -- common/autotest_common.sh@10 -- # set +x 00:23:35.459 20:29:07 -- target/shutdown.sh@124 -- # perfpid=3501575 00:23:35.459 20:29:07 -- target/shutdown.sh@125 -- # waitforlisten 3501575 /var/tmp/bdevperf.sock 00:23:35.459 20:29:07 -- common/autotest_common.sh@819 -- # '[' -z 3501575 ']' 00:23:35.459 20:29:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:35.459 20:29:07 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:23:35.459 20:29:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:35.459 20:29:07 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:23:35.459 20:29:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:35.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:35.459 20:29:07 -- nvmf/common.sh@520 -- # config=() 00:23:35.459 20:29:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:35.459 20:29:07 -- nvmf/common.sh@520 -- # local subsystem config 00:23:35.459 20:29:07 -- common/autotest_common.sh@10 -- # set +x 00:23:35.459 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.459 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.459 { 00:23:35.459 "params": { 00:23:35.459 "name": "Nvme$subsystem", 00:23:35.459 "trtype": "$TEST_TRANSPORT", 00:23:35.459 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.459 "adrfam": "ipv4", 00:23:35.459 "trsvcid": "$NVMF_PORT", 00:23:35.459 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.459 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.459 "hdgst": ${hdgst:-false}, 00:23:35.459 "ddgst": ${ddgst:-false} 00:23:35.459 }, 00:23:35.459 "method": "bdev_nvme_attach_controller" 00:23:35.459 } 00:23:35.459 EOF 00:23:35.459 )") 00:23:35.459 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.459 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.459 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.459 { 00:23:35.459 "params": { 00:23:35.459 "name": "Nvme$subsystem", 00:23:35.459 "trtype": "$TEST_TRANSPORT", 00:23:35.459 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.459 "adrfam": "ipv4", 00:23:35.459 "trsvcid": "$NVMF_PORT", 00:23:35.459 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.459 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.459 "hdgst": ${hdgst:-false}, 00:23:35.459 "ddgst": ${ddgst:-false} 00:23:35.459 }, 00:23:35.459 "method": "bdev_nvme_attach_controller" 00:23:35.459 } 00:23:35.459 EOF 00:23:35.459 )") 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.460 { 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme$subsystem", 00:23:35.460 "trtype": "$TEST_TRANSPORT", 00:23:35.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "$NVMF_PORT", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.460 "hdgst": ${hdgst:-false}, 00:23:35.460 "ddgst": ${ddgst:-false} 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 } 00:23:35.460 EOF 00:23:35.460 )") 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.460 { 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme$subsystem", 00:23:35.460 "trtype": "$TEST_TRANSPORT", 00:23:35.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "$NVMF_PORT", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.460 "hdgst": ${hdgst:-false}, 00:23:35.460 "ddgst": ${ddgst:-false} 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 } 00:23:35.460 EOF 00:23:35.460 )") 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.460 { 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme$subsystem", 00:23:35.460 "trtype": "$TEST_TRANSPORT", 00:23:35.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "$NVMF_PORT", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.460 "hdgst": ${hdgst:-false}, 00:23:35.460 "ddgst": ${ddgst:-false} 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 } 00:23:35.460 EOF 00:23:35.460 )") 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.460 { 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme$subsystem", 00:23:35.460 "trtype": "$TEST_TRANSPORT", 00:23:35.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "$NVMF_PORT", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.460 "hdgst": ${hdgst:-false}, 00:23:35.460 "ddgst": ${ddgst:-false} 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 } 00:23:35.460 EOF 00:23:35.460 )") 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 [2024-07-22 20:29:07.217386] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:35.460 [2024-07-22 20:29:07.217435] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3501575 ] 00:23:35.460 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.460 { 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme$subsystem", 00:23:35.460 "trtype": "$TEST_TRANSPORT", 00:23:35.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "$NVMF_PORT", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.460 "hdgst": ${hdgst:-false}, 00:23:35.460 "ddgst": ${ddgst:-false} 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 } 00:23:35.460 EOF 00:23:35.460 )") 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.460 { 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme$subsystem", 00:23:35.460 "trtype": "$TEST_TRANSPORT", 00:23:35.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "$NVMF_PORT", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.460 "hdgst": ${hdgst:-false}, 00:23:35.460 "ddgst": ${ddgst:-false} 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 } 00:23:35.460 EOF 00:23:35.460 )") 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.460 { 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme$subsystem", 00:23:35.460 "trtype": "$TEST_TRANSPORT", 00:23:35.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "$NVMF_PORT", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.460 "hdgst": ${hdgst:-false}, 00:23:35.460 "ddgst": ${ddgst:-false} 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 } 00:23:35.460 EOF 00:23:35.460 )") 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 20:29:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:23:35.460 { 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme$subsystem", 00:23:35.460 "trtype": "$TEST_TRANSPORT", 00:23:35.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "$NVMF_PORT", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:23:35.460 "hdgst": ${hdgst:-false}, 00:23:35.460 "ddgst": ${ddgst:-false} 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 } 00:23:35.460 EOF 00:23:35.460 )") 00:23:35.460 EAL: No free 2048 kB hugepages reported on node 1 00:23:35.460 20:29:07 -- nvmf/common.sh@542 -- # cat 00:23:35.460 20:29:07 -- nvmf/common.sh@544 -- # jq . 00:23:35.460 20:29:07 -- nvmf/common.sh@545 -- # IFS=, 00:23:35.460 20:29:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme1", 00:23:35.460 "trtype": "tcp", 00:23:35.460 "traddr": "10.0.0.2", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "4420", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:23:35.460 "hdgst": false, 00:23:35.460 "ddgst": false 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 },{ 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme2", 00:23:35.460 "trtype": "tcp", 00:23:35.460 "traddr": "10.0.0.2", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "4420", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:23:35.460 "hdgst": false, 00:23:35.460 "ddgst": false 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 },{ 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme3", 00:23:35.460 "trtype": "tcp", 00:23:35.460 "traddr": "10.0.0.2", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "4420", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:23:35.460 "hdgst": false, 00:23:35.460 "ddgst": false 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 },{ 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme4", 00:23:35.460 "trtype": "tcp", 00:23:35.460 "traddr": "10.0.0.2", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "4420", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:23:35.460 "hdgst": false, 00:23:35.460 "ddgst": false 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 },{ 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme5", 00:23:35.460 "trtype": "tcp", 00:23:35.460 "traddr": "10.0.0.2", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "4420", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:23:35.460 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:23:35.460 "hdgst": false, 00:23:35.460 "ddgst": false 00:23:35.460 }, 00:23:35.460 "method": "bdev_nvme_attach_controller" 00:23:35.460 },{ 00:23:35.460 "params": { 00:23:35.460 "name": "Nvme6", 00:23:35.460 "trtype": "tcp", 00:23:35.460 "traddr": "10.0.0.2", 00:23:35.460 "adrfam": "ipv4", 00:23:35.460 "trsvcid": "4420", 00:23:35.460 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:23:35.461 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:23:35.461 "hdgst": false, 00:23:35.461 "ddgst": false 00:23:35.461 }, 00:23:35.461 "method": "bdev_nvme_attach_controller" 00:23:35.461 },{ 00:23:35.461 "params": { 00:23:35.461 "name": "Nvme7", 00:23:35.461 "trtype": "tcp", 00:23:35.461 "traddr": "10.0.0.2", 00:23:35.461 "adrfam": "ipv4", 00:23:35.461 "trsvcid": "4420", 00:23:35.461 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:23:35.461 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:23:35.461 "hdgst": false, 00:23:35.461 "ddgst": false 00:23:35.461 }, 00:23:35.461 "method": "bdev_nvme_attach_controller" 00:23:35.461 },{ 00:23:35.461 "params": { 00:23:35.461 "name": "Nvme8", 00:23:35.461 "trtype": "tcp", 00:23:35.461 "traddr": "10.0.0.2", 00:23:35.461 "adrfam": "ipv4", 00:23:35.461 "trsvcid": "4420", 00:23:35.461 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:23:35.461 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:23:35.461 "hdgst": false, 00:23:35.461 "ddgst": false 00:23:35.461 }, 00:23:35.461 "method": "bdev_nvme_attach_controller" 00:23:35.461 },{ 00:23:35.461 "params": { 00:23:35.461 "name": "Nvme9", 00:23:35.461 "trtype": "tcp", 00:23:35.461 "traddr": "10.0.0.2", 00:23:35.461 "adrfam": "ipv4", 00:23:35.461 "trsvcid": "4420", 00:23:35.461 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:23:35.461 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:23:35.461 "hdgst": false, 00:23:35.461 "ddgst": false 00:23:35.461 }, 00:23:35.461 "method": "bdev_nvme_attach_controller" 00:23:35.461 },{ 00:23:35.461 "params": { 00:23:35.461 "name": "Nvme10", 00:23:35.461 "trtype": "tcp", 00:23:35.461 "traddr": "10.0.0.2", 00:23:35.461 "adrfam": "ipv4", 00:23:35.461 "trsvcid": "4420", 00:23:35.461 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:23:35.461 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:23:35.461 "hdgst": false, 00:23:35.461 "ddgst": false 00:23:35.461 }, 00:23:35.461 "method": "bdev_nvme_attach_controller" 00:23:35.461 }' 00:23:35.461 [2024-07-22 20:29:07.273470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:35.461 [2024-07-22 20:29:07.344985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:36.839 Running I/O for 10 seconds... 00:23:36.839 20:29:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:36.839 20:29:08 -- common/autotest_common.sh@852 -- # return 0 00:23:36.840 20:29:08 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:23:36.840 20:29:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:36.840 20:29:08 -- common/autotest_common.sh@10 -- # set +x 00:23:36.840 20:29:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:36.840 20:29:08 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:36.840 20:29:08 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:23:36.840 20:29:08 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:23:36.840 20:29:08 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:23:36.840 20:29:08 -- target/shutdown.sh@57 -- # local ret=1 00:23:36.840 20:29:08 -- target/shutdown.sh@58 -- # local i 00:23:36.840 20:29:08 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:23:36.840 20:29:08 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:23:36.840 20:29:08 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:23:36.840 20:29:08 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:23:36.840 20:29:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:36.840 20:29:08 -- common/autotest_common.sh@10 -- # set +x 00:23:37.099 20:29:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:37.099 20:29:08 -- target/shutdown.sh@60 -- # read_io_count=3 00:23:37.099 20:29:08 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:23:37.099 20:29:08 -- target/shutdown.sh@67 -- # sleep 0.25 00:23:37.377 20:29:09 -- target/shutdown.sh@59 -- # (( i-- )) 00:23:37.377 20:29:09 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:23:37.377 20:29:09 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:23:37.377 20:29:09 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:23:37.377 20:29:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:37.377 20:29:09 -- common/autotest_common.sh@10 -- # set +x 00:23:37.377 20:29:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:37.377 20:29:09 -- target/shutdown.sh@60 -- # read_io_count=129 00:23:37.377 20:29:09 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:23:37.377 20:29:09 -- target/shutdown.sh@64 -- # ret=0 00:23:37.377 20:29:09 -- target/shutdown.sh@65 -- # break 00:23:37.377 20:29:09 -- target/shutdown.sh@69 -- # return 0 00:23:37.377 20:29:09 -- target/shutdown.sh@134 -- # killprocess 3501297 00:23:37.377 20:29:09 -- common/autotest_common.sh@926 -- # '[' -z 3501297 ']' 00:23:37.377 20:29:09 -- common/autotest_common.sh@930 -- # kill -0 3501297 00:23:37.377 20:29:09 -- common/autotest_common.sh@931 -- # uname 00:23:37.377 20:29:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:37.377 20:29:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3501297 00:23:37.377 20:29:09 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:23:37.377 20:29:09 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:23:37.377 20:29:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3501297' 00:23:37.377 killing process with pid 3501297 00:23:37.377 20:29:09 -- common/autotest_common.sh@945 -- # kill 3501297 00:23:37.377 20:29:09 -- common/autotest_common.sh@950 -- # wait 3501297 00:23:37.377 [2024-07-22 20:29:09.163415] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163498] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163505] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163511] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163530] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163536] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163550] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163556] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163574] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163580] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163586] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163592] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163599] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163605] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163616] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163622] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163628] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163634] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163647] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163653] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163660] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163667] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163673] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163679] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163685] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163691] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163705] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163712] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163725] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163731] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163737] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163745] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.377 [2024-07-22 20:29:09.163752] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163759] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163765] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163772] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163779] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163785] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163791] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163798] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163812] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163818] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163831] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163837] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163849] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163855] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163861] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163868] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163874] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163880] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.163887] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1430 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165438] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165475] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165482] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165499] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165512] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165519] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165525] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165531] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165564] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165571] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165577] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165583] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165589] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165601] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165608] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165614] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165620] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165626] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165632] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165638] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165657] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165665] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165671] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165679] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165685] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165691] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165697] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165710] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165717] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165723] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165729] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165736] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165744] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165750] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165756] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165769] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165776] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165782] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165789] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165795] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165800] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165807] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165813] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.165820] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3de0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.166928] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e18e0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.166939] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e18e0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.166948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e18e0 is same with the state(5) to be set 00:23:37.378 [2024-07-22 20:29:09.168168] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168193] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168214] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168220] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168226] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168238] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168251] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168257] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168264] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168278] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168291] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168298] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168304] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168316] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168322] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168335] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168348] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168358] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168371] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168377] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168383] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168396] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168409] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168417] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168423] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168429] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168442] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168448] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168460] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168467] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168472] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168478] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168484] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168496] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168508] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168528] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168535] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168558] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168564] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168577] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168582] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.168588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e1d90 is same with the state(5) to be set 00:23:37.379 [2024-07-22 20:29:09.169333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.379 [2024-07-22 20:29:09.169381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.379 [2024-07-22 20:29:09.169406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.379 [2024-07-22 20:29:09.169422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.379 [2024-07-22 20:29:09.169437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.379 [2024-07-22 20:29:09.169453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.379 [2024-07-22 20:29:09.169468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.379 [2024-07-22 20:29:09.169484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.379 [2024-07-22 20:29:09.169503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.379 [2024-07-22 20:29:09.169510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27520 len:12[2024-07-22 20:29:09.169712] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169738] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169746] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169754] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169769] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with [2024-07-22 20:29:09.169777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27904 len:12the state(5) to be set 00:23:37.380 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169786] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with [2024-07-22 20:29:09.169787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:23:37.380 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169803] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169811] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169818] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169829] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169837] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169844] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169852] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169859] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31872 len:1[2024-07-22 20:29:09.169867] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.169876] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169885] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169891] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.169914] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.380 [2024-07-22 20:29:09.169933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.380 [2024-07-22 20:29:09.169934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.380 [2024-07-22 20:29:09.169941] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.169945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.169948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.169952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.169955] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.169962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:32512 len:1[2024-07-22 20:29:09.169963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.169971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.169972] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.169982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.169983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.169990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.169992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.169999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:32768 len:1[2024-07-22 20:29:09.170000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.170009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170020] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with [2024-07-22 20:29:09.170021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:32896 len:1the state(5) to be set 00:23:37.381 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170029] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170037] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170049] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33152 len:12[2024-07-22 20:29:09.170066] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.170077] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170086] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170100] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170107] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with [2024-07-22 20:29:09.170122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:12the state(5) to be set 00:23:37.381 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170130] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with [2024-07-22 20:29:09.170131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:23:37.381 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170148] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170162] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33920 len:1[2024-07-22 20:29:09.170178] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with [2024-07-22 20:29:09.170187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:23:37.381 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170196] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170203] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170210] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34176 len:12[2024-07-22 20:29:09.170218] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170233] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.381 [2024-07-22 20:29:09.170240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2220 is same with the state(5) to be set 00:23:37.381 [2024-07-22 20:29:09.170245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.381 [2024-07-22 20:29:09.170254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.382 [2024-07-22 20:29:09.170458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.382 [2024-07-22 20:29:09.170872] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x21fd6d0 was disconnected and freed. reset controller. 00:23:37.382 [2024-07-22 20:29:09.171000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171035] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171047] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171091] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171105] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171118] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171124] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171130] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171135] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171148] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171154] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171160] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171166] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171172] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171178] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171184] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171193] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171206] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171213] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171225] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171233] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171246] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171253] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171259] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171266] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171272] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171278] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.382 [2024-07-22 20:29:09.171290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171296] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171303] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171309] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171327] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171346] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171358] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171364] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171371] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171377] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171383] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171405] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.171425] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e26d0 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172470] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172484] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172491] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172497] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172510] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172517] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172523] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172529] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172535] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172541] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172548] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172554] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172560] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172567] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172584] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172591] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172603] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172616] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172625] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172631] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172637] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172643] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172656] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172662] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172688] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172700] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172706] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172726] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172732] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172738] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172744] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172751] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172757] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172776] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172782] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172789] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172794] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172809] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172821] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172828] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172833] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172839] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.383 [2024-07-22 20:29:09.172851] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.172857] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.172863] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.172870] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.172876] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e2b60 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.172904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:23:37.384 [2024-07-22 20:29:09.172959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x101d6b0 (9): Bad file descriptor 00:23:37.384 [2024-07-22 20:29:09.172985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.172994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173002] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173031] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x101e430 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.173074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173108] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173121] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10265e0 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.173156] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173172] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173186] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf66660 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.173233] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173250] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173268] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1002710 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.173329] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173346] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173374] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.384 [2024-07-22 20:29:09.173381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1005470 is same with the state(5) to be set 00:23:37.384 [2024-07-22 20:29:09.173484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.384 [2024-07-22 20:29:09.173686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.384 [2024-07-22 20:29:09.173694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.173963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.173981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.173983] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.173988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.173992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.173997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34304 len:12[2024-07-22 20:29:09.174000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.174009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with [2024-07-22 20:29:09.174021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36352 len:12the state(5) to be set 00:23:37.385 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.174030] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with [2024-07-22 20:29:09.174031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:23:37.385 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.174039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.174050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.174058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:36608 len:1[2024-07-22 20:29:09.174066] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.174077] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174087] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with [2024-07-22 20:29:09.174087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36736 len:12the state(5) to be set 00:23:37.385 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.174097] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with [2024-07-22 20:29:09.174098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:23:37.385 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.174106] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.174113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.174120] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.174128] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.174135] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174142] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.174149] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.385 [2024-07-22 20:29:09.174156] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.385 [2024-07-22 20:29:09.174164] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.385 [2024-07-22 20:29:09.174169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174172] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37376 len:1[2024-07-22 20:29:09.174179] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.174188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174204] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174211] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:37632 len:12[2024-07-22 20:29:09.174219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:1[2024-07-22 20:29:09.174237] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.174247] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174265] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174273] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with [2024-07-22 20:29:09.174274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:38016 len:1the state(5) to be set 00:23:37.386 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174282] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174298] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174312] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174326] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174340] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174347] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174364] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.386 [2024-07-22 20:29:09.174371] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.386 [2024-07-22 20:29:09.174378] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.386 [2024-07-22 20:29:09.174384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.174385] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.387 the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.174446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.387 [2024-07-22 20:29:09.174501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.174555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.387 [2024-07-22 20:29:09.174613] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.174669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.387 [2024-07-22 20:29:09.174724] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.174785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.387 [2024-07-22 20:29:09.174841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.174897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.387 [2024-07-22 20:29:09.174959] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.175014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.387 [2024-07-22 20:29:09.175105] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.175163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.387 [2024-07-22 20:29:09.175221] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.175276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.387 [2024-07-22 20:29:09.175330] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.175385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.387 [2024-07-22 20:29:09.175439] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.387 [2024-07-22 20:29:09.175493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.388 [2024-07-22 20:29:09.175549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.175605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.388 [2024-07-22 20:29:09.175663] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.175717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.388 [2024-07-22 20:29:09.175772] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.175827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.388 [2024-07-22 20:29:09.175882] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3010 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.175936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.388 [2024-07-22 20:29:09.176060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.388 [2024-07-22 20:29:09.176114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.388 [2024-07-22 20:29:09.176170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.388 [2024-07-22 20:29:09.176223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.388 [2024-07-22 20:29:09.176280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.388 [2024-07-22 20:29:09.176334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.388 [2024-07-22 20:29:09.176395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.388 [2024-07-22 20:29:09.176447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.388 [2024-07-22 20:29:09.176552] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xff2b80 was disconnected and freed. reset controller. 00:23:37.388 [2024-07-22 20:29:09.176811] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.176828] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.176835] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.176842] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.176848] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.176855] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.176911] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.176964] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177025] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177096] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177160] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177213] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177449] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177556] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177662] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177768] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177822] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177883] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.177989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178063] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178146] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178212] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:23:37.388 [2024-07-22 20:29:09.178441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf66660 (9): Bad file descriptor 00:23:37.388 [2024-07-22 20:29:09.178490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178561] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178606] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178691] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178725] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178762] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178837] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178879] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178913] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:37.388 [2024-07-22 20:29:09.178919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.178992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179031] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179196] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179268] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179312] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179308] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:37.388 [2024-07-22 20:29:09.179357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179432] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179466] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179537] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.388 [2024-07-22 20:29:09.179661] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:37.388 [2024-07-22 20:29:09.180318] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:37.388 [2024-07-22 20:29:09.180370] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:37.388 [2024-07-22 20:29:09.180419] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:37.388 [2024-07-22 20:29:09.182942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x101e430 (9): Bad file descriptor 00:23:37.389 [2024-07-22 20:29:09.182969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10265e0 (9): Bad file descriptor 00:23:37.389 [2024-07-22 20:29:09.182986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1002710 (9): Bad file descriptor 00:23:37.389 [2024-07-22 20:29:09.183015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183034] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183054] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183071] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6160 is same with the state(5) to be set 00:23:37.389 [2024-07-22 20:29:09.183111] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183127] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183142] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183157] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1023f70 is same with the state(5) to be set 00:23:37.389 [2024-07-22 20:29:09.183184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1005470 (9): Bad file descriptor 00:23:37.389 [2024-07-22 20:29:09.183211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183229] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183243] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183258] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.389 [2024-07-22 20:29:09.183265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.183271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c68e0 is same with the state(5) to be set 00:23:37.389 [2024-07-22 20:29:09.191731] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.389 [2024-07-22 20:29:09.191744] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.389 [2024-07-22 20:29:09.191754] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.389 [2024-07-22 20:29:09.191762] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e34a0 is same with the state(5) to be set 00:23:37.389 [2024-07-22 20:29:09.192160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.389 [2024-07-22 20:29:09.192525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.389 [2024-07-22 20:29:09.192534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192687] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192695] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with [2024-07-22 20:29:09.192695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31232 len:12the state(5) to be set 00:23:37.390 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192711] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192726] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28672 len:12[2024-07-22 20:29:09.192733] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.192743] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192769] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192776] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192784] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192803] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192811] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192818] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192832] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-22 20:29:09.192839] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192848] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192854] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192862] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31872 len:1[2024-07-22 20:29:09.192870] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17e3950 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 the state(5) to be set 00:23:37.390 [2024-07-22 20:29:09.192878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.192985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.192992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.390 [2024-07-22 20:29:09.193000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.390 [2024-07-22 20:29:09.193007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.193236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bfb60 is same with the state(5) to be set 00:23:37.391 [2024-07-22 20:29:09.193297] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x11bfb60 was disconnected and freed. reset controller. 00:23:37.391 [2024-07-22 20:29:09.193422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c6160 (9): Bad file descriptor 00:23:37.391 [2024-07-22 20:29:09.193437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1023f70 (9): Bad file descriptor 00:23:37.391 [2024-07-22 20:29:09.193456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c68e0 (9): Bad file descriptor 00:23:37.391 [2024-07-22 20:29:09.193483] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.391 [2024-07-22 20:29:09.193492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193500] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.391 [2024-07-22 20:29:09.193507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193515] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.391 [2024-07-22 20:29:09.193523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:37.391 [2024-07-22 20:29:09.193540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.193547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1096640 is same with the state(5) to be set 00:23:37.391 [2024-07-22 20:29:09.194554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:23:37.391 [2024-07-22 20:29:09.194601] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:37.391 [2024-07-22 20:29:09.194612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf66660 is same with the state(5) to be set 00:23:37.391 [2024-07-22 20:29:09.194639] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:37.391 [2024-07-22 20:29:09.194647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x101d6b0 is same with the state(5) to be set 00:23:37.391 [2024-07-22 20:29:09.194685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.391 [2024-07-22 20:29:09.194915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.391 [2024-07-22 20:29:09.194925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.194931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.194940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.194947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.194955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.194962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.194970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.194977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.194985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.194992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.392 [2024-07-22 20:29:09.195437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.392 [2024-07-22 20:29:09.195446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.195688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.195696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11bf280 is same with the state(5) to be set 00:23:37.393 [2024-07-22 20:29:09.196689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.196985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.196995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.197004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.197013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.197020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.197028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.197035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.197049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.393 [2024-07-22 20:29:09.197056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.393 [2024-07-22 20:29:09.197065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.197355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.197363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.200998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.394 [2024-07-22 20:29:09.201294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.394 [2024-07-22 20:29:09.201303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.201310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.201319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.201326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.201334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.201342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.201349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xff32c0 is same with the state(5) to be set 00:23:37.395 [2024-07-22 20:29:09.202341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.395 [2024-07-22 20:29:09.202920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.395 [2024-07-22 20:29:09.202928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.202937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.202944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.202953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.202960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.202969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.202976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.202984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.202991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.203382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.203389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x114fb70 is same with the state(5) to be set 00:23:37.396 [2024-07-22 20:29:09.204360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.204373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.204384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.204392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.204400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.396 [2024-07-22 20:29:09.204410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.396 [2024-07-22 20:29:09.204419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.204983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.204992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.205000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.205010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.205017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.397 [2024-07-22 20:29:09.205025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.397 [2024-07-22 20:29:09.205032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.205403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.205411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1151020 is same with the state(5) to be set 00:23:37.398 [2024-07-22 20:29:09.206446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:23:37.398 [2024-07-22 20:29:09.206465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:23:37.398 [2024-07-22 20:29:09.206478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:23:37.398 [2024-07-22 20:29:09.206896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.398 [2024-07-22 20:29:09.207268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.398 [2024-07-22 20:29:09.207282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10c6160 with addr=10.0.0.2, port=4420 00:23:37.398 [2024-07-22 20:29:09.207291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6160 is same with the state(5) to be set 00:23:37.398 [2024-07-22 20:29:09.207303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf66660 (9): Bad file descriptor 00:23:37.398 [2024-07-22 20:29:09.207313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x101d6b0 (9): Bad file descriptor 00:23:37.398 [2024-07-22 20:29:09.207324] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.398 [2024-07-22 20:29:09.207346] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.398 [2024-07-22 20:29:09.207361] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.398 [2024-07-22 20:29:09.207384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1096640 (9): Bad file descriptor 00:23:37.398 [2024-07-22 20:29:09.207404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c6160 (9): Bad file descriptor 00:23:37.398 [2024-07-22 20:29:09.207798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:23:37.398 [2024-07-22 20:29:09.208219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.398 [2024-07-22 20:29:09.208496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.398 [2024-07-22 20:29:09.208508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1002710 with addr=10.0.0.2, port=4420 00:23:37.398 [2024-07-22 20:29:09.208517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1002710 is same with the state(5) to be set 00:23:37.398 [2024-07-22 20:29:09.208883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.398 [2024-07-22 20:29:09.209012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.398 [2024-07-22 20:29:09.209023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1005470 with addr=10.0.0.2, port=4420 00:23:37.398 [2024-07-22 20:29:09.209031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1005470 is same with the state(5) to be set 00:23:37.398 [2024-07-22 20:29:09.209378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.398 [2024-07-22 20:29:09.209787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.398 [2024-07-22 20:29:09.209799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x101e430 with addr=10.0.0.2, port=4420 00:23:37.398 [2024-07-22 20:29:09.209807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x101e430 is same with the state(5) to be set 00:23:37.398 [2024-07-22 20:29:09.209817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:23:37.398 [2024-07-22 20:29:09.209824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:23:37.398 [2024-07-22 20:29:09.209832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:23:37.398 [2024-07-22 20:29:09.209845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:23:37.398 [2024-07-22 20:29:09.209852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:23:37.398 [2024-07-22 20:29:09.209864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:23:37.398 [2024-07-22 20:29:09.210797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.210812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.210824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.210833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.398 [2024-07-22 20:29:09.210842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.398 [2024-07-22 20:29:09.210850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.210866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.210883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.210899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.210915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.210932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.210954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.210970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.210986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.210996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.399 [2024-07-22 20:29:09.211498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.399 [2024-07-22 20:29:09.211505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.211864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.211873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10ab710 is same with the state(5) to be set 00:23:37.400 [2024-07-22 20:29:09.212868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.212882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.212893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.212901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.212911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.212918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.212927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.212935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.212944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.212951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.212960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.212967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.212976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.212983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.212992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.400 [2024-07-22 20:29:09.213149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.400 [2024-07-22 20:29:09.213157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.401 [2024-07-22 20:29:09.213653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.401 [2024-07-22 20:29:09.213664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.213913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.213921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10accf0 is same with the state(5) to be set 00:23:37.402 [2024-07-22 20:29:09.214923] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:23:37.402 [2024-07-22 20:29:09.214957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.402 [2024-07-22 20:29:09.214965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.402 [2024-07-22 20:29:09.214973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:23:37.402 [2024-07-22 20:29:09.214982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:23:37.402 [2024-07-22 20:29:09.215329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.402 [2024-07-22 20:29:09.215659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.402 [2024-07-22 20:29:09.215671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10265e0 with addr=10.0.0.2, port=4420 00:23:37.402 [2024-07-22 20:29:09.215679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10265e0 is same with the state(5) to be set 00:23:37.402 [2024-07-22 20:29:09.215690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1002710 (9): Bad file descriptor 00:23:37.402 [2024-07-22 20:29:09.215700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1005470 (9): Bad file descriptor 00:23:37.402 [2024-07-22 20:29:09.215710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x101e430 (9): Bad file descriptor 00:23:37.402 [2024-07-22 20:29:09.215718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:23:37.402 [2024-07-22 20:29:09.215726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:23:37.402 [2024-07-22 20:29:09.215734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:23:37.402 [2024-07-22 20:29:09.215827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.402 [2024-07-22 20:29:09.216221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.402 [2024-07-22 20:29:09.216553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.402 [2024-07-22 20:29:09.216565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1023f70 with addr=10.0.0.2, port=4420 00:23:37.402 [2024-07-22 20:29:09.216574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1023f70 is same with the state(5) to be set 00:23:37.402 [2024-07-22 20:29:09.216952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.402 [2024-07-22 20:29:09.217263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.402 [2024-07-22 20:29:09.217278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10c68e0 with addr=10.0.0.2, port=4420 00:23:37.402 [2024-07-22 20:29:09.217285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c68e0 is same with the state(5) to be set 00:23:37.402 [2024-07-22 20:29:09.217295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10265e0 (9): Bad file descriptor 00:23:37.402 [2024-07-22 20:29:09.217303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:23:37.402 [2024-07-22 20:29:09.217311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:23:37.402 [2024-07-22 20:29:09.217318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:37.402 [2024-07-22 20:29:09.217329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:23:37.402 [2024-07-22 20:29:09.217336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:23:37.402 [2024-07-22 20:29:09.217343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:23:37.402 [2024-07-22 20:29:09.217353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:23:37.402 [2024-07-22 20:29:09.217360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:23:37.402 [2024-07-22 20:29:09.217367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:23:37.402 [2024-07-22 20:29:09.217847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.402 [2024-07-22 20:29:09.217858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.402 [2024-07-22 20:29:09.217863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.402 [2024-07-22 20:29:09.217872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1023f70 (9): Bad file descriptor 00:23:37.402 [2024-07-22 20:29:09.217881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c68e0 (9): Bad file descriptor 00:23:37.402 [2024-07-22 20:29:09.217889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:23:37.402 [2024-07-22 20:29:09.217896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:23:37.402 [2024-07-22 20:29:09.217903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:23:37.402 [2024-07-22 20:29:09.217968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.402 [2024-07-22 20:29:09.217996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:23:37.402 [2024-07-22 20:29:09.218004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:23:37.402 [2024-07-22 20:29:09.218011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:23:37.402 [2024-07-22 20:29:09.218021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:23:37.402 [2024-07-22 20:29:09.218028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:23:37.402 [2024-07-22 20:29:09.218035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:23:37.402 [2024-07-22 20:29:09.218094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.218105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.402 [2024-07-22 20:29:09.218116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.402 [2024-07-22 20:29:09.218127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:37.403 [2024-07-22 20:29:09.218396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:37.403 [2024-07-22 20:29:09.218404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x205abb0 is same with the state(5) to be set 00:23:37.403 [2024-07-22 20:29:09.219201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:23:37.403 [2024-07-22 20:29:09.219216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:23:37.403 [2024-07-22 20:29:09.219224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:23:37.403 [2024-07-22 20:29:09.219233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:23:37.403 [2024-07-22 20:29:09.219241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:23:37.403 [2024-07-22 20:29:09.219250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:23:37.403 [2024-07-22 20:29:09.219258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.403 [2024-07-22 20:29:09.219265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.403 task offset: 29440 on job bdev=Nvme10n1 fails 00:23:37.403 00:23:37.403 Latency(us) 00:23:37.403 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:37.403 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme1n1 ended in about 0.54 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme1n1 : 0.54 304.26 19.02 118.74 0.00 150135.93 83886.08 130388.15 00:23:37.403 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme2n1 ended in about 0.52 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme2n1 : 0.52 482.40 30.15 123.00 0.00 103525.35 5499.33 96195.45 00:23:37.403 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme3n1 ended in about 0.54 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme3n1 : 0.54 381.90 23.87 117.51 0.00 124106.08 75679.83 110784.33 00:23:37.403 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme4n1 ended in about 0.55 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme4n1 : 0.55 299.99 18.75 117.07 0.00 146836.63 83886.08 130388.15 00:23:37.403 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme5n1 ended in about 0.55 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme5n1 : 0.55 298.89 18.68 116.64 0.00 145552.91 75679.83 129476.34 00:23:37.403 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme6n1 ended in about 0.56 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme6n1 : 0.56 374.68 23.42 115.28 0.00 121990.82 74768.03 92548.23 00:23:37.403 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme7n1 ended in about 0.56 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme7n1 : 0.56 294.34 18.40 114.86 0.00 144310.17 59267.34 145888.83 00:23:37.403 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme8n1 ended in about 0.54 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme8n1 : 0.54 387.41 24.21 119.20 0.00 114632.69 58811.44 99386.77 00:23:37.403 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme9n1 ended in about 0.56 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme9n1 : 0.56 464.82 29.05 32.06 0.00 110893.61 24960.67 96651.35 00:23:37.403 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:23:37.403 Job: Nvme10n1 ended in about 0.52 seconds with error 00:23:37.403 Verification LBA range: start 0x0 length 0x400 00:23:37.403 Nvme10n1 : 0.52 417.18 26.07 124.18 0.00 103838.66 10599.74 96651.35 00:23:37.403 =================================================================================================================== 00:23:37.403 Total : 3705.87 231.62 1098.55 0.00 124735.78 5499.33 145888.83 00:23:37.403 [2024-07-22 20:29:09.240641] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:23:37.403 [2024-07-22 20:29:09.240686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:23:37.403 [2024-07-22 20:29:09.241148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.403 [2024-07-22 20:29:09.241541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.403 [2024-07-22 20:29:09.241553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x101d6b0 with addr=10.0.0.2, port=4420 00:23:37.403 [2024-07-22 20:29:09.241564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x101d6b0 is same with the state(5) to be set 00:23:37.403 [2024-07-22 20:29:09.241917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.403 [2024-07-22 20:29:09.242259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.403 [2024-07-22 20:29:09.242271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf66660 with addr=10.0.0.2, port=4420 00:23:37.403 [2024-07-22 20:29:09.242279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf66660 is same with the state(5) to be set 00:23:37.403 [2024-07-22 20:29:09.242545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.403 [2024-07-22 20:29:09.242883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.403 [2024-07-22 20:29:09.242895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10c6160 with addr=10.0.0.2, port=4420 00:23:37.403 [2024-07-22 20:29:09.242902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6160 is same with the state(5) to be set 00:23:37.404 [2024-07-22 20:29:09.243205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.243502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.243513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x101e430 with addr=10.0.0.2, port=4420 00:23:37.404 [2024-07-22 20:29:09.243520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x101e430 is same with the state(5) to be set 00:23:37.404 [2024-07-22 20:29:09.243853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.244171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.244182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1005470 with addr=10.0.0.2, port=4420 00:23:37.404 [2024-07-22 20:29:09.244190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1005470 is same with the state(5) to be set 00:23:37.404 [2024-07-22 20:29:09.244494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.244903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.244914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1002710 with addr=10.0.0.2, port=4420 00:23:37.404 [2024-07-22 20:29:09.244921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1002710 is same with the state(5) to be set 00:23:37.404 [2024-07-22 20:29:09.245196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:23:37.404 [2024-07-22 20:29:09.245516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.245910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.245922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1096640 with addr=10.0.0.2, port=4420 00:23:37.404 [2024-07-22 20:29:09.245930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1096640 is same with the state(5) to be set 00:23:37.404 [2024-07-22 20:29:09.245944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x101d6b0 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.245955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf66660 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.245965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c6160 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.245974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x101e430 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.245983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1005470 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.245992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1002710 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.246036] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.404 [2024-07-22 20:29:09.246053] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.404 [2024-07-22 20:29:09.246064] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.404 [2024-07-22 20:29:09.246075] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.404 [2024-07-22 20:29:09.246085] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.404 [2024-07-22 20:29:09.246095] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:37.404 [2024-07-22 20:29:09.246454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.246781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.246793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10265e0 with addr=10.0.0.2, port=4420 00:23:37.404 [2024-07-22 20:29:09.246800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10265e0 is same with the state(5) to be set 00:23:37.404 [2024-07-22 20:29:09.246810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1096640 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.246823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.246830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.246839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:23:37.404 [2024-07-22 20:29:09.246850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.246857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.246865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:23:37.404 [2024-07-22 20:29:09.246873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.246880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.246886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:23:37.404 [2024-07-22 20:29:09.246896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.246904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.246911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:23:37.404 [2024-07-22 20:29:09.246921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.246927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.246934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:23:37.404 [2024-07-22 20:29:09.246944] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.246950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.246956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:37.404 [2024-07-22 20:29:09.246995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:23:37.404 [2024-07-22 20:29:09.247006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:23:37.404 [2024-07-22 20:29:09.247015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.247021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.247028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.247033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.247040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.247064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10265e0 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.247073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.247080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.247086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:23:37.404 [2024-07-22 20:29:09.247103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.247117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.247487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.247821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.247833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10c68e0 with addr=10.0.0.2, port=4420 00:23:37.404 [2024-07-22 20:29:09.247841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c68e0 is same with the state(5) to be set 00:23:37.404 [2024-07-22 20:29:09.248183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.248549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:23:37.404 [2024-07-22 20:29:09.248560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1023f70 with addr=10.0.0.2, port=4420 00:23:37.404 [2024-07-22 20:29:09.248568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1023f70 is same with the state(5) to be set 00:23:37.404 [2024-07-22 20:29:09.248575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.248582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.248588] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:23:37.404 [2024-07-22 20:29:09.248612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.248623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c68e0 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.248631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1023f70 (9): Bad file descriptor 00:23:37.404 [2024-07-22 20:29:09.248653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.248661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.248668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:23:37.404 [2024-07-22 20:29:09.248676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:23:37.404 [2024-07-22 20:29:09.248683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:23:37.404 [2024-07-22 20:29:09.248690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:23:37.404 [2024-07-22 20:29:09.248712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.404 [2024-07-22 20:29:09.248719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:37.974 20:29:09 -- target/shutdown.sh@135 -- # nvmfpid= 00:23:37.974 20:29:09 -- target/shutdown.sh@138 -- # sleep 1 00:23:38.914 20:29:10 -- target/shutdown.sh@141 -- # kill -9 3501575 00:23:38.914 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3501575) - No such process 00:23:38.914 20:29:10 -- target/shutdown.sh@141 -- # true 00:23:38.914 20:29:10 -- target/shutdown.sh@143 -- # stoptarget 00:23:38.914 20:29:10 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:23:38.914 20:29:10 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:23:38.914 20:29:10 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:23:38.914 20:29:10 -- target/shutdown.sh@45 -- # nvmftestfini 00:23:38.914 20:29:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:38.914 20:29:10 -- nvmf/common.sh@116 -- # sync 00:23:38.914 20:29:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:38.914 20:29:10 -- nvmf/common.sh@119 -- # set +e 00:23:38.914 20:29:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:38.914 20:29:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:38.914 rmmod nvme_tcp 00:23:38.914 rmmod nvme_fabrics 00:23:38.914 rmmod nvme_keyring 00:23:38.914 20:29:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:38.914 20:29:10 -- nvmf/common.sh@123 -- # set -e 00:23:38.914 20:29:10 -- nvmf/common.sh@124 -- # return 0 00:23:38.914 20:29:10 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:23:38.914 20:29:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:38.914 20:29:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:38.914 20:29:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:38.914 20:29:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:38.914 20:29:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:38.914 20:29:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:38.914 20:29:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:38.914 20:29:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:40.833 20:29:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:40.833 00:23:40.833 real 0m7.286s 00:23:40.833 user 0m16.836s 00:23:40.833 sys 0m1.200s 00:23:40.833 20:29:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:40.833 20:29:12 -- common/autotest_common.sh@10 -- # set +x 00:23:40.833 ************************************ 00:23:40.833 END TEST nvmf_shutdown_tc3 00:23:40.833 ************************************ 00:23:41.092 20:29:12 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:23:41.092 00:23:41.092 real 0m29.982s 00:23:41.092 user 1m16.241s 00:23:41.092 sys 0m7.652s 00:23:41.092 20:29:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:41.092 20:29:12 -- common/autotest_common.sh@10 -- # set +x 00:23:41.092 ************************************ 00:23:41.092 END TEST nvmf_shutdown 00:23:41.092 ************************************ 00:23:41.092 20:29:12 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:23:41.092 20:29:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:41.092 20:29:12 -- common/autotest_common.sh@10 -- # set +x 00:23:41.093 20:29:12 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:23:41.093 20:29:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:41.093 20:29:12 -- common/autotest_common.sh@10 -- # set +x 00:23:41.093 20:29:12 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:23:41.093 20:29:12 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:41.093 20:29:12 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:41.093 20:29:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:41.093 20:29:12 -- common/autotest_common.sh@10 -- # set +x 00:23:41.093 ************************************ 00:23:41.093 START TEST nvmf_multicontroller 00:23:41.093 ************************************ 00:23:41.093 20:29:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:41.093 * Looking for test storage... 00:23:41.093 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:41.093 20:29:12 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:41.093 20:29:12 -- nvmf/common.sh@7 -- # uname -s 00:23:41.093 20:29:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:41.093 20:29:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:41.093 20:29:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:41.093 20:29:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:41.093 20:29:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:41.093 20:29:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:41.093 20:29:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:41.093 20:29:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:41.093 20:29:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:41.093 20:29:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:41.093 20:29:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:23:41.093 20:29:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:23:41.093 20:29:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:41.093 20:29:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:41.093 20:29:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:41.093 20:29:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:41.093 20:29:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:41.093 20:29:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:41.093 20:29:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:41.093 20:29:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:41.093 20:29:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:41.093 20:29:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:41.093 20:29:12 -- paths/export.sh@5 -- # export PATH 00:23:41.093 20:29:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:41.093 20:29:12 -- nvmf/common.sh@46 -- # : 0 00:23:41.093 20:29:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:41.093 20:29:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:41.093 20:29:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:41.093 20:29:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:41.093 20:29:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:41.093 20:29:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:41.093 20:29:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:41.093 20:29:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:41.093 20:29:12 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:41.093 20:29:12 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:41.093 20:29:12 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:23:41.093 20:29:12 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:23:41.093 20:29:12 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:23:41.093 20:29:12 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:23:41.093 20:29:12 -- host/multicontroller.sh@23 -- # nvmftestinit 00:23:41.093 20:29:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:41.093 20:29:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:41.093 20:29:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:41.093 20:29:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:41.093 20:29:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:41.093 20:29:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:41.093 20:29:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:41.093 20:29:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:41.093 20:29:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:41.093 20:29:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:41.093 20:29:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:41.093 20:29:12 -- common/autotest_common.sh@10 -- # set +x 00:23:46.369 20:29:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:46.369 20:29:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:46.369 20:29:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:46.369 20:29:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:46.369 20:29:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:46.369 20:29:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:46.369 20:29:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:46.369 20:29:17 -- nvmf/common.sh@294 -- # net_devs=() 00:23:46.369 20:29:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:46.369 20:29:17 -- nvmf/common.sh@295 -- # e810=() 00:23:46.369 20:29:17 -- nvmf/common.sh@295 -- # local -ga e810 00:23:46.369 20:29:17 -- nvmf/common.sh@296 -- # x722=() 00:23:46.369 20:29:17 -- nvmf/common.sh@296 -- # local -ga x722 00:23:46.369 20:29:17 -- nvmf/common.sh@297 -- # mlx=() 00:23:46.369 20:29:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:46.369 20:29:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:46.369 20:29:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:46.369 20:29:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:46.369 20:29:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:46.369 20:29:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:46.369 20:29:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:23:46.369 Found 0000:86:00.0 (0x8086 - 0x159b) 00:23:46.369 20:29:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:46.369 20:29:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:23:46.369 Found 0000:86:00.1 (0x8086 - 0x159b) 00:23:46.369 20:29:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:46.369 20:29:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:46.369 20:29:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:46.369 20:29:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:46.369 20:29:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:46.369 20:29:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:46.369 20:29:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:23:46.369 Found net devices under 0000:86:00.0: cvl_0_0 00:23:46.369 20:29:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:46.369 20:29:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:46.369 20:29:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:46.369 20:29:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:46.369 20:29:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:46.369 20:29:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:23:46.369 Found net devices under 0000:86:00.1: cvl_0_1 00:23:46.369 20:29:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:46.369 20:29:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:46.369 20:29:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:46.369 20:29:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:46.369 20:29:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:46.369 20:29:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:46.369 20:29:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:46.369 20:29:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:46.369 20:29:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:46.369 20:29:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:46.369 20:29:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:46.369 20:29:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:46.369 20:29:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:46.369 20:29:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:46.369 20:29:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:46.369 20:29:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:46.369 20:29:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:46.369 20:29:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:46.369 20:29:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:46.370 20:29:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:46.370 20:29:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:46.370 20:29:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:46.370 20:29:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:46.370 20:29:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:46.370 20:29:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:46.370 20:29:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:46.370 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:46.370 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:23:46.370 00:23:46.370 --- 10.0.0.2 ping statistics --- 00:23:46.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:46.370 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:23:46.370 20:29:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:46.370 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:46.370 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.319 ms 00:23:46.370 00:23:46.370 --- 10.0.0.1 ping statistics --- 00:23:46.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:46.370 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:23:46.370 20:29:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:46.370 20:29:18 -- nvmf/common.sh@410 -- # return 0 00:23:46.370 20:29:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:46.370 20:29:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:46.370 20:29:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:46.370 20:29:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:46.370 20:29:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:46.370 20:29:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:46.370 20:29:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:46.370 20:29:18 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:23:46.370 20:29:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:46.370 20:29:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:46.370 20:29:18 -- common/autotest_common.sh@10 -- # set +x 00:23:46.370 20:29:18 -- nvmf/common.sh@469 -- # nvmfpid=3505481 00:23:46.370 20:29:18 -- nvmf/common.sh@470 -- # waitforlisten 3505481 00:23:46.370 20:29:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:46.370 20:29:18 -- common/autotest_common.sh@819 -- # '[' -z 3505481 ']' 00:23:46.370 20:29:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:46.370 20:29:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:46.370 20:29:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:46.370 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:46.370 20:29:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:46.370 20:29:18 -- common/autotest_common.sh@10 -- # set +x 00:23:46.628 [2024-07-22 20:29:18.336548] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:46.628 [2024-07-22 20:29:18.336592] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:46.628 EAL: No free 2048 kB hugepages reported on node 1 00:23:46.628 [2024-07-22 20:29:18.392509] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:46.628 [2024-07-22 20:29:18.470974] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:46.628 [2024-07-22 20:29:18.471087] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:46.628 [2024-07-22 20:29:18.471095] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:46.628 [2024-07-22 20:29:18.471102] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:46.628 [2024-07-22 20:29:18.471205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:46.628 [2024-07-22 20:29:18.471289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:46.628 [2024-07-22 20:29:18.471290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:47.565 20:29:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:47.565 20:29:19 -- common/autotest_common.sh@852 -- # return 0 00:23:47.565 20:29:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:47.565 20:29:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 20:29:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:47.565 20:29:19 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 [2024-07-22 20:29:19.176198] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 Malloc0 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 [2024-07-22 20:29:19.243934] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 [2024-07-22 20:29:19.251893] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 Malloc1 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:23:47.565 20:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:47.565 20:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.565 20:29:19 -- host/multicontroller.sh@44 -- # bdevperf_pid=3505681 00:23:47.565 20:29:19 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:23:47.565 20:29:19 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:47.565 20:29:19 -- host/multicontroller.sh@47 -- # waitforlisten 3505681 /var/tmp/bdevperf.sock 00:23:47.565 20:29:19 -- common/autotest_common.sh@819 -- # '[' -z 3505681 ']' 00:23:47.565 20:29:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:47.565 20:29:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:47.565 20:29:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:47.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:47.565 20:29:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:47.565 20:29:19 -- common/autotest_common.sh@10 -- # set +x 00:23:48.499 20:29:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:48.499 20:29:20 -- common/autotest_common.sh@852 -- # return 0 00:23:48.499 20:29:20 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:48.499 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:48.499 NVMe0n1 00:23:48.499 20:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.499 20:29:20 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:48.499 20:29:20 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:48.499 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:48.499 20:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.499 1 00:23:48.499 20:29:20 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:48.499 20:29:20 -- common/autotest_common.sh@640 -- # local es=0 00:23:48.499 20:29:20 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:48.499 20:29:20 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:48.499 20:29:20 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:48.499 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:48.499 request: 00:23:48.499 { 00:23:48.499 "name": "NVMe0", 00:23:48.499 "trtype": "tcp", 00:23:48.499 "traddr": "10.0.0.2", 00:23:48.499 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:48.499 "hostaddr": "10.0.0.2", 00:23:48.499 "hostsvcid": "60000", 00:23:48.499 "adrfam": "ipv4", 00:23:48.499 "trsvcid": "4420", 00:23:48.499 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:48.499 "method": "bdev_nvme_attach_controller", 00:23:48.499 "req_id": 1 00:23:48.499 } 00:23:48.499 Got JSON-RPC error response 00:23:48.499 response: 00:23:48.499 { 00:23:48.499 "code": -114, 00:23:48.499 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:48.499 } 00:23:48.499 20:29:20 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:23:48.499 20:29:20 -- common/autotest_common.sh@643 -- # es=1 00:23:48.499 20:29:20 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:23:48.499 20:29:20 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:23:48.499 20:29:20 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:23:48.499 20:29:20 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:48.499 20:29:20 -- common/autotest_common.sh@640 -- # local es=0 00:23:48.499 20:29:20 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:48.499 20:29:20 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:48.499 20:29:20 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:48.499 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:48.499 request: 00:23:48.499 { 00:23:48.499 "name": "NVMe0", 00:23:48.499 "trtype": "tcp", 00:23:48.499 "traddr": "10.0.0.2", 00:23:48.499 "hostaddr": "10.0.0.2", 00:23:48.499 "hostsvcid": "60000", 00:23:48.499 "adrfam": "ipv4", 00:23:48.499 "trsvcid": "4420", 00:23:48.499 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:48.499 "method": "bdev_nvme_attach_controller", 00:23:48.499 "req_id": 1 00:23:48.499 } 00:23:48.499 Got JSON-RPC error response 00:23:48.499 response: 00:23:48.499 { 00:23:48.499 "code": -114, 00:23:48.499 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:48.499 } 00:23:48.499 20:29:20 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:23:48.499 20:29:20 -- common/autotest_common.sh@643 -- # es=1 00:23:48.499 20:29:20 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:23:48.499 20:29:20 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:23:48.499 20:29:20 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:23:48.499 20:29:20 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@640 -- # local es=0 00:23:48.499 20:29:20 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:48.499 20:29:20 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:48.499 request: 00:23:48.499 { 00:23:48.499 "name": "NVMe0", 00:23:48.499 "trtype": "tcp", 00:23:48.499 "traddr": "10.0.0.2", 00:23:48.499 "hostaddr": "10.0.0.2", 00:23:48.499 "hostsvcid": "60000", 00:23:48.499 "adrfam": "ipv4", 00:23:48.499 "trsvcid": "4420", 00:23:48.499 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:48.499 "multipath": "disable", 00:23:48.499 "method": "bdev_nvme_attach_controller", 00:23:48.499 "req_id": 1 00:23:48.499 } 00:23:48.499 Got JSON-RPC error response 00:23:48.499 response: 00:23:48.499 { 00:23:48.499 "code": -114, 00:23:48.499 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:48.499 } 00:23:48.499 20:29:20 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:23:48.499 20:29:20 -- common/autotest_common.sh@643 -- # es=1 00:23:48.499 20:29:20 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:23:48.499 20:29:20 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:23:48.499 20:29:20 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:23:48.499 20:29:20 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:48.499 20:29:20 -- common/autotest_common.sh@640 -- # local es=0 00:23:48.499 20:29:20 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:48.499 20:29:20 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:23:48.499 20:29:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:48.499 20:29:20 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:48.499 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:48.499 request: 00:23:48.499 { 00:23:48.499 "name": "NVMe0", 00:23:48.499 "trtype": "tcp", 00:23:48.499 "traddr": "10.0.0.2", 00:23:48.499 "hostaddr": "10.0.0.2", 00:23:48.499 "hostsvcid": "60000", 00:23:48.499 "adrfam": "ipv4", 00:23:48.499 "trsvcid": "4420", 00:23:48.499 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:48.499 "multipath": "failover", 00:23:48.499 "method": "bdev_nvme_attach_controller", 00:23:48.499 "req_id": 1 00:23:48.499 } 00:23:48.499 Got JSON-RPC error response 00:23:48.499 response: 00:23:48.499 { 00:23:48.499 "code": -114, 00:23:48.499 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:48.499 } 00:23:48.499 20:29:20 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:23:48.499 20:29:20 -- common/autotest_common.sh@643 -- # es=1 00:23:48.499 20:29:20 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:23:48.499 20:29:20 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:23:48.499 20:29:20 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:23:48.499 20:29:20 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:48.499 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.499 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:48.757 00:23:48.757 20:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.757 20:29:20 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:48.757 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.757 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:48.757 20:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.757 20:29:20 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:48.757 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.757 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:49.016 00:23:49.016 20:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:49.016 20:29:20 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:49.016 20:29:20 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:49.016 20:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:49.016 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:23:49.016 20:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:49.016 20:29:20 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:49.016 20:29:20 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:50.395 0 00:23:50.395 20:29:21 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:50.395 20:29:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:50.395 20:29:21 -- common/autotest_common.sh@10 -- # set +x 00:23:50.395 20:29:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:50.395 20:29:21 -- host/multicontroller.sh@100 -- # killprocess 3505681 00:23:50.395 20:29:21 -- common/autotest_common.sh@926 -- # '[' -z 3505681 ']' 00:23:50.395 20:29:21 -- common/autotest_common.sh@930 -- # kill -0 3505681 00:23:50.395 20:29:21 -- common/autotest_common.sh@931 -- # uname 00:23:50.395 20:29:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:50.395 20:29:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3505681 00:23:50.395 20:29:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:50.395 20:29:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:50.395 20:29:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3505681' 00:23:50.395 killing process with pid 3505681 00:23:50.395 20:29:22 -- common/autotest_common.sh@945 -- # kill 3505681 00:23:50.395 20:29:22 -- common/autotest_common.sh@950 -- # wait 3505681 00:23:50.395 20:29:22 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:50.395 20:29:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:50.395 20:29:22 -- common/autotest_common.sh@10 -- # set +x 00:23:50.395 20:29:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:50.395 20:29:22 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:50.395 20:29:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:50.395 20:29:22 -- common/autotest_common.sh@10 -- # set +x 00:23:50.395 20:29:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:50.395 20:29:22 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:50.395 20:29:22 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:50.395 20:29:22 -- common/autotest_common.sh@1597 -- # read -r file 00:23:50.395 20:29:22 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:50.395 20:29:22 -- common/autotest_common.sh@1596 -- # sort -u 00:23:50.395 20:29:22 -- common/autotest_common.sh@1598 -- # cat 00:23:50.395 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:50.395 [2024-07-22 20:29:19.352547] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:50.395 [2024-07-22 20:29:19.352597] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3505681 ] 00:23:50.395 EAL: No free 2048 kB hugepages reported on node 1 00:23:50.395 [2024-07-22 20:29:19.407470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:50.395 [2024-07-22 20:29:19.486606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:50.395 [2024-07-22 20:29:20.802402] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name f70ad87e-8c60-473f-b150-b20f7d2e0523 already exists 00:23:50.395 [2024-07-22 20:29:20.802432] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:f70ad87e-8c60-473f-b150-b20f7d2e0523 alias for bdev NVMe1n1 00:23:50.395 [2024-07-22 20:29:20.802442] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:50.395 Running I/O for 1 seconds... 00:23:50.395 00:23:50.395 Latency(us) 00:23:50.395 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:50.395 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:50.395 NVMe0n1 : 1.01 23450.77 91.60 0.00 0.00 5440.75 2421.98 15728.64 00:23:50.395 =================================================================================================================== 00:23:50.395 Total : 23450.77 91.60 0.00 0.00 5440.75 2421.98 15728.64 00:23:50.395 Received shutdown signal, test time was about 1.000000 seconds 00:23:50.395 00:23:50.395 Latency(us) 00:23:50.395 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:50.395 =================================================================================================================== 00:23:50.395 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:50.395 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:50.395 20:29:22 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:50.395 20:29:22 -- common/autotest_common.sh@1597 -- # read -r file 00:23:50.395 20:29:22 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:50.395 20:29:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:50.395 20:29:22 -- nvmf/common.sh@116 -- # sync 00:23:50.395 20:29:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:50.395 20:29:22 -- nvmf/common.sh@119 -- # set +e 00:23:50.395 20:29:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:50.395 20:29:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:50.395 rmmod nvme_tcp 00:23:50.395 rmmod nvme_fabrics 00:23:50.395 rmmod nvme_keyring 00:23:50.395 20:29:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:50.395 20:29:22 -- nvmf/common.sh@123 -- # set -e 00:23:50.395 20:29:22 -- nvmf/common.sh@124 -- # return 0 00:23:50.395 20:29:22 -- nvmf/common.sh@477 -- # '[' -n 3505481 ']' 00:23:50.395 20:29:22 -- nvmf/common.sh@478 -- # killprocess 3505481 00:23:50.395 20:29:22 -- common/autotest_common.sh@926 -- # '[' -z 3505481 ']' 00:23:50.395 20:29:22 -- common/autotest_common.sh@930 -- # kill -0 3505481 00:23:50.395 20:29:22 -- common/autotest_common.sh@931 -- # uname 00:23:50.395 20:29:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:50.395 20:29:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3505481 00:23:50.730 20:29:22 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:23:50.730 20:29:22 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:23:50.730 20:29:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3505481' 00:23:50.730 killing process with pid 3505481 00:23:50.731 20:29:22 -- common/autotest_common.sh@945 -- # kill 3505481 00:23:50.731 20:29:22 -- common/autotest_common.sh@950 -- # wait 3505481 00:23:50.731 20:29:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:50.731 20:29:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:50.731 20:29:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:50.731 20:29:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:50.731 20:29:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:50.731 20:29:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:50.731 20:29:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:50.731 20:29:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:53.266 20:29:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:53.266 00:23:53.266 real 0m11.794s 00:23:53.266 user 0m16.868s 00:23:53.266 sys 0m4.800s 00:23:53.266 20:29:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:53.266 20:29:24 -- common/autotest_common.sh@10 -- # set +x 00:23:53.266 ************************************ 00:23:53.266 END TEST nvmf_multicontroller 00:23:53.266 ************************************ 00:23:53.266 20:29:24 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:53.266 20:29:24 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:53.266 20:29:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:53.266 20:29:24 -- common/autotest_common.sh@10 -- # set +x 00:23:53.266 ************************************ 00:23:53.266 START TEST nvmf_aer 00:23:53.266 ************************************ 00:23:53.266 20:29:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:53.266 * Looking for test storage... 00:23:53.266 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:53.266 20:29:24 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:53.266 20:29:24 -- nvmf/common.sh@7 -- # uname -s 00:23:53.266 20:29:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:53.266 20:29:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:53.266 20:29:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:53.266 20:29:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:53.266 20:29:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:53.266 20:29:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:53.266 20:29:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:53.266 20:29:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:53.266 20:29:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:53.266 20:29:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:53.266 20:29:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:23:53.266 20:29:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:23:53.266 20:29:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:53.266 20:29:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:53.266 20:29:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:53.266 20:29:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:53.266 20:29:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:53.266 20:29:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:53.266 20:29:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:53.266 20:29:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:53.266 20:29:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:53.266 20:29:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:53.266 20:29:24 -- paths/export.sh@5 -- # export PATH 00:23:53.266 20:29:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:53.266 20:29:24 -- nvmf/common.sh@46 -- # : 0 00:23:53.266 20:29:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:53.266 20:29:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:53.266 20:29:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:53.266 20:29:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:53.266 20:29:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:53.266 20:29:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:53.266 20:29:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:53.266 20:29:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:53.266 20:29:24 -- host/aer.sh@11 -- # nvmftestinit 00:23:53.266 20:29:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:53.266 20:29:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:53.266 20:29:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:53.266 20:29:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:53.266 20:29:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:53.266 20:29:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:53.266 20:29:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:53.266 20:29:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:53.266 20:29:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:53.266 20:29:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:53.266 20:29:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:53.266 20:29:24 -- common/autotest_common.sh@10 -- # set +x 00:23:58.540 20:29:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:58.540 20:29:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:58.540 20:29:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:58.540 20:29:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:58.540 20:29:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:58.540 20:29:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:58.540 20:29:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:58.540 20:29:29 -- nvmf/common.sh@294 -- # net_devs=() 00:23:58.540 20:29:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:58.540 20:29:29 -- nvmf/common.sh@295 -- # e810=() 00:23:58.540 20:29:29 -- nvmf/common.sh@295 -- # local -ga e810 00:23:58.540 20:29:29 -- nvmf/common.sh@296 -- # x722=() 00:23:58.540 20:29:29 -- nvmf/common.sh@296 -- # local -ga x722 00:23:58.540 20:29:29 -- nvmf/common.sh@297 -- # mlx=() 00:23:58.540 20:29:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:58.540 20:29:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:58.540 20:29:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:58.541 20:29:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:58.541 20:29:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:58.541 20:29:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:58.541 20:29:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:58.541 20:29:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:23:58.541 Found 0000:86:00.0 (0x8086 - 0x159b) 00:23:58.541 20:29:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:58.541 20:29:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:23:58.541 Found 0000:86:00.1 (0x8086 - 0x159b) 00:23:58.541 20:29:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:58.541 20:29:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:58.541 20:29:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:58.541 20:29:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:58.541 20:29:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:58.541 20:29:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:23:58.541 Found net devices under 0000:86:00.0: cvl_0_0 00:23:58.541 20:29:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:58.541 20:29:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:58.541 20:29:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:58.541 20:29:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:58.541 20:29:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:58.541 20:29:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:23:58.541 Found net devices under 0000:86:00.1: cvl_0_1 00:23:58.541 20:29:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:58.541 20:29:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:58.541 20:29:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:58.541 20:29:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:58.541 20:29:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:58.541 20:29:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:58.541 20:29:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:58.541 20:29:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:58.541 20:29:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:58.541 20:29:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:58.541 20:29:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:58.541 20:29:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:58.541 20:29:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:58.541 20:29:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:58.541 20:29:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:58.541 20:29:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:58.541 20:29:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:58.541 20:29:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:58.541 20:29:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:58.541 20:29:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:58.541 20:29:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:58.541 20:29:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:58.541 20:29:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:58.541 20:29:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:58.541 20:29:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:58.541 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:58.541 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.290 ms 00:23:58.541 00:23:58.541 --- 10.0.0.2 ping statistics --- 00:23:58.541 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:58.541 rtt min/avg/max/mdev = 0.290/0.290/0.290/0.000 ms 00:23:58.541 20:29:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:58.541 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:58.541 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.302 ms 00:23:58.541 00:23:58.541 --- 10.0.0.1 ping statistics --- 00:23:58.541 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:58.541 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:23:58.541 20:29:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:58.541 20:29:30 -- nvmf/common.sh@410 -- # return 0 00:23:58.541 20:29:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:58.541 20:29:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:58.541 20:29:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:58.541 20:29:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:58.541 20:29:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:58.541 20:29:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:58.541 20:29:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:58.541 20:29:30 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:58.541 20:29:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:58.541 20:29:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:58.541 20:29:30 -- common/autotest_common.sh@10 -- # set +x 00:23:58.541 20:29:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:58.541 20:29:30 -- nvmf/common.sh@469 -- # nvmfpid=3509702 00:23:58.541 20:29:30 -- nvmf/common.sh@470 -- # waitforlisten 3509702 00:23:58.541 20:29:30 -- common/autotest_common.sh@819 -- # '[' -z 3509702 ']' 00:23:58.541 20:29:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:58.541 20:29:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:58.541 20:29:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:58.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:58.541 20:29:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:58.541 20:29:30 -- common/autotest_common.sh@10 -- # set +x 00:23:58.541 [2024-07-22 20:29:30.192751] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:23:58.541 [2024-07-22 20:29:30.192795] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:58.541 EAL: No free 2048 kB hugepages reported on node 1 00:23:58.541 [2024-07-22 20:29:30.250767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:58.541 [2024-07-22 20:29:30.330796] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:58.541 [2024-07-22 20:29:30.330907] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:58.541 [2024-07-22 20:29:30.330915] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:58.541 [2024-07-22 20:29:30.330922] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:58.541 [2024-07-22 20:29:30.330963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:58.541 [2024-07-22 20:29:30.331072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:58.541 [2024-07-22 20:29:30.331136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:58.541 [2024-07-22 20:29:30.331138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:59.109 20:29:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:59.109 20:29:31 -- common/autotest_common.sh@852 -- # return 0 00:23:59.109 20:29:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:59.109 20:29:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:59.109 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.109 20:29:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:59.109 20:29:31 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:59.109 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.369 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.369 [2024-07-22 20:29:31.053349] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:59.369 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.369 20:29:31 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:59.369 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.369 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.369 Malloc0 00:23:59.369 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.369 20:29:31 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:59.369 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.369 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.369 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.369 20:29:31 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:59.369 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.369 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.369 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.369 20:29:31 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:59.369 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.369 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.369 [2024-07-22 20:29:31.104888] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:59.369 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.369 20:29:31 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:59.369 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.369 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.369 [2024-07-22 20:29:31.112706] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:59.369 [ 00:23:59.369 { 00:23:59.369 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:59.369 "subtype": "Discovery", 00:23:59.369 "listen_addresses": [], 00:23:59.369 "allow_any_host": true, 00:23:59.369 "hosts": [] 00:23:59.369 }, 00:23:59.369 { 00:23:59.369 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:59.369 "subtype": "NVMe", 00:23:59.369 "listen_addresses": [ 00:23:59.369 { 00:23:59.369 "transport": "TCP", 00:23:59.369 "trtype": "TCP", 00:23:59.369 "adrfam": "IPv4", 00:23:59.369 "traddr": "10.0.0.2", 00:23:59.369 "trsvcid": "4420" 00:23:59.369 } 00:23:59.369 ], 00:23:59.369 "allow_any_host": true, 00:23:59.369 "hosts": [], 00:23:59.369 "serial_number": "SPDK00000000000001", 00:23:59.369 "model_number": "SPDK bdev Controller", 00:23:59.369 "max_namespaces": 2, 00:23:59.369 "min_cntlid": 1, 00:23:59.369 "max_cntlid": 65519, 00:23:59.369 "namespaces": [ 00:23:59.369 { 00:23:59.369 "nsid": 1, 00:23:59.369 "bdev_name": "Malloc0", 00:23:59.369 "name": "Malloc0", 00:23:59.369 "nguid": "F8EC75F8B83A428DBB09BD118B50F239", 00:23:59.369 "uuid": "f8ec75f8-b83a-428d-bb09-bd118b50f239" 00:23:59.369 } 00:23:59.369 ] 00:23:59.369 } 00:23:59.369 ] 00:23:59.369 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.369 20:29:31 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:59.369 20:29:31 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:59.369 20:29:31 -- host/aer.sh@33 -- # aerpid=3509784 00:23:59.369 20:29:31 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:59.369 20:29:31 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:59.369 20:29:31 -- common/autotest_common.sh@1244 -- # local i=0 00:23:59.369 20:29:31 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:59.369 20:29:31 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:23:59.369 20:29:31 -- common/autotest_common.sh@1247 -- # i=1 00:23:59.369 20:29:31 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:23:59.369 EAL: No free 2048 kB hugepages reported on node 1 00:23:59.369 20:29:31 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:59.369 20:29:31 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:23:59.369 20:29:31 -- common/autotest_common.sh@1247 -- # i=2 00:23:59.369 20:29:31 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:23:59.628 20:29:31 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:59.628 20:29:31 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:59.628 20:29:31 -- common/autotest_common.sh@1255 -- # return 0 00:23:59.628 20:29:31 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:59.628 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.628 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.628 Malloc1 00:23:59.628 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.628 20:29:31 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:59.628 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.628 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.628 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.628 20:29:31 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:59.628 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.628 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.628 [ 00:23:59.628 { 00:23:59.628 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:59.628 "subtype": "Discovery", 00:23:59.628 "listen_addresses": [], 00:23:59.628 "allow_any_host": true, 00:23:59.628 "hosts": [] 00:23:59.628 }, 00:23:59.628 { 00:23:59.628 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:59.628 "subtype": "NVMe", 00:23:59.628 "listen_addresses": [ 00:23:59.628 { 00:23:59.628 "transport": "TCP", 00:23:59.628 "trtype": "TCP", 00:23:59.628 "adrfam": "IPv4", 00:23:59.628 "traddr": "10.0.0.2", 00:23:59.628 "trsvcid": "4420" 00:23:59.628 } 00:23:59.628 ], 00:23:59.628 "allow_any_host": true, 00:23:59.628 "hosts": [], 00:23:59.628 "serial_number": "SPDK00000000000001", 00:23:59.628 "model_number": "SPDK bdev Controller", 00:23:59.628 "max_namespaces": 2, 00:23:59.628 "min_cntlid": 1, 00:23:59.628 "max_cntlid": 65519, 00:23:59.628 "namespaces": [ 00:23:59.628 { 00:23:59.628 "nsid": 1, 00:23:59.628 "bdev_name": "Malloc0", 00:23:59.628 "name": "Malloc0", 00:23:59.628 "nguid": "F8EC75F8B83A428DBB09BD118B50F239", 00:23:59.628 "uuid": "f8ec75f8-b83a-428d-bb09-bd118b50f239" 00:23:59.628 }, 00:23:59.628 { 00:23:59.628 "nsid": 2, 00:23:59.628 "bdev_name": "Malloc1", 00:23:59.628 "name": "Malloc1", 00:23:59.628 "nguid": "3B53774D6A4F4138A03E11CA39F74CDA", 00:23:59.628 "uuid": "3b53774d-6a4f-4138-a03e-11ca39f74cda" 00:23:59.628 } 00:23:59.628 ] 00:23:59.628 } 00:23:59.628 ] 00:23:59.628 Asynchronous Event Request test 00:23:59.628 Attaching to 10.0.0.2 00:23:59.628 Attached to 10.0.0.2 00:23:59.628 Registering asynchronous event callbacks... 00:23:59.628 Starting namespace attribute notice tests for all controllers... 00:23:59.628 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:59.628 aer_cb - Changed Namespace 00:23:59.628 Cleaning up... 00:23:59.628 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.628 20:29:31 -- host/aer.sh@43 -- # wait 3509784 00:23:59.628 20:29:31 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:59.628 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.628 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.628 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.628 20:29:31 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:59.628 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.628 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.628 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.628 20:29:31 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:59.628 20:29:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:59.628 20:29:31 -- common/autotest_common.sh@10 -- # set +x 00:23:59.628 20:29:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:59.628 20:29:31 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:59.628 20:29:31 -- host/aer.sh@51 -- # nvmftestfini 00:23:59.628 20:29:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:59.628 20:29:31 -- nvmf/common.sh@116 -- # sync 00:23:59.628 20:29:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:59.628 20:29:31 -- nvmf/common.sh@119 -- # set +e 00:23:59.628 20:29:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:59.628 20:29:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:59.628 rmmod nvme_tcp 00:23:59.628 rmmod nvme_fabrics 00:23:59.628 rmmod nvme_keyring 00:23:59.628 20:29:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:59.628 20:29:31 -- nvmf/common.sh@123 -- # set -e 00:23:59.628 20:29:31 -- nvmf/common.sh@124 -- # return 0 00:23:59.628 20:29:31 -- nvmf/common.sh@477 -- # '[' -n 3509702 ']' 00:23:59.628 20:29:31 -- nvmf/common.sh@478 -- # killprocess 3509702 00:23:59.628 20:29:31 -- common/autotest_common.sh@926 -- # '[' -z 3509702 ']' 00:23:59.628 20:29:31 -- common/autotest_common.sh@930 -- # kill -0 3509702 00:23:59.628 20:29:31 -- common/autotest_common.sh@931 -- # uname 00:23:59.628 20:29:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:59.628 20:29:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3509702 00:23:59.628 20:29:31 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:59.628 20:29:31 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:59.628 20:29:31 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3509702' 00:23:59.628 killing process with pid 3509702 00:23:59.628 20:29:31 -- common/autotest_common.sh@945 -- # kill 3509702 00:23:59.628 [2024-07-22 20:29:31.557838] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:59.628 20:29:31 -- common/autotest_common.sh@950 -- # wait 3509702 00:23:59.887 20:29:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:59.887 20:29:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:59.887 20:29:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:59.887 20:29:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:59.887 20:29:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:59.887 20:29:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:59.887 20:29:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:59.887 20:29:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:02.422 20:29:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:02.422 00:24:02.422 real 0m9.119s 00:24:02.422 user 0m7.136s 00:24:02.422 sys 0m4.434s 00:24:02.422 20:29:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:02.422 20:29:33 -- common/autotest_common.sh@10 -- # set +x 00:24:02.422 ************************************ 00:24:02.422 END TEST nvmf_aer 00:24:02.422 ************************************ 00:24:02.422 20:29:33 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:24:02.422 20:29:33 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:02.422 20:29:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:02.422 20:29:33 -- common/autotest_common.sh@10 -- # set +x 00:24:02.422 ************************************ 00:24:02.422 START TEST nvmf_async_init 00:24:02.422 ************************************ 00:24:02.422 20:29:33 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:24:02.422 * Looking for test storage... 00:24:02.422 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:02.422 20:29:33 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:02.422 20:29:33 -- nvmf/common.sh@7 -- # uname -s 00:24:02.422 20:29:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:02.422 20:29:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:02.422 20:29:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:02.422 20:29:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:02.422 20:29:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:02.422 20:29:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:02.422 20:29:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:02.422 20:29:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:02.422 20:29:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:02.422 20:29:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:02.422 20:29:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:24:02.422 20:29:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:24:02.422 20:29:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:02.422 20:29:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:02.422 20:29:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:02.422 20:29:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:02.422 20:29:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:02.422 20:29:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:02.422 20:29:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:02.422 20:29:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:02.422 20:29:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:02.422 20:29:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:02.422 20:29:33 -- paths/export.sh@5 -- # export PATH 00:24:02.422 20:29:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:02.422 20:29:33 -- nvmf/common.sh@46 -- # : 0 00:24:02.422 20:29:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:02.422 20:29:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:02.422 20:29:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:02.422 20:29:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:02.422 20:29:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:02.423 20:29:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:02.423 20:29:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:02.423 20:29:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:02.423 20:29:33 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:24:02.423 20:29:33 -- host/async_init.sh@14 -- # null_block_size=512 00:24:02.423 20:29:33 -- host/async_init.sh@15 -- # null_bdev=null0 00:24:02.423 20:29:33 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:24:02.423 20:29:33 -- host/async_init.sh@20 -- # uuidgen 00:24:02.423 20:29:33 -- host/async_init.sh@20 -- # tr -d - 00:24:02.423 20:29:33 -- host/async_init.sh@20 -- # nguid=872ad103adeb42e18e0668d25757bb50 00:24:02.423 20:29:33 -- host/async_init.sh@22 -- # nvmftestinit 00:24:02.423 20:29:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:02.423 20:29:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:02.423 20:29:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:02.423 20:29:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:02.423 20:29:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:02.423 20:29:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:02.423 20:29:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:02.423 20:29:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:02.423 20:29:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:02.423 20:29:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:02.423 20:29:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:02.423 20:29:33 -- common/autotest_common.sh@10 -- # set +x 00:24:07.695 20:29:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:07.695 20:29:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:07.695 20:29:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:07.695 20:29:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:07.695 20:29:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:07.695 20:29:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:07.696 20:29:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:07.696 20:29:38 -- nvmf/common.sh@294 -- # net_devs=() 00:24:07.696 20:29:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:07.696 20:29:38 -- nvmf/common.sh@295 -- # e810=() 00:24:07.696 20:29:38 -- nvmf/common.sh@295 -- # local -ga e810 00:24:07.696 20:29:38 -- nvmf/common.sh@296 -- # x722=() 00:24:07.696 20:29:38 -- nvmf/common.sh@296 -- # local -ga x722 00:24:07.696 20:29:38 -- nvmf/common.sh@297 -- # mlx=() 00:24:07.696 20:29:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:07.696 20:29:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:07.696 20:29:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:07.696 20:29:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:07.696 20:29:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:07.696 20:29:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:07.696 20:29:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:24:07.696 Found 0000:86:00.0 (0x8086 - 0x159b) 00:24:07.696 20:29:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:07.696 20:29:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:24:07.696 Found 0000:86:00.1 (0x8086 - 0x159b) 00:24:07.696 20:29:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:07.696 20:29:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:07.696 20:29:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:07.696 20:29:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:07.696 20:29:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:07.696 20:29:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:24:07.696 Found net devices under 0000:86:00.0: cvl_0_0 00:24:07.696 20:29:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:07.696 20:29:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:07.696 20:29:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:07.696 20:29:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:07.696 20:29:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:07.696 20:29:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:24:07.696 Found net devices under 0000:86:00.1: cvl_0_1 00:24:07.696 20:29:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:07.696 20:29:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:07.696 20:29:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:07.696 20:29:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:07.696 20:29:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:07.696 20:29:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:07.696 20:29:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:07.696 20:29:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:07.696 20:29:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:07.696 20:29:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:07.696 20:29:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:07.696 20:29:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:07.696 20:29:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:07.696 20:29:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:07.696 20:29:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:07.696 20:29:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:07.696 20:29:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:07.696 20:29:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:07.696 20:29:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:07.696 20:29:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:07.696 20:29:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:07.696 20:29:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:07.696 20:29:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:07.696 20:29:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:07.696 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:07.696 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:24:07.696 00:24:07.696 --- 10.0.0.2 ping statistics --- 00:24:07.696 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:07.696 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:24:07.696 20:29:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:07.696 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:07.696 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.198 ms 00:24:07.696 00:24:07.696 --- 10.0.0.1 ping statistics --- 00:24:07.696 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:07.696 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:24:07.696 20:29:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:07.696 20:29:38 -- nvmf/common.sh@410 -- # return 0 00:24:07.696 20:29:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:07.696 20:29:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:07.696 20:29:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:07.696 20:29:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:07.696 20:29:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:07.696 20:29:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:07.696 20:29:38 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:24:07.696 20:29:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:07.696 20:29:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:07.696 20:29:38 -- common/autotest_common.sh@10 -- # set +x 00:24:07.696 20:29:38 -- nvmf/common.sh@469 -- # nvmfpid=3513272 00:24:07.696 20:29:38 -- nvmf/common.sh@470 -- # waitforlisten 3513272 00:24:07.696 20:29:38 -- common/autotest_common.sh@819 -- # '[' -z 3513272 ']' 00:24:07.696 20:29:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:07.696 20:29:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:07.696 20:29:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:07.696 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:07.696 20:29:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:07.696 20:29:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:24:07.696 20:29:38 -- common/autotest_common.sh@10 -- # set +x 00:24:07.696 [2024-07-22 20:29:39.031802] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:24:07.696 [2024-07-22 20:29:39.031844] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:07.696 EAL: No free 2048 kB hugepages reported on node 1 00:24:07.696 [2024-07-22 20:29:39.087530] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:07.696 [2024-07-22 20:29:39.164636] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:07.696 [2024-07-22 20:29:39.164740] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:07.696 [2024-07-22 20:29:39.164747] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:07.696 [2024-07-22 20:29:39.164753] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:07.696 [2024-07-22 20:29:39.164769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:07.956 20:29:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:07.956 20:29:39 -- common/autotest_common.sh@852 -- # return 0 00:24:07.956 20:29:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:07.956 20:29:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:07.956 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:24:07.956 20:29:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:07.956 20:29:39 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:24:07.956 20:29:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:07.956 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:24:07.956 [2024-07-22 20:29:39.870528] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:07.956 20:29:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:07.956 20:29:39 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:24:07.956 20:29:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:07.956 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:24:07.956 null0 00:24:07.956 20:29:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:07.956 20:29:39 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:24:07.956 20:29:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:07.956 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:24:07.956 20:29:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:07.956 20:29:39 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:24:07.956 20:29:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:07.956 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:24:08.216 20:29:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.216 20:29:39 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 872ad103adeb42e18e0668d25757bb50 00:24:08.216 20:29:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.216 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:24:08.216 20:29:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.216 20:29:39 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:24:08.216 20:29:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.216 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:24:08.216 [2024-07-22 20:29:39.910722] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:08.216 20:29:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.216 20:29:39 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:24:08.216 20:29:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.216 20:29:39 -- common/autotest_common.sh@10 -- # set +x 00:24:08.216 nvme0n1 00:24:08.216 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.216 20:29:40 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:08.216 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.216 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.216 [ 00:24:08.216 { 00:24:08.216 "name": "nvme0n1", 00:24:08.216 "aliases": [ 00:24:08.216 "872ad103-adeb-42e1-8e06-68d25757bb50" 00:24:08.216 ], 00:24:08.216 "product_name": "NVMe disk", 00:24:08.216 "block_size": 512, 00:24:08.216 "num_blocks": 2097152, 00:24:08.216 "uuid": "872ad103-adeb-42e1-8e06-68d25757bb50", 00:24:08.216 "assigned_rate_limits": { 00:24:08.216 "rw_ios_per_sec": 0, 00:24:08.216 "rw_mbytes_per_sec": 0, 00:24:08.216 "r_mbytes_per_sec": 0, 00:24:08.216 "w_mbytes_per_sec": 0 00:24:08.216 }, 00:24:08.216 "claimed": false, 00:24:08.216 "zoned": false, 00:24:08.216 "supported_io_types": { 00:24:08.216 "read": true, 00:24:08.216 "write": true, 00:24:08.216 "unmap": false, 00:24:08.216 "write_zeroes": true, 00:24:08.216 "flush": true, 00:24:08.216 "reset": true, 00:24:08.216 "compare": true, 00:24:08.216 "compare_and_write": true, 00:24:08.216 "abort": true, 00:24:08.216 "nvme_admin": true, 00:24:08.216 "nvme_io": true 00:24:08.216 }, 00:24:08.216 "driver_specific": { 00:24:08.216 "nvme": [ 00:24:08.216 { 00:24:08.216 "trid": { 00:24:08.216 "trtype": "TCP", 00:24:08.216 "adrfam": "IPv4", 00:24:08.216 "traddr": "10.0.0.2", 00:24:08.476 "trsvcid": "4420", 00:24:08.476 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:08.476 }, 00:24:08.476 "ctrlr_data": { 00:24:08.476 "cntlid": 1, 00:24:08.476 "vendor_id": "0x8086", 00:24:08.476 "model_number": "SPDK bdev Controller", 00:24:08.476 "serial_number": "00000000000000000000", 00:24:08.476 "firmware_revision": "24.01.1", 00:24:08.476 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:08.476 "oacs": { 00:24:08.476 "security": 0, 00:24:08.476 "format": 0, 00:24:08.476 "firmware": 0, 00:24:08.476 "ns_manage": 0 00:24:08.476 }, 00:24:08.476 "multi_ctrlr": true, 00:24:08.476 "ana_reporting": false 00:24:08.476 }, 00:24:08.476 "vs": { 00:24:08.476 "nvme_version": "1.3" 00:24:08.476 }, 00:24:08.476 "ns_data": { 00:24:08.476 "id": 1, 00:24:08.476 "can_share": true 00:24:08.476 } 00:24:08.476 } 00:24:08.476 ], 00:24:08.476 "mp_policy": "active_passive" 00:24:08.476 } 00:24:08.476 } 00:24:08.476 ] 00:24:08.476 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.476 20:29:40 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:24:08.476 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.476 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.476 [2024-07-22 20:29:40.159267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:08.476 [2024-07-22 20:29:40.159323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b8b2b0 (9): Bad file descriptor 00:24:08.476 [2024-07-22 20:29:40.291115] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:08.476 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.476 20:29:40 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:08.476 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.476 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.476 [ 00:24:08.476 { 00:24:08.476 "name": "nvme0n1", 00:24:08.476 "aliases": [ 00:24:08.476 "872ad103-adeb-42e1-8e06-68d25757bb50" 00:24:08.476 ], 00:24:08.476 "product_name": "NVMe disk", 00:24:08.476 "block_size": 512, 00:24:08.476 "num_blocks": 2097152, 00:24:08.476 "uuid": "872ad103-adeb-42e1-8e06-68d25757bb50", 00:24:08.476 "assigned_rate_limits": { 00:24:08.476 "rw_ios_per_sec": 0, 00:24:08.476 "rw_mbytes_per_sec": 0, 00:24:08.476 "r_mbytes_per_sec": 0, 00:24:08.476 "w_mbytes_per_sec": 0 00:24:08.476 }, 00:24:08.476 "claimed": false, 00:24:08.476 "zoned": false, 00:24:08.476 "supported_io_types": { 00:24:08.476 "read": true, 00:24:08.476 "write": true, 00:24:08.476 "unmap": false, 00:24:08.476 "write_zeroes": true, 00:24:08.476 "flush": true, 00:24:08.476 "reset": true, 00:24:08.476 "compare": true, 00:24:08.476 "compare_and_write": true, 00:24:08.476 "abort": true, 00:24:08.476 "nvme_admin": true, 00:24:08.476 "nvme_io": true 00:24:08.476 }, 00:24:08.476 "driver_specific": { 00:24:08.476 "nvme": [ 00:24:08.476 { 00:24:08.476 "trid": { 00:24:08.476 "trtype": "TCP", 00:24:08.476 "adrfam": "IPv4", 00:24:08.476 "traddr": "10.0.0.2", 00:24:08.476 "trsvcid": "4420", 00:24:08.476 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:08.476 }, 00:24:08.476 "ctrlr_data": { 00:24:08.476 "cntlid": 2, 00:24:08.476 "vendor_id": "0x8086", 00:24:08.476 "model_number": "SPDK bdev Controller", 00:24:08.476 "serial_number": "00000000000000000000", 00:24:08.476 "firmware_revision": "24.01.1", 00:24:08.476 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:08.476 "oacs": { 00:24:08.476 "security": 0, 00:24:08.476 "format": 0, 00:24:08.476 "firmware": 0, 00:24:08.476 "ns_manage": 0 00:24:08.476 }, 00:24:08.476 "multi_ctrlr": true, 00:24:08.476 "ana_reporting": false 00:24:08.476 }, 00:24:08.476 "vs": { 00:24:08.476 "nvme_version": "1.3" 00:24:08.476 }, 00:24:08.476 "ns_data": { 00:24:08.476 "id": 1, 00:24:08.476 "can_share": true 00:24:08.476 } 00:24:08.476 } 00:24:08.476 ], 00:24:08.476 "mp_policy": "active_passive" 00:24:08.476 } 00:24:08.476 } 00:24:08.476 ] 00:24:08.476 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.476 20:29:40 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:08.476 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.476 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.476 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.476 20:29:40 -- host/async_init.sh@53 -- # mktemp 00:24:08.476 20:29:40 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.eiLU5DMoyM 00:24:08.476 20:29:40 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:24:08.476 20:29:40 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.eiLU5DMoyM 00:24:08.476 20:29:40 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:24:08.476 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.476 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.476 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.476 20:29:40 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:24:08.476 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.476 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.476 [2024-07-22 20:29:40.339850] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:24:08.476 [2024-07-22 20:29:40.339953] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:08.476 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.476 20:29:40 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.eiLU5DMoyM 00:24:08.476 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.476 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.476 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.476 20:29:40 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.eiLU5DMoyM 00:24:08.477 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.477 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.477 [2024-07-22 20:29:40.355891] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:24:08.737 nvme0n1 00:24:08.737 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.737 20:29:40 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:08.737 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.737 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.737 [ 00:24:08.737 { 00:24:08.737 "name": "nvme0n1", 00:24:08.737 "aliases": [ 00:24:08.737 "872ad103-adeb-42e1-8e06-68d25757bb50" 00:24:08.737 ], 00:24:08.737 "product_name": "NVMe disk", 00:24:08.737 "block_size": 512, 00:24:08.737 "num_blocks": 2097152, 00:24:08.737 "uuid": "872ad103-adeb-42e1-8e06-68d25757bb50", 00:24:08.737 "assigned_rate_limits": { 00:24:08.737 "rw_ios_per_sec": 0, 00:24:08.737 "rw_mbytes_per_sec": 0, 00:24:08.737 "r_mbytes_per_sec": 0, 00:24:08.737 "w_mbytes_per_sec": 0 00:24:08.737 }, 00:24:08.737 "claimed": false, 00:24:08.737 "zoned": false, 00:24:08.737 "supported_io_types": { 00:24:08.737 "read": true, 00:24:08.737 "write": true, 00:24:08.737 "unmap": false, 00:24:08.737 "write_zeroes": true, 00:24:08.737 "flush": true, 00:24:08.737 "reset": true, 00:24:08.737 "compare": true, 00:24:08.737 "compare_and_write": true, 00:24:08.737 "abort": true, 00:24:08.737 "nvme_admin": true, 00:24:08.737 "nvme_io": true 00:24:08.737 }, 00:24:08.737 "driver_specific": { 00:24:08.737 "nvme": [ 00:24:08.737 { 00:24:08.737 "trid": { 00:24:08.737 "trtype": "TCP", 00:24:08.737 "adrfam": "IPv4", 00:24:08.737 "traddr": "10.0.0.2", 00:24:08.737 "trsvcid": "4421", 00:24:08.737 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:08.737 }, 00:24:08.737 "ctrlr_data": { 00:24:08.737 "cntlid": 3, 00:24:08.737 "vendor_id": "0x8086", 00:24:08.737 "model_number": "SPDK bdev Controller", 00:24:08.737 "serial_number": "00000000000000000000", 00:24:08.737 "firmware_revision": "24.01.1", 00:24:08.737 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:08.737 "oacs": { 00:24:08.737 "security": 0, 00:24:08.737 "format": 0, 00:24:08.737 "firmware": 0, 00:24:08.737 "ns_manage": 0 00:24:08.737 }, 00:24:08.737 "multi_ctrlr": true, 00:24:08.737 "ana_reporting": false 00:24:08.737 }, 00:24:08.737 "vs": { 00:24:08.737 "nvme_version": "1.3" 00:24:08.737 }, 00:24:08.737 "ns_data": { 00:24:08.737 "id": 1, 00:24:08.737 "can_share": true 00:24:08.737 } 00:24:08.737 } 00:24:08.737 ], 00:24:08.737 "mp_policy": "active_passive" 00:24:08.737 } 00:24:08.737 } 00:24:08.737 ] 00:24:08.737 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.737 20:29:40 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:08.737 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:08.737 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:24:08.737 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:08.737 20:29:40 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.eiLU5DMoyM 00:24:08.737 20:29:40 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:24:08.737 20:29:40 -- host/async_init.sh@78 -- # nvmftestfini 00:24:08.737 20:29:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:08.737 20:29:40 -- nvmf/common.sh@116 -- # sync 00:24:08.737 20:29:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:08.737 20:29:40 -- nvmf/common.sh@119 -- # set +e 00:24:08.737 20:29:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:08.737 20:29:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:08.737 rmmod nvme_tcp 00:24:08.737 rmmod nvme_fabrics 00:24:08.737 rmmod nvme_keyring 00:24:08.737 20:29:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:08.737 20:29:40 -- nvmf/common.sh@123 -- # set -e 00:24:08.737 20:29:40 -- nvmf/common.sh@124 -- # return 0 00:24:08.737 20:29:40 -- nvmf/common.sh@477 -- # '[' -n 3513272 ']' 00:24:08.737 20:29:40 -- nvmf/common.sh@478 -- # killprocess 3513272 00:24:08.737 20:29:40 -- common/autotest_common.sh@926 -- # '[' -z 3513272 ']' 00:24:08.737 20:29:40 -- common/autotest_common.sh@930 -- # kill -0 3513272 00:24:08.737 20:29:40 -- common/autotest_common.sh@931 -- # uname 00:24:08.737 20:29:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:08.737 20:29:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3513272 00:24:08.737 20:29:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:08.737 20:29:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:08.737 20:29:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3513272' 00:24:08.737 killing process with pid 3513272 00:24:08.737 20:29:40 -- common/autotest_common.sh@945 -- # kill 3513272 00:24:08.737 20:29:40 -- common/autotest_common.sh@950 -- # wait 3513272 00:24:08.997 20:29:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:08.997 20:29:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:08.997 20:29:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:08.997 20:29:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:08.997 20:29:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:08.997 20:29:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:08.997 20:29:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:08.997 20:29:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:10.904 20:29:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:10.904 00:24:10.904 real 0m8.938s 00:24:10.904 user 0m3.246s 00:24:10.904 sys 0m4.138s 00:24:10.904 20:29:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:10.904 20:29:42 -- common/autotest_common.sh@10 -- # set +x 00:24:10.904 ************************************ 00:24:10.904 END TEST nvmf_async_init 00:24:10.904 ************************************ 00:24:10.904 20:29:42 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:24:10.904 20:29:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:10.904 20:29:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:10.904 20:29:42 -- common/autotest_common.sh@10 -- # set +x 00:24:11.164 ************************************ 00:24:11.164 START TEST dma 00:24:11.164 ************************************ 00:24:11.164 20:29:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:24:11.164 * Looking for test storage... 00:24:11.164 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:11.164 20:29:42 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:11.164 20:29:42 -- nvmf/common.sh@7 -- # uname -s 00:24:11.164 20:29:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:11.164 20:29:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:11.164 20:29:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:11.164 20:29:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:11.164 20:29:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:11.164 20:29:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:11.164 20:29:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:11.164 20:29:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:11.164 20:29:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:11.164 20:29:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:11.164 20:29:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:24:11.164 20:29:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:24:11.164 20:29:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:11.164 20:29:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:11.164 20:29:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:11.164 20:29:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:11.164 20:29:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:11.164 20:29:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:11.165 20:29:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:11.165 20:29:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:11.165 20:29:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:11.165 20:29:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:11.165 20:29:42 -- paths/export.sh@5 -- # export PATH 00:24:11.165 20:29:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:11.165 20:29:42 -- nvmf/common.sh@46 -- # : 0 00:24:11.165 20:29:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:11.165 20:29:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:11.165 20:29:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:11.165 20:29:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:11.165 20:29:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:11.165 20:29:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:11.165 20:29:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:11.165 20:29:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:11.165 20:29:42 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:24:11.165 20:29:42 -- host/dma.sh@13 -- # exit 0 00:24:11.165 00:24:11.165 real 0m0.084s 00:24:11.165 user 0m0.036s 00:24:11.165 sys 0m0.055s 00:24:11.165 20:29:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:11.165 20:29:42 -- common/autotest_common.sh@10 -- # set +x 00:24:11.165 ************************************ 00:24:11.165 END TEST dma 00:24:11.165 ************************************ 00:24:11.165 20:29:42 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:24:11.165 20:29:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:11.165 20:29:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:11.165 20:29:42 -- common/autotest_common.sh@10 -- # set +x 00:24:11.165 ************************************ 00:24:11.165 START TEST nvmf_identify 00:24:11.165 ************************************ 00:24:11.165 20:29:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:24:11.165 * Looking for test storage... 00:24:11.165 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:11.165 20:29:43 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:11.165 20:29:43 -- nvmf/common.sh@7 -- # uname -s 00:24:11.165 20:29:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:11.165 20:29:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:11.165 20:29:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:11.165 20:29:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:11.165 20:29:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:11.165 20:29:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:11.165 20:29:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:11.165 20:29:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:11.165 20:29:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:11.165 20:29:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:11.165 20:29:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:24:11.165 20:29:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:24:11.165 20:29:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:11.165 20:29:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:11.165 20:29:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:11.165 20:29:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:11.165 20:29:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:11.165 20:29:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:11.165 20:29:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:11.165 20:29:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:11.165 20:29:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:11.165 20:29:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:11.165 20:29:43 -- paths/export.sh@5 -- # export PATH 00:24:11.165 20:29:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:11.165 20:29:43 -- nvmf/common.sh@46 -- # : 0 00:24:11.165 20:29:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:11.165 20:29:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:11.165 20:29:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:11.165 20:29:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:11.165 20:29:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:11.165 20:29:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:11.165 20:29:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:11.165 20:29:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:11.165 20:29:43 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:11.165 20:29:43 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:11.165 20:29:43 -- host/identify.sh@14 -- # nvmftestinit 00:24:11.165 20:29:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:11.165 20:29:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:11.165 20:29:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:11.165 20:29:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:11.165 20:29:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:11.165 20:29:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:11.165 20:29:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:11.165 20:29:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:11.165 20:29:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:11.165 20:29:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:11.165 20:29:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:11.165 20:29:43 -- common/autotest_common.sh@10 -- # set +x 00:24:17.740 20:29:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:17.740 20:29:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:17.740 20:29:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:17.740 20:29:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:17.740 20:29:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:17.740 20:29:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:17.740 20:29:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:17.740 20:29:48 -- nvmf/common.sh@294 -- # net_devs=() 00:24:17.740 20:29:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:17.740 20:29:48 -- nvmf/common.sh@295 -- # e810=() 00:24:17.740 20:29:48 -- nvmf/common.sh@295 -- # local -ga e810 00:24:17.740 20:29:48 -- nvmf/common.sh@296 -- # x722=() 00:24:17.740 20:29:48 -- nvmf/common.sh@296 -- # local -ga x722 00:24:17.740 20:29:48 -- nvmf/common.sh@297 -- # mlx=() 00:24:17.740 20:29:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:17.740 20:29:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:17.740 20:29:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:17.740 20:29:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:17.740 20:29:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:17.741 20:29:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:17.741 20:29:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:17.741 20:29:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:17.741 20:29:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:17.741 20:29:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:17.741 20:29:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:17.741 20:29:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:17.741 20:29:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:17.741 20:29:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:17.741 20:29:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:17.741 20:29:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:17.741 20:29:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:24:17.741 Found 0000:86:00.0 (0x8086 - 0x159b) 00:24:17.741 20:29:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:17.741 20:29:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:24:17.741 Found 0000:86:00.1 (0x8086 - 0x159b) 00:24:17.741 20:29:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:17.741 20:29:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:17.741 20:29:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:17.741 20:29:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:17.741 20:29:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:17.741 20:29:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:24:17.741 Found net devices under 0000:86:00.0: cvl_0_0 00:24:17.741 20:29:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:17.741 20:29:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:17.741 20:29:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:17.741 20:29:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:17.741 20:29:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:17.741 20:29:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:24:17.741 Found net devices under 0000:86:00.1: cvl_0_1 00:24:17.741 20:29:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:17.741 20:29:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:17.741 20:29:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:17.741 20:29:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:17.741 20:29:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:17.741 20:29:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:17.741 20:29:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:17.741 20:29:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:17.741 20:29:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:17.741 20:29:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:17.741 20:29:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:17.741 20:29:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:17.741 20:29:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:17.741 20:29:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:17.741 20:29:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:17.741 20:29:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:17.741 20:29:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:17.741 20:29:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:17.741 20:29:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:17.741 20:29:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:17.741 20:29:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:17.741 20:29:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:17.741 20:29:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:17.741 20:29:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:17.741 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:17.741 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:24:17.741 00:24:17.741 --- 10.0.0.2 ping statistics --- 00:24:17.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:17.741 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:24:17.741 20:29:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:17.741 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:17.741 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.241 ms 00:24:17.741 00:24:17.741 --- 10.0.0.1 ping statistics --- 00:24:17.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:17.741 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:24:17.741 20:29:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:17.741 20:29:48 -- nvmf/common.sh@410 -- # return 0 00:24:17.741 20:29:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:17.741 20:29:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:17.741 20:29:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:17.741 20:29:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:17.741 20:29:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:17.741 20:29:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:17.741 20:29:48 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:24:17.741 20:29:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:17.741 20:29:48 -- common/autotest_common.sh@10 -- # set +x 00:24:17.741 20:29:48 -- host/identify.sh@19 -- # nvmfpid=3517090 00:24:17.741 20:29:48 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:17.741 20:29:48 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:17.741 20:29:48 -- host/identify.sh@23 -- # waitforlisten 3517090 00:24:17.741 20:29:48 -- common/autotest_common.sh@819 -- # '[' -z 3517090 ']' 00:24:17.741 20:29:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:17.741 20:29:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:17.741 20:29:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:17.741 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:17.741 20:29:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:17.741 20:29:48 -- common/autotest_common.sh@10 -- # set +x 00:24:17.741 [2024-07-22 20:29:48.758952] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:24:17.741 [2024-07-22 20:29:48.758996] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:17.741 EAL: No free 2048 kB hugepages reported on node 1 00:24:17.741 [2024-07-22 20:29:48.818329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:17.741 [2024-07-22 20:29:48.890883] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:17.741 [2024-07-22 20:29:48.890997] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:17.741 [2024-07-22 20:29:48.891004] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:17.741 [2024-07-22 20:29:48.891011] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:17.741 [2024-07-22 20:29:48.891101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:17.741 [2024-07-22 20:29:48.891119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:17.741 [2024-07-22 20:29:48.891205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:17.741 [2024-07-22 20:29:48.891206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:17.741 20:29:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:17.741 20:29:49 -- common/autotest_common.sh@852 -- # return 0 00:24:17.741 20:29:49 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:17.741 20:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:17.741 20:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:17.741 [2024-07-22 20:29:49.569245] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:17.741 20:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:17.741 20:29:49 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:24:17.741 20:29:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:17.741 20:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:17.741 20:29:49 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:17.741 20:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:17.741 20:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:17.741 Malloc0 00:24:17.741 20:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:17.741 20:29:49 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:17.741 20:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:17.741 20:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:17.741 20:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:17.741 20:29:49 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:24:17.741 20:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:17.741 20:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:17.741 20:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:17.741 20:29:49 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:17.741 20:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:17.741 20:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:17.742 [2024-07-22 20:29:49.653052] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:17.742 20:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:17.742 20:29:49 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:17.742 20:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:17.742 20:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:17.742 20:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:17.742 20:29:49 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:24:17.742 20:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:17.742 20:29:49 -- common/autotest_common.sh@10 -- # set +x 00:24:17.742 [2024-07-22 20:29:49.668876] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:24:17.742 [ 00:24:17.742 { 00:24:17.742 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:24:17.742 "subtype": "Discovery", 00:24:17.742 "listen_addresses": [ 00:24:17.742 { 00:24:17.742 "transport": "TCP", 00:24:17.742 "trtype": "TCP", 00:24:17.742 "adrfam": "IPv4", 00:24:17.742 "traddr": "10.0.0.2", 00:24:17.742 "trsvcid": "4420" 00:24:17.742 } 00:24:17.742 ], 00:24:17.742 "allow_any_host": true, 00:24:17.742 "hosts": [] 00:24:17.742 }, 00:24:17.742 { 00:24:17.742 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:24:17.742 "subtype": "NVMe", 00:24:17.742 "listen_addresses": [ 00:24:17.742 { 00:24:17.742 "transport": "TCP", 00:24:17.742 "trtype": "TCP", 00:24:17.742 "adrfam": "IPv4", 00:24:17.742 "traddr": "10.0.0.2", 00:24:17.742 "trsvcid": "4420" 00:24:17.742 } 00:24:17.742 ], 00:24:17.742 "allow_any_host": true, 00:24:17.742 "hosts": [], 00:24:17.742 "serial_number": "SPDK00000000000001", 00:24:17.742 "model_number": "SPDK bdev Controller", 00:24:17.742 "max_namespaces": 32, 00:24:17.742 "min_cntlid": 1, 00:24:17.742 "max_cntlid": 65519, 00:24:17.742 "namespaces": [ 00:24:17.742 { 00:24:17.742 "nsid": 1, 00:24:18.004 "bdev_name": "Malloc0", 00:24:18.004 "name": "Malloc0", 00:24:18.004 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:24:18.004 "eui64": "ABCDEF0123456789", 00:24:18.004 "uuid": "9748a3e4-3478-410a-89cb-b78cfa631d70" 00:24:18.004 } 00:24:18.004 ] 00:24:18.004 } 00:24:18.004 ] 00:24:18.004 20:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:18.004 20:29:49 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:24:18.005 [2024-07-22 20:29:49.703052] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:24:18.005 [2024-07-22 20:29:49.703083] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3517241 ] 00:24:18.005 EAL: No free 2048 kB hugepages reported on node 1 00:24:18.005 [2024-07-22 20:29:49.731610] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:24:18.005 [2024-07-22 20:29:49.731656] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:24:18.005 [2024-07-22 20:29:49.731661] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:24:18.005 [2024-07-22 20:29:49.731672] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:24:18.005 [2024-07-22 20:29:49.731679] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:24:18.005 [2024-07-22 20:29:49.732183] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:24:18.005 [2024-07-22 20:29:49.732217] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x127e9e0 0 00:24:18.005 [2024-07-22 20:29:49.747057] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:24:18.005 [2024-07-22 20:29:49.747073] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:24:18.005 [2024-07-22 20:29:49.747077] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:24:18.005 [2024-07-22 20:29:49.747080] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:24:18.005 [2024-07-22 20:29:49.747117] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.747123] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.747126] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.005 [2024-07-22 20:29:49.747140] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:24:18.005 [2024-07-22 20:29:49.747158] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.005 [2024-07-22 20:29:49.755052] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.005 [2024-07-22 20:29:49.755061] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.005 [2024-07-22 20:29:49.755064] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755068] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.005 [2024-07-22 20:29:49.755078] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:24:18.005 [2024-07-22 20:29:49.755083] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:24:18.005 [2024-07-22 20:29:49.755088] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:24:18.005 [2024-07-22 20:29:49.755099] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755103] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755105] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.005 [2024-07-22 20:29:49.755112] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.005 [2024-07-22 20:29:49.755124] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.005 [2024-07-22 20:29:49.755351] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.005 [2024-07-22 20:29:49.755362] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.005 [2024-07-22 20:29:49.755365] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755369] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.005 [2024-07-22 20:29:49.755375] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:24:18.005 [2024-07-22 20:29:49.755384] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:24:18.005 [2024-07-22 20:29:49.755392] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755396] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755399] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.005 [2024-07-22 20:29:49.755406] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.005 [2024-07-22 20:29:49.755419] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.005 [2024-07-22 20:29:49.755537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.005 [2024-07-22 20:29:49.755545] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.005 [2024-07-22 20:29:49.755548] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755551] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.005 [2024-07-22 20:29:49.755558] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:24:18.005 [2024-07-22 20:29:49.755565] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:24:18.005 [2024-07-22 20:29:49.755572] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755575] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755579] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.005 [2024-07-22 20:29:49.755585] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.005 [2024-07-22 20:29:49.755600] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.005 [2024-07-22 20:29:49.755724] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.005 [2024-07-22 20:29:49.755731] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.005 [2024-07-22 20:29:49.755734] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755737] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.005 [2024-07-22 20:29:49.755743] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:24:18.005 [2024-07-22 20:29:49.755753] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755757] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755760] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.005 [2024-07-22 20:29:49.755766] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.005 [2024-07-22 20:29:49.755778] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.005 [2024-07-22 20:29:49.755902] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.005 [2024-07-22 20:29:49.755910] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.005 [2024-07-22 20:29:49.755913] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.755916] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.005 [2024-07-22 20:29:49.755921] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:24:18.005 [2024-07-22 20:29:49.755926] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:24:18.005 [2024-07-22 20:29:49.755933] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:24:18.005 [2024-07-22 20:29:49.756038] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:24:18.005 [2024-07-22 20:29:49.756052] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:24:18.005 [2024-07-22 20:29:49.756062] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.756065] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.756069] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.005 [2024-07-22 20:29:49.756075] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.005 [2024-07-22 20:29:49.756087] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.005 [2024-07-22 20:29:49.756201] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.005 [2024-07-22 20:29:49.756209] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.005 [2024-07-22 20:29:49.756211] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.756215] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.005 [2024-07-22 20:29:49.756220] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:24:18.005 [2024-07-22 20:29:49.756230] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.756233] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.756236] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.005 [2024-07-22 20:29:49.756246] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.005 [2024-07-22 20:29:49.756258] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.005 [2024-07-22 20:29:49.756383] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.005 [2024-07-22 20:29:49.756390] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.005 [2024-07-22 20:29:49.756393] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.756396] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.005 [2024-07-22 20:29:49.756402] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:24:18.005 [2024-07-22 20:29:49.756406] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:24:18.005 [2024-07-22 20:29:49.756413] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:24:18.005 [2024-07-22 20:29:49.756421] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:24:18.005 [2024-07-22 20:29:49.756430] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.756433] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.005 [2024-07-22 20:29:49.756436] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.756443] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.006 [2024-07-22 20:29:49.756455] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.006 [2024-07-22 20:29:49.756593] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.006 [2024-07-22 20:29:49.756600] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.006 [2024-07-22 20:29:49.756603] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.756607] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x127e9e0): datao=0, datal=4096, cccid=0 00:24:18.006 [2024-07-22 20:29:49.756611] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12e6730) on tqpair(0x127e9e0): expected_datao=0, payload_size=4096 00:24:18.006 [2024-07-22 20:29:49.756787] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.756791] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.756884] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.006 [2024-07-22 20:29:49.756891] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.006 [2024-07-22 20:29:49.756894] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.756897] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.006 [2024-07-22 20:29:49.756906] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:24:18.006 [2024-07-22 20:29:49.756910] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:24:18.006 [2024-07-22 20:29:49.756914] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:24:18.006 [2024-07-22 20:29:49.756918] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:24:18.006 [2024-07-22 20:29:49.756923] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:24:18.006 [2024-07-22 20:29:49.756927] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:24:18.006 [2024-07-22 20:29:49.756942] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:24:18.006 [2024-07-22 20:29:49.756949] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.756953] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.756956] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.756963] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:24:18.006 [2024-07-22 20:29:49.756976] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.006 [2024-07-22 20:29:49.757108] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.006 [2024-07-22 20:29:49.757117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.006 [2024-07-22 20:29:49.757120] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6730) on tqpair=0x127e9e0 00:24:18.006 [2024-07-22 20:29:49.757131] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757135] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757138] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.757144] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.006 [2024-07-22 20:29:49.757149] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757152] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757155] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.757159] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.006 [2024-07-22 20:29:49.757164] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757170] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.757175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.006 [2024-07-22 20:29:49.757180] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757183] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757186] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.757191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.006 [2024-07-22 20:29:49.757195] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:24:18.006 [2024-07-22 20:29:49.757207] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:24:18.006 [2024-07-22 20:29:49.757213] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757216] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757219] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.757225] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.006 [2024-07-22 20:29:49.757238] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6730, cid 0, qid 0 00:24:18.006 [2024-07-22 20:29:49.757245] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6890, cid 1, qid 0 00:24:18.006 [2024-07-22 20:29:49.757249] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e69f0, cid 2, qid 0 00:24:18.006 [2024-07-22 20:29:49.757252] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.006 [2024-07-22 20:29:49.757256] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6cb0, cid 4, qid 0 00:24:18.006 [2024-07-22 20:29:49.757415] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.006 [2024-07-22 20:29:49.757423] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.006 [2024-07-22 20:29:49.757426] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757429] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6cb0) on tqpair=0x127e9e0 00:24:18.006 [2024-07-22 20:29:49.757435] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:24:18.006 [2024-07-22 20:29:49.757441] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:24:18.006 [2024-07-22 20:29:49.757452] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757456] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757459] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.757465] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.006 [2024-07-22 20:29:49.757476] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6cb0, cid 4, qid 0 00:24:18.006 [2024-07-22 20:29:49.757610] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.006 [2024-07-22 20:29:49.757619] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.006 [2024-07-22 20:29:49.757622] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757625] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x127e9e0): datao=0, datal=4096, cccid=4 00:24:18.006 [2024-07-22 20:29:49.757629] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12e6cb0) on tqpair(0x127e9e0): expected_datao=0, payload_size=4096 00:24:18.006 [2024-07-22 20:29:49.757635] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757639] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757824] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.006 [2024-07-22 20:29:49.757830] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.006 [2024-07-22 20:29:49.757832] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757836] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6cb0) on tqpair=0x127e9e0 00:24:18.006 [2024-07-22 20:29:49.757850] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:24:18.006 [2024-07-22 20:29:49.757874] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757878] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757881] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.757887] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.006 [2024-07-22 20:29:49.757893] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757896] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.757899] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x127e9e0) 00:24:18.006 [2024-07-22 20:29:49.757904] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.006 [2024-07-22 20:29:49.757921] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6cb0, cid 4, qid 0 00:24:18.006 [2024-07-22 20:29:49.757926] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6e10, cid 5, qid 0 00:24:18.006 [2024-07-22 20:29:49.758093] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.006 [2024-07-22 20:29:49.758102] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.006 [2024-07-22 20:29:49.758105] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.758108] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x127e9e0): datao=0, datal=1024, cccid=4 00:24:18.006 [2024-07-22 20:29:49.758112] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12e6cb0) on tqpair(0x127e9e0): expected_datao=0, payload_size=1024 00:24:18.006 [2024-07-22 20:29:49.758118] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.758122] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.758127] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.006 [2024-07-22 20:29:49.758131] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.006 [2024-07-22 20:29:49.758134] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.006 [2024-07-22 20:29:49.758138] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6e10) on tqpair=0x127e9e0 00:24:18.007 [2024-07-22 20:29:49.803052] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.007 [2024-07-22 20:29:49.803061] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.007 [2024-07-22 20:29:49.803064] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803068] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6cb0) on tqpair=0x127e9e0 00:24:18.007 [2024-07-22 20:29:49.803080] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803084] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803087] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x127e9e0) 00:24:18.007 [2024-07-22 20:29:49.803094] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.007 [2024-07-22 20:29:49.803111] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6cb0, cid 4, qid 0 00:24:18.007 [2024-07-22 20:29:49.803242] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.007 [2024-07-22 20:29:49.803251] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.007 [2024-07-22 20:29:49.803254] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803257] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x127e9e0): datao=0, datal=3072, cccid=4 00:24:18.007 [2024-07-22 20:29:49.803261] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12e6cb0) on tqpair(0x127e9e0): expected_datao=0, payload_size=3072 00:24:18.007 [2024-07-22 20:29:49.803268] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803271] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803462] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.007 [2024-07-22 20:29:49.803468] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.007 [2024-07-22 20:29:49.803471] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803474] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6cb0) on tqpair=0x127e9e0 00:24:18.007 [2024-07-22 20:29:49.803483] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803487] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803490] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x127e9e0) 00:24:18.007 [2024-07-22 20:29:49.803497] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.007 [2024-07-22 20:29:49.803523] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6cb0, cid 4, qid 0 00:24:18.007 [2024-07-22 20:29:49.803649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.007 [2024-07-22 20:29:49.803656] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.007 [2024-07-22 20:29:49.803660] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803663] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x127e9e0): datao=0, datal=8, cccid=4 00:24:18.007 [2024-07-22 20:29:49.803667] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12e6cb0) on tqpair(0x127e9e0): expected_datao=0, payload_size=8 00:24:18.007 [2024-07-22 20:29:49.803674] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.803677] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.844190] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.007 [2024-07-22 20:29:49.844205] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.007 [2024-07-22 20:29:49.844208] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.007 [2024-07-22 20:29:49.844212] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6cb0) on tqpair=0x127e9e0 00:24:18.007 ===================================================== 00:24:18.007 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:24:18.007 ===================================================== 00:24:18.007 Controller Capabilities/Features 00:24:18.007 ================================ 00:24:18.007 Vendor ID: 0000 00:24:18.007 Subsystem Vendor ID: 0000 00:24:18.007 Serial Number: .................... 00:24:18.007 Model Number: ........................................ 00:24:18.007 Firmware Version: 24.01.1 00:24:18.007 Recommended Arb Burst: 0 00:24:18.007 IEEE OUI Identifier: 00 00 00 00:24:18.007 Multi-path I/O 00:24:18.007 May have multiple subsystem ports: No 00:24:18.007 May have multiple controllers: No 00:24:18.007 Associated with SR-IOV VF: No 00:24:18.007 Max Data Transfer Size: 131072 00:24:18.007 Max Number of Namespaces: 0 00:24:18.007 Max Number of I/O Queues: 1024 00:24:18.007 NVMe Specification Version (VS): 1.3 00:24:18.007 NVMe Specification Version (Identify): 1.3 00:24:18.007 Maximum Queue Entries: 128 00:24:18.007 Contiguous Queues Required: Yes 00:24:18.007 Arbitration Mechanisms Supported 00:24:18.007 Weighted Round Robin: Not Supported 00:24:18.007 Vendor Specific: Not Supported 00:24:18.007 Reset Timeout: 15000 ms 00:24:18.007 Doorbell Stride: 4 bytes 00:24:18.007 NVM Subsystem Reset: Not Supported 00:24:18.007 Command Sets Supported 00:24:18.007 NVM Command Set: Supported 00:24:18.007 Boot Partition: Not Supported 00:24:18.007 Memory Page Size Minimum: 4096 bytes 00:24:18.007 Memory Page Size Maximum: 4096 bytes 00:24:18.007 Persistent Memory Region: Not Supported 00:24:18.007 Optional Asynchronous Events Supported 00:24:18.007 Namespace Attribute Notices: Not Supported 00:24:18.007 Firmware Activation Notices: Not Supported 00:24:18.007 ANA Change Notices: Not Supported 00:24:18.007 PLE Aggregate Log Change Notices: Not Supported 00:24:18.007 LBA Status Info Alert Notices: Not Supported 00:24:18.007 EGE Aggregate Log Change Notices: Not Supported 00:24:18.007 Normal NVM Subsystem Shutdown event: Not Supported 00:24:18.007 Zone Descriptor Change Notices: Not Supported 00:24:18.007 Discovery Log Change Notices: Supported 00:24:18.007 Controller Attributes 00:24:18.007 128-bit Host Identifier: Not Supported 00:24:18.007 Non-Operational Permissive Mode: Not Supported 00:24:18.007 NVM Sets: Not Supported 00:24:18.007 Read Recovery Levels: Not Supported 00:24:18.007 Endurance Groups: Not Supported 00:24:18.007 Predictable Latency Mode: Not Supported 00:24:18.007 Traffic Based Keep ALive: Not Supported 00:24:18.007 Namespace Granularity: Not Supported 00:24:18.007 SQ Associations: Not Supported 00:24:18.007 UUID List: Not Supported 00:24:18.007 Multi-Domain Subsystem: Not Supported 00:24:18.007 Fixed Capacity Management: Not Supported 00:24:18.007 Variable Capacity Management: Not Supported 00:24:18.007 Delete Endurance Group: Not Supported 00:24:18.007 Delete NVM Set: Not Supported 00:24:18.007 Extended LBA Formats Supported: Not Supported 00:24:18.007 Flexible Data Placement Supported: Not Supported 00:24:18.007 00:24:18.007 Controller Memory Buffer Support 00:24:18.007 ================================ 00:24:18.007 Supported: No 00:24:18.007 00:24:18.007 Persistent Memory Region Support 00:24:18.007 ================================ 00:24:18.007 Supported: No 00:24:18.007 00:24:18.007 Admin Command Set Attributes 00:24:18.007 ============================ 00:24:18.007 Security Send/Receive: Not Supported 00:24:18.007 Format NVM: Not Supported 00:24:18.007 Firmware Activate/Download: Not Supported 00:24:18.007 Namespace Management: Not Supported 00:24:18.007 Device Self-Test: Not Supported 00:24:18.007 Directives: Not Supported 00:24:18.007 NVMe-MI: Not Supported 00:24:18.007 Virtualization Management: Not Supported 00:24:18.007 Doorbell Buffer Config: Not Supported 00:24:18.007 Get LBA Status Capability: Not Supported 00:24:18.007 Command & Feature Lockdown Capability: Not Supported 00:24:18.007 Abort Command Limit: 1 00:24:18.007 Async Event Request Limit: 4 00:24:18.007 Number of Firmware Slots: N/A 00:24:18.007 Firmware Slot 1 Read-Only: N/A 00:24:18.007 Firmware Activation Without Reset: N/A 00:24:18.007 Multiple Update Detection Support: N/A 00:24:18.007 Firmware Update Granularity: No Information Provided 00:24:18.007 Per-Namespace SMART Log: No 00:24:18.007 Asymmetric Namespace Access Log Page: Not Supported 00:24:18.007 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:24:18.007 Command Effects Log Page: Not Supported 00:24:18.007 Get Log Page Extended Data: Supported 00:24:18.007 Telemetry Log Pages: Not Supported 00:24:18.007 Persistent Event Log Pages: Not Supported 00:24:18.007 Supported Log Pages Log Page: May Support 00:24:18.007 Commands Supported & Effects Log Page: Not Supported 00:24:18.007 Feature Identifiers & Effects Log Page:May Support 00:24:18.007 NVMe-MI Commands & Effects Log Page: May Support 00:24:18.007 Data Area 4 for Telemetry Log: Not Supported 00:24:18.007 Error Log Page Entries Supported: 128 00:24:18.007 Keep Alive: Not Supported 00:24:18.007 00:24:18.007 NVM Command Set Attributes 00:24:18.007 ========================== 00:24:18.007 Submission Queue Entry Size 00:24:18.007 Max: 1 00:24:18.007 Min: 1 00:24:18.007 Completion Queue Entry Size 00:24:18.007 Max: 1 00:24:18.007 Min: 1 00:24:18.007 Number of Namespaces: 0 00:24:18.007 Compare Command: Not Supported 00:24:18.007 Write Uncorrectable Command: Not Supported 00:24:18.007 Dataset Management Command: Not Supported 00:24:18.007 Write Zeroes Command: Not Supported 00:24:18.007 Set Features Save Field: Not Supported 00:24:18.007 Reservations: Not Supported 00:24:18.007 Timestamp: Not Supported 00:24:18.007 Copy: Not Supported 00:24:18.007 Volatile Write Cache: Not Present 00:24:18.008 Atomic Write Unit (Normal): 1 00:24:18.008 Atomic Write Unit (PFail): 1 00:24:18.008 Atomic Compare & Write Unit: 1 00:24:18.008 Fused Compare & Write: Supported 00:24:18.008 Scatter-Gather List 00:24:18.008 SGL Command Set: Supported 00:24:18.008 SGL Keyed: Supported 00:24:18.008 SGL Bit Bucket Descriptor: Not Supported 00:24:18.008 SGL Metadata Pointer: Not Supported 00:24:18.008 Oversized SGL: Not Supported 00:24:18.008 SGL Metadata Address: Not Supported 00:24:18.008 SGL Offset: Supported 00:24:18.008 Transport SGL Data Block: Not Supported 00:24:18.008 Replay Protected Memory Block: Not Supported 00:24:18.008 00:24:18.008 Firmware Slot Information 00:24:18.008 ========================= 00:24:18.008 Active slot: 0 00:24:18.008 00:24:18.008 00:24:18.008 Error Log 00:24:18.008 ========= 00:24:18.008 00:24:18.008 Active Namespaces 00:24:18.008 ================= 00:24:18.008 Discovery Log Page 00:24:18.008 ================== 00:24:18.008 Generation Counter: 2 00:24:18.008 Number of Records: 2 00:24:18.008 Record Format: 0 00:24:18.008 00:24:18.008 Discovery Log Entry 0 00:24:18.008 ---------------------- 00:24:18.008 Transport Type: 3 (TCP) 00:24:18.008 Address Family: 1 (IPv4) 00:24:18.008 Subsystem Type: 3 (Current Discovery Subsystem) 00:24:18.008 Entry Flags: 00:24:18.008 Duplicate Returned Information: 1 00:24:18.008 Explicit Persistent Connection Support for Discovery: 1 00:24:18.008 Transport Requirements: 00:24:18.008 Secure Channel: Not Required 00:24:18.008 Port ID: 0 (0x0000) 00:24:18.008 Controller ID: 65535 (0xffff) 00:24:18.008 Admin Max SQ Size: 128 00:24:18.008 Transport Service Identifier: 4420 00:24:18.008 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:24:18.008 Transport Address: 10.0.0.2 00:24:18.008 Discovery Log Entry 1 00:24:18.008 ---------------------- 00:24:18.008 Transport Type: 3 (TCP) 00:24:18.008 Address Family: 1 (IPv4) 00:24:18.008 Subsystem Type: 2 (NVM Subsystem) 00:24:18.008 Entry Flags: 00:24:18.008 Duplicate Returned Information: 0 00:24:18.008 Explicit Persistent Connection Support for Discovery: 0 00:24:18.008 Transport Requirements: 00:24:18.008 Secure Channel: Not Required 00:24:18.008 Port ID: 0 (0x0000) 00:24:18.008 Controller ID: 65535 (0xffff) 00:24:18.008 Admin Max SQ Size: 128 00:24:18.008 Transport Service Identifier: 4420 00:24:18.008 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:24:18.008 Transport Address: 10.0.0.2 [2024-07-22 20:29:49.844392] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:24:18.008 [2024-07-22 20:29:49.844406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:18.008 [2024-07-22 20:29:49.844412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:18.008 [2024-07-22 20:29:49.844417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:18.008 [2024-07-22 20:29:49.844422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:18.008 [2024-07-22 20:29:49.844429] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844433] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844436] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.008 [2024-07-22 20:29:49.844443] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.008 [2024-07-22 20:29:49.844457] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.008 [2024-07-22 20:29:49.844572] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.008 [2024-07-22 20:29:49.844581] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.008 [2024-07-22 20:29:49.844585] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844588] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.008 [2024-07-22 20:29:49.844596] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844599] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844602] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.008 [2024-07-22 20:29:49.844609] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.008 [2024-07-22 20:29:49.844624] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.008 [2024-07-22 20:29:49.844751] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.008 [2024-07-22 20:29:49.844759] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.008 [2024-07-22 20:29:49.844762] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844768] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.008 [2024-07-22 20:29:49.844774] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:24:18.008 [2024-07-22 20:29:49.844778] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:24:18.008 [2024-07-22 20:29:49.844787] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844791] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844794] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.008 [2024-07-22 20:29:49.844800] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.008 [2024-07-22 20:29:49.844812] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.008 [2024-07-22 20:29:49.844931] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.008 [2024-07-22 20:29:49.844939] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.008 [2024-07-22 20:29:49.844942] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844945] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.008 [2024-07-22 20:29:49.844957] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844960] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.844963] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.008 [2024-07-22 20:29:49.844970] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.008 [2024-07-22 20:29:49.844981] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.008 [2024-07-22 20:29:49.845106] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.008 [2024-07-22 20:29:49.845115] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.008 [2024-07-22 20:29:49.845118] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.008 [2024-07-22 20:29:49.845132] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845136] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845139] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.008 [2024-07-22 20:29:49.845145] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.008 [2024-07-22 20:29:49.845157] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.008 [2024-07-22 20:29:49.845275] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.008 [2024-07-22 20:29:49.845283] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.008 [2024-07-22 20:29:49.845286] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845289] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.008 [2024-07-22 20:29:49.845299] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845303] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845306] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.008 [2024-07-22 20:29:49.845312] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.008 [2024-07-22 20:29:49.845323] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.008 [2024-07-22 20:29:49.845441] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.008 [2024-07-22 20:29:49.845453] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.008 [2024-07-22 20:29:49.845456] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845459] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.008 [2024-07-22 20:29:49.845469] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845473] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845476] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.008 [2024-07-22 20:29:49.845482] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.008 [2024-07-22 20:29:49.845494] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.008 [2024-07-22 20:29:49.845616] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.008 [2024-07-22 20:29:49.845623] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.008 [2024-07-22 20:29:49.845626] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.008 [2024-07-22 20:29:49.845629] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.009 [2024-07-22 20:29:49.845640] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.845644] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.845647] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.009 [2024-07-22 20:29:49.845653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.009 [2024-07-22 20:29:49.845665] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.009 [2024-07-22 20:29:49.845783] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.009 [2024-07-22 20:29:49.845790] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.009 [2024-07-22 20:29:49.845793] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.845797] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.009 [2024-07-22 20:29:49.845808] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.845811] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.845815] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.009 [2024-07-22 20:29:49.845821] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.009 [2024-07-22 20:29:49.845832] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.009 [2024-07-22 20:29:49.846103] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.009 [2024-07-22 20:29:49.846112] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.009 [2024-07-22 20:29:49.846115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.846118] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.009 [2024-07-22 20:29:49.846130] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.846133] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.846136] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.009 [2024-07-22 20:29:49.846143] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.009 [2024-07-22 20:29:49.846155] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.009 [2024-07-22 20:29:49.846274] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.009 [2024-07-22 20:29:49.846281] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.009 [2024-07-22 20:29:49.846287] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.846291] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.009 [2024-07-22 20:29:49.846302] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.846306] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.846309] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.009 [2024-07-22 20:29:49.846315] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.009 [2024-07-22 20:29:49.846326] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.009 [2024-07-22 20:29:49.850051] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.009 [2024-07-22 20:29:49.850059] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.009 [2024-07-22 20:29:49.850062] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.850066] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.009 [2024-07-22 20:29:49.850076] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.850080] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.850083] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x127e9e0) 00:24:18.009 [2024-07-22 20:29:49.850089] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.009 [2024-07-22 20:29:49.850100] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12e6b50, cid 3, qid 0 00:24:18.009 [2024-07-22 20:29:49.850218] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.009 [2024-07-22 20:29:49.850227] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.009 [2024-07-22 20:29:49.850230] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.850233] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12e6b50) on tqpair=0x127e9e0 00:24:18.009 [2024-07-22 20:29:49.850242] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:24:18.009 00:24:18.009 20:29:49 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:24:18.009 [2024-07-22 20:29:49.884194] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:24:18.009 [2024-07-22 20:29:49.884239] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3517343 ] 00:24:18.009 EAL: No free 2048 kB hugepages reported on node 1 00:24:18.009 [2024-07-22 20:29:49.912432] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:24:18.009 [2024-07-22 20:29:49.912471] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:24:18.009 [2024-07-22 20:29:49.912476] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:24:18.009 [2024-07-22 20:29:49.912487] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:24:18.009 [2024-07-22 20:29:49.912494] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:24:18.009 [2024-07-22 20:29:49.912925] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:24:18.009 [2024-07-22 20:29:49.912952] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xe5f9e0 0 00:24:18.009 [2024-07-22 20:29:49.927053] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:24:18.009 [2024-07-22 20:29:49.927068] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:24:18.009 [2024-07-22 20:29:49.927072] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:24:18.009 [2024-07-22 20:29:49.927075] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:24:18.009 [2024-07-22 20:29:49.927105] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.927110] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.927114] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.009 [2024-07-22 20:29:49.927124] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:24:18.009 [2024-07-22 20:29:49.927139] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.009 [2024-07-22 20:29:49.934053] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.009 [2024-07-22 20:29:49.934062] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.009 [2024-07-22 20:29:49.934065] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.934069] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.009 [2024-07-22 20:29:49.934077] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:24:18.009 [2024-07-22 20:29:49.934082] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:24:18.009 [2024-07-22 20:29:49.934087] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:24:18.009 [2024-07-22 20:29:49.934096] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.934100] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.009 [2024-07-22 20:29:49.934103] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.009 [2024-07-22 20:29:49.934110] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.009 [2024-07-22 20:29:49.934123] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.009 [2024-07-22 20:29:49.934335] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.009 [2024-07-22 20:29:49.934344] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.010 [2024-07-22 20:29:49.934347] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934351] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.010 [2024-07-22 20:29:49.934356] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:24:18.010 [2024-07-22 20:29:49.934364] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:24:18.010 [2024-07-22 20:29:49.934371] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934375] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934378] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.010 [2024-07-22 20:29:49.934385] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.010 [2024-07-22 20:29:49.934397] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.010 [2024-07-22 20:29:49.934518] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.010 [2024-07-22 20:29:49.934525] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.010 [2024-07-22 20:29:49.934528] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934535] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.010 [2024-07-22 20:29:49.934540] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:24:18.010 [2024-07-22 20:29:49.934549] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:24:18.010 [2024-07-22 20:29:49.934555] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934559] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934562] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.010 [2024-07-22 20:29:49.934568] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.010 [2024-07-22 20:29:49.934580] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.010 [2024-07-22 20:29:49.934698] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.010 [2024-07-22 20:29:49.934705] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.010 [2024-07-22 20:29:49.934708] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934712] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.010 [2024-07-22 20:29:49.934717] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:24:18.010 [2024-07-22 20:29:49.934727] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934731] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934734] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.010 [2024-07-22 20:29:49.934741] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.010 [2024-07-22 20:29:49.934753] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.010 [2024-07-22 20:29:49.934868] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.010 [2024-07-22 20:29:49.934875] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.010 [2024-07-22 20:29:49.934878] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.934882] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.010 [2024-07-22 20:29:49.934886] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:24:18.010 [2024-07-22 20:29:49.934891] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:24:18.010 [2024-07-22 20:29:49.934898] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:24:18.010 [2024-07-22 20:29:49.935003] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:24:18.010 [2024-07-22 20:29:49.935007] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:24:18.010 [2024-07-22 20:29:49.935014] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935018] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935021] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.010 [2024-07-22 20:29:49.935027] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.010 [2024-07-22 20:29:49.935039] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.010 [2024-07-22 20:29:49.935163] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.010 [2024-07-22 20:29:49.935174] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.010 [2024-07-22 20:29:49.935177] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935181] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.010 [2024-07-22 20:29:49.935185] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:24:18.010 [2024-07-22 20:29:49.935195] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935199] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935202] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.010 [2024-07-22 20:29:49.935209] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.010 [2024-07-22 20:29:49.935220] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.010 [2024-07-22 20:29:49.935338] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.010 [2024-07-22 20:29:49.935345] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.010 [2024-07-22 20:29:49.935348] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935351] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.010 [2024-07-22 20:29:49.935356] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:24:18.010 [2024-07-22 20:29:49.935360] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:24:18.010 [2024-07-22 20:29:49.935368] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:24:18.010 [2024-07-22 20:29:49.935376] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:24:18.010 [2024-07-22 20:29:49.935384] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935387] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935391] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.010 [2024-07-22 20:29:49.935397] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.010 [2024-07-22 20:29:49.935409] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.010 [2024-07-22 20:29:49.935626] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.010 [2024-07-22 20:29:49.935636] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.010 [2024-07-22 20:29:49.935639] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935643] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5f9e0): datao=0, datal=4096, cccid=0 00:24:18.010 [2024-07-22 20:29:49.935647] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xec7730) on tqpair(0xe5f9e0): expected_datao=0, payload_size=4096 00:24:18.010 [2024-07-22 20:29:49.935654] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.010 [2024-07-22 20:29:49.935657] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.272 [2024-07-22 20:29:49.976242] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.272 [2024-07-22 20:29:49.976255] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.272 [2024-07-22 20:29:49.976258] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.272 [2024-07-22 20:29:49.976262] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.272 [2024-07-22 20:29:49.976270] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:24:18.272 [2024-07-22 20:29:49.976277] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:24:18.272 [2024-07-22 20:29:49.976282] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:24:18.272 [2024-07-22 20:29:49.976285] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:24:18.272 [2024-07-22 20:29:49.976289] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:24:18.272 [2024-07-22 20:29:49.976294] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:24:18.272 [2024-07-22 20:29:49.976306] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:24:18.272 [2024-07-22 20:29:49.976313] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976317] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976320] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.976328] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:24:18.273 [2024-07-22 20:29:49.976341] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.273 [2024-07-22 20:29:49.976457] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.273 [2024-07-22 20:29:49.976465] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.273 [2024-07-22 20:29:49.976468] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976472] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7730) on tqpair=0xe5f9e0 00:24:18.273 [2024-07-22 20:29:49.976478] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976482] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976485] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.976490] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.273 [2024-07-22 20:29:49.976496] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976499] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976502] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.976507] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.273 [2024-07-22 20:29:49.976512] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976515] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976518] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.976523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.273 [2024-07-22 20:29:49.976528] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976531] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976534] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.976539] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.273 [2024-07-22 20:29:49.976544] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.976555] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.976563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976566] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976569] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.976575] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.273 [2024-07-22 20:29:49.976589] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7730, cid 0, qid 0 00:24:18.273 [2024-07-22 20:29:49.976593] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7890, cid 1, qid 0 00:24:18.273 [2024-07-22 20:29:49.976597] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec79f0, cid 2, qid 0 00:24:18.273 [2024-07-22 20:29:49.976601] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7b50, cid 3, qid 0 00:24:18.273 [2024-07-22 20:29:49.976605] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7cb0, cid 4, qid 0 00:24:18.273 [2024-07-22 20:29:49.976768] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.273 [2024-07-22 20:29:49.976776] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.273 [2024-07-22 20:29:49.976779] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976783] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7cb0) on tqpair=0xe5f9e0 00:24:18.273 [2024-07-22 20:29:49.976787] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:24:18.273 [2024-07-22 20:29:49.976792] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.976800] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.976809] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.976815] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976818] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976821] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.976828] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:24:18.273 [2024-07-22 20:29:49.976840] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7cb0, cid 4, qid 0 00:24:18.273 [2024-07-22 20:29:49.976962] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.273 [2024-07-22 20:29:49.976970] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.273 [2024-07-22 20:29:49.976973] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.976976] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7cb0) on tqpair=0xe5f9e0 00:24:18.273 [2024-07-22 20:29:49.977029] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.977039] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.977054] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977058] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977061] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.977067] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.273 [2024-07-22 20:29:49.977079] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7cb0, cid 4, qid 0 00:24:18.273 [2024-07-22 20:29:49.977215] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.273 [2024-07-22 20:29:49.977224] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.273 [2024-07-22 20:29:49.977227] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977231] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5f9e0): datao=0, datal=4096, cccid=4 00:24:18.273 [2024-07-22 20:29:49.977235] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xec7cb0) on tqpair(0xe5f9e0): expected_datao=0, payload_size=4096 00:24:18.273 [2024-07-22 20:29:49.977241] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977245] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977311] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.273 [2024-07-22 20:29:49.977318] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.273 [2024-07-22 20:29:49.977321] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977325] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7cb0) on tqpair=0xe5f9e0 00:24:18.273 [2024-07-22 20:29:49.977338] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:24:18.273 [2024-07-22 20:29:49.977346] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.977356] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:49.977363] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977367] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977370] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:49.977376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.273 [2024-07-22 20:29:49.977388] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7cb0, cid 4, qid 0 00:24:18.273 [2024-07-22 20:29:49.977524] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.273 [2024-07-22 20:29:49.977532] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.273 [2024-07-22 20:29:49.977536] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977539] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5f9e0): datao=0, datal=4096, cccid=4 00:24:18.273 [2024-07-22 20:29:49.977542] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xec7cb0) on tqpair(0xe5f9e0): expected_datao=0, payload_size=4096 00:24:18.273 [2024-07-22 20:29:49.977714] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:49.977718] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:50.022051] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.273 [2024-07-22 20:29:50.022063] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.273 [2024-07-22 20:29:50.022067] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:50.022071] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7cb0) on tqpair=0xe5f9e0 00:24:18.273 [2024-07-22 20:29:50.022091] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:50.022101] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:24:18.273 [2024-07-22 20:29:50.022110] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:50.022115] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.273 [2024-07-22 20:29:50.022119] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5f9e0) 00:24:18.273 [2024-07-22 20:29:50.022129] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.273 [2024-07-22 20:29:50.022142] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7cb0, cid 4, qid 0 00:24:18.273 [2024-07-22 20:29:50.022365] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.273 [2024-07-22 20:29:50.022375] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.273 [2024-07-22 20:29:50.022378] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.022382] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5f9e0): datao=0, datal=4096, cccid=4 00:24:18.274 [2024-07-22 20:29:50.022386] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xec7cb0) on tqpair(0xe5f9e0): expected_datao=0, payload_size=4096 00:24:18.274 [2024-07-22 20:29:50.022556] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.022561] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063272] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.274 [2024-07-22 20:29:50.063288] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.274 [2024-07-22 20:29:50.063291] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063295] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7cb0) on tqpair=0xe5f9e0 00:24:18.274 [2024-07-22 20:29:50.063304] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:24:18.274 [2024-07-22 20:29:50.063314] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:24:18.274 [2024-07-22 20:29:50.063323] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:24:18.274 [2024-07-22 20:29:50.063329] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:24:18.274 [2024-07-22 20:29:50.063333] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:24:18.274 [2024-07-22 20:29:50.063338] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:24:18.274 [2024-07-22 20:29:50.063342] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:24:18.274 [2024-07-22 20:29:50.063347] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:24:18.274 [2024-07-22 20:29:50.063361] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063365] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063368] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.063376] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.274 [2024-07-22 20:29:50.063382] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063385] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063388] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.063394] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:24:18.274 [2024-07-22 20:29:50.063409] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7cb0, cid 4, qid 0 00:24:18.274 [2024-07-22 20:29:50.063414] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7e10, cid 5, qid 0 00:24:18.274 [2024-07-22 20:29:50.063689] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.274 [2024-07-22 20:29:50.063697] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.274 [2024-07-22 20:29:50.063700] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063703] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7cb0) on tqpair=0xe5f9e0 00:24:18.274 [2024-07-22 20:29:50.063709] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.274 [2024-07-22 20:29:50.063715] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.274 [2024-07-22 20:29:50.063718] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063721] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7e10) on tqpair=0xe5f9e0 00:24:18.274 [2024-07-22 20:29:50.063729] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063733] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063736] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.063741] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.274 [2024-07-22 20:29:50.063751] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7e10, cid 5, qid 0 00:24:18.274 [2024-07-22 20:29:50.063873] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.274 [2024-07-22 20:29:50.063882] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.274 [2024-07-22 20:29:50.063885] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063889] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7e10) on tqpair=0xe5f9e0 00:24:18.274 [2024-07-22 20:29:50.063898] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063902] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.063905] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.063911] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.274 [2024-07-22 20:29:50.063923] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7e10, cid 5, qid 0 00:24:18.274 [2024-07-22 20:29:50.064054] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.274 [2024-07-22 20:29:50.064063] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.274 [2024-07-22 20:29:50.064066] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064069] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7e10) on tqpair=0xe5f9e0 00:24:18.274 [2024-07-22 20:29:50.064079] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064083] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064086] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.064092] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.274 [2024-07-22 20:29:50.064104] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7e10, cid 5, qid 0 00:24:18.274 [2024-07-22 20:29:50.064222] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.274 [2024-07-22 20:29:50.064230] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.274 [2024-07-22 20:29:50.064233] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064237] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7e10) on tqpair=0xe5f9e0 00:24:18.274 [2024-07-22 20:29:50.064250] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064254] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064257] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.064266] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.274 [2024-07-22 20:29:50.064273] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064276] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064279] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.064284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.274 [2024-07-22 20:29:50.064291] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064294] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064297] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.064302] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.274 [2024-07-22 20:29:50.064309] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064313] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064316] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xe5f9e0) 00:24:18.274 [2024-07-22 20:29:50.064321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.274 [2024-07-22 20:29:50.064335] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7e10, cid 5, qid 0 00:24:18.274 [2024-07-22 20:29:50.064339] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7cb0, cid 4, qid 0 00:24:18.274 [2024-07-22 20:29:50.064343] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7f70, cid 6, qid 0 00:24:18.274 [2024-07-22 20:29:50.064348] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec80d0, cid 7, qid 0 00:24:18.274 [2024-07-22 20:29:50.064663] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.274 [2024-07-22 20:29:50.064673] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.274 [2024-07-22 20:29:50.064677] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064680] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5f9e0): datao=0, datal=8192, cccid=5 00:24:18.274 [2024-07-22 20:29:50.064684] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xec7e10) on tqpair(0xe5f9e0): expected_datao=0, payload_size=8192 00:24:18.274 [2024-07-22 20:29:50.064692] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064695] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.274 [2024-07-22 20:29:50.064705] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.274 [2024-07-22 20:29:50.064708] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064711] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5f9e0): datao=0, datal=512, cccid=4 00:24:18.274 [2024-07-22 20:29:50.064715] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xec7cb0) on tqpair(0xe5f9e0): expected_datao=0, payload_size=512 00:24:18.274 [2024-07-22 20:29:50.064721] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064725] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064730] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.274 [2024-07-22 20:29:50.064735] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.274 [2024-07-22 20:29:50.064738] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.274 [2024-07-22 20:29:50.064744] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5f9e0): datao=0, datal=512, cccid=6 00:24:18.274 [2024-07-22 20:29:50.064747] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xec7f70) on tqpair(0xe5f9e0): expected_datao=0, payload_size=512 00:24:18.274 [2024-07-22 20:29:50.064753] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064757] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064761] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:24:18.275 [2024-07-22 20:29:50.064766] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:24:18.275 [2024-07-22 20:29:50.064769] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064772] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5f9e0): datao=0, datal=4096, cccid=7 00:24:18.275 [2024-07-22 20:29:50.064776] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xec80d0) on tqpair(0xe5f9e0): expected_datao=0, payload_size=4096 00:24:18.275 [2024-07-22 20:29:50.064783] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064786] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064873] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.275 [2024-07-22 20:29:50.064878] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.275 [2024-07-22 20:29:50.064881] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064884] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7e10) on tqpair=0xe5f9e0 00:24:18.275 [2024-07-22 20:29:50.064898] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.275 [2024-07-22 20:29:50.064903] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.275 [2024-07-22 20:29:50.064906] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064909] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7cb0) on tqpair=0xe5f9e0 00:24:18.275 [2024-07-22 20:29:50.064917] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.275 [2024-07-22 20:29:50.064923] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.275 [2024-07-22 20:29:50.064926] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064929] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7f70) on tqpair=0xe5f9e0 00:24:18.275 [2024-07-22 20:29:50.064935] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.275 [2024-07-22 20:29:50.064940] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.275 [2024-07-22 20:29:50.064943] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.275 [2024-07-22 20:29:50.064946] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec80d0) on tqpair=0xe5f9e0 00:24:18.275 ===================================================== 00:24:18.275 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:18.275 ===================================================== 00:24:18.275 Controller Capabilities/Features 00:24:18.275 ================================ 00:24:18.275 Vendor ID: 8086 00:24:18.275 Subsystem Vendor ID: 8086 00:24:18.275 Serial Number: SPDK00000000000001 00:24:18.275 Model Number: SPDK bdev Controller 00:24:18.275 Firmware Version: 24.01.1 00:24:18.275 Recommended Arb Burst: 6 00:24:18.275 IEEE OUI Identifier: e4 d2 5c 00:24:18.275 Multi-path I/O 00:24:18.275 May have multiple subsystem ports: Yes 00:24:18.275 May have multiple controllers: Yes 00:24:18.275 Associated with SR-IOV VF: No 00:24:18.275 Max Data Transfer Size: 131072 00:24:18.275 Max Number of Namespaces: 32 00:24:18.275 Max Number of I/O Queues: 127 00:24:18.275 NVMe Specification Version (VS): 1.3 00:24:18.275 NVMe Specification Version (Identify): 1.3 00:24:18.275 Maximum Queue Entries: 128 00:24:18.275 Contiguous Queues Required: Yes 00:24:18.275 Arbitration Mechanisms Supported 00:24:18.275 Weighted Round Robin: Not Supported 00:24:18.275 Vendor Specific: Not Supported 00:24:18.275 Reset Timeout: 15000 ms 00:24:18.275 Doorbell Stride: 4 bytes 00:24:18.275 NVM Subsystem Reset: Not Supported 00:24:18.275 Command Sets Supported 00:24:18.275 NVM Command Set: Supported 00:24:18.275 Boot Partition: Not Supported 00:24:18.275 Memory Page Size Minimum: 4096 bytes 00:24:18.275 Memory Page Size Maximum: 4096 bytes 00:24:18.275 Persistent Memory Region: Not Supported 00:24:18.275 Optional Asynchronous Events Supported 00:24:18.275 Namespace Attribute Notices: Supported 00:24:18.275 Firmware Activation Notices: Not Supported 00:24:18.275 ANA Change Notices: Not Supported 00:24:18.275 PLE Aggregate Log Change Notices: Not Supported 00:24:18.275 LBA Status Info Alert Notices: Not Supported 00:24:18.275 EGE Aggregate Log Change Notices: Not Supported 00:24:18.275 Normal NVM Subsystem Shutdown event: Not Supported 00:24:18.275 Zone Descriptor Change Notices: Not Supported 00:24:18.275 Discovery Log Change Notices: Not Supported 00:24:18.275 Controller Attributes 00:24:18.275 128-bit Host Identifier: Supported 00:24:18.275 Non-Operational Permissive Mode: Not Supported 00:24:18.275 NVM Sets: Not Supported 00:24:18.275 Read Recovery Levels: Not Supported 00:24:18.275 Endurance Groups: Not Supported 00:24:18.275 Predictable Latency Mode: Not Supported 00:24:18.275 Traffic Based Keep ALive: Not Supported 00:24:18.275 Namespace Granularity: Not Supported 00:24:18.275 SQ Associations: Not Supported 00:24:18.275 UUID List: Not Supported 00:24:18.275 Multi-Domain Subsystem: Not Supported 00:24:18.275 Fixed Capacity Management: Not Supported 00:24:18.275 Variable Capacity Management: Not Supported 00:24:18.275 Delete Endurance Group: Not Supported 00:24:18.275 Delete NVM Set: Not Supported 00:24:18.275 Extended LBA Formats Supported: Not Supported 00:24:18.275 Flexible Data Placement Supported: Not Supported 00:24:18.275 00:24:18.275 Controller Memory Buffer Support 00:24:18.275 ================================ 00:24:18.275 Supported: No 00:24:18.275 00:24:18.275 Persistent Memory Region Support 00:24:18.275 ================================ 00:24:18.275 Supported: No 00:24:18.275 00:24:18.275 Admin Command Set Attributes 00:24:18.275 ============================ 00:24:18.275 Security Send/Receive: Not Supported 00:24:18.275 Format NVM: Not Supported 00:24:18.275 Firmware Activate/Download: Not Supported 00:24:18.275 Namespace Management: Not Supported 00:24:18.275 Device Self-Test: Not Supported 00:24:18.275 Directives: Not Supported 00:24:18.275 NVMe-MI: Not Supported 00:24:18.275 Virtualization Management: Not Supported 00:24:18.275 Doorbell Buffer Config: Not Supported 00:24:18.275 Get LBA Status Capability: Not Supported 00:24:18.275 Command & Feature Lockdown Capability: Not Supported 00:24:18.275 Abort Command Limit: 4 00:24:18.275 Async Event Request Limit: 4 00:24:18.275 Number of Firmware Slots: N/A 00:24:18.275 Firmware Slot 1 Read-Only: N/A 00:24:18.275 Firmware Activation Without Reset: N/A 00:24:18.275 Multiple Update Detection Support: N/A 00:24:18.275 Firmware Update Granularity: No Information Provided 00:24:18.275 Per-Namespace SMART Log: No 00:24:18.275 Asymmetric Namespace Access Log Page: Not Supported 00:24:18.275 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:24:18.275 Command Effects Log Page: Supported 00:24:18.275 Get Log Page Extended Data: Supported 00:24:18.275 Telemetry Log Pages: Not Supported 00:24:18.275 Persistent Event Log Pages: Not Supported 00:24:18.275 Supported Log Pages Log Page: May Support 00:24:18.275 Commands Supported & Effects Log Page: Not Supported 00:24:18.275 Feature Identifiers & Effects Log Page:May Support 00:24:18.275 NVMe-MI Commands & Effects Log Page: May Support 00:24:18.275 Data Area 4 for Telemetry Log: Not Supported 00:24:18.275 Error Log Page Entries Supported: 128 00:24:18.275 Keep Alive: Supported 00:24:18.275 Keep Alive Granularity: 10000 ms 00:24:18.275 00:24:18.275 NVM Command Set Attributes 00:24:18.275 ========================== 00:24:18.275 Submission Queue Entry Size 00:24:18.275 Max: 64 00:24:18.275 Min: 64 00:24:18.275 Completion Queue Entry Size 00:24:18.275 Max: 16 00:24:18.275 Min: 16 00:24:18.275 Number of Namespaces: 32 00:24:18.275 Compare Command: Supported 00:24:18.275 Write Uncorrectable Command: Not Supported 00:24:18.275 Dataset Management Command: Supported 00:24:18.275 Write Zeroes Command: Supported 00:24:18.275 Set Features Save Field: Not Supported 00:24:18.275 Reservations: Supported 00:24:18.275 Timestamp: Not Supported 00:24:18.275 Copy: Supported 00:24:18.275 Volatile Write Cache: Present 00:24:18.275 Atomic Write Unit (Normal): 1 00:24:18.275 Atomic Write Unit (PFail): 1 00:24:18.275 Atomic Compare & Write Unit: 1 00:24:18.275 Fused Compare & Write: Supported 00:24:18.275 Scatter-Gather List 00:24:18.275 SGL Command Set: Supported 00:24:18.275 SGL Keyed: Supported 00:24:18.275 SGL Bit Bucket Descriptor: Not Supported 00:24:18.275 SGL Metadata Pointer: Not Supported 00:24:18.275 Oversized SGL: Not Supported 00:24:18.275 SGL Metadata Address: Not Supported 00:24:18.275 SGL Offset: Supported 00:24:18.275 Transport SGL Data Block: Not Supported 00:24:18.275 Replay Protected Memory Block: Not Supported 00:24:18.275 00:24:18.275 Firmware Slot Information 00:24:18.275 ========================= 00:24:18.275 Active slot: 1 00:24:18.275 Slot 1 Firmware Revision: 24.01.1 00:24:18.275 00:24:18.275 00:24:18.275 Commands Supported and Effects 00:24:18.275 ============================== 00:24:18.275 Admin Commands 00:24:18.275 -------------- 00:24:18.276 Get Log Page (02h): Supported 00:24:18.276 Identify (06h): Supported 00:24:18.276 Abort (08h): Supported 00:24:18.276 Set Features (09h): Supported 00:24:18.276 Get Features (0Ah): Supported 00:24:18.276 Asynchronous Event Request (0Ch): Supported 00:24:18.276 Keep Alive (18h): Supported 00:24:18.276 I/O Commands 00:24:18.276 ------------ 00:24:18.276 Flush (00h): Supported LBA-Change 00:24:18.276 Write (01h): Supported LBA-Change 00:24:18.276 Read (02h): Supported 00:24:18.276 Compare (05h): Supported 00:24:18.276 Write Zeroes (08h): Supported LBA-Change 00:24:18.276 Dataset Management (09h): Supported LBA-Change 00:24:18.276 Copy (19h): Supported LBA-Change 00:24:18.276 Unknown (79h): Supported LBA-Change 00:24:18.276 Unknown (7Ah): Supported 00:24:18.276 00:24:18.276 Error Log 00:24:18.276 ========= 00:24:18.276 00:24:18.276 Arbitration 00:24:18.276 =========== 00:24:18.276 Arbitration Burst: 1 00:24:18.276 00:24:18.276 Power Management 00:24:18.276 ================ 00:24:18.276 Number of Power States: 1 00:24:18.276 Current Power State: Power State #0 00:24:18.276 Power State #0: 00:24:18.276 Max Power: 0.00 W 00:24:18.276 Non-Operational State: Operational 00:24:18.276 Entry Latency: Not Reported 00:24:18.276 Exit Latency: Not Reported 00:24:18.276 Relative Read Throughput: 0 00:24:18.276 Relative Read Latency: 0 00:24:18.276 Relative Write Throughput: 0 00:24:18.276 Relative Write Latency: 0 00:24:18.276 Idle Power: Not Reported 00:24:18.276 Active Power: Not Reported 00:24:18.276 Non-Operational Permissive Mode: Not Supported 00:24:18.276 00:24:18.276 Health Information 00:24:18.276 ================== 00:24:18.276 Critical Warnings: 00:24:18.276 Available Spare Space: OK 00:24:18.276 Temperature: OK 00:24:18.276 Device Reliability: OK 00:24:18.276 Read Only: No 00:24:18.276 Volatile Memory Backup: OK 00:24:18.276 Current Temperature: 0 Kelvin (-273 Celsius) 00:24:18.276 Temperature Threshold: [2024-07-22 20:29:50.065049] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065055] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065058] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xe5f9e0) 00:24:18.276 [2024-07-22 20:29:50.065065] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.276 [2024-07-22 20:29:50.065093] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec80d0, cid 7, qid 0 00:24:18.276 [2024-07-22 20:29:50.065230] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.276 [2024-07-22 20:29:50.065239] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.276 [2024-07-22 20:29:50.065242] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065246] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec80d0) on tqpair=0xe5f9e0 00:24:18.276 [2024-07-22 20:29:50.065278] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:24:18.276 [2024-07-22 20:29:50.065291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:18.276 [2024-07-22 20:29:50.065300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:18.276 [2024-07-22 20:29:50.065306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:18.276 [2024-07-22 20:29:50.065311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:18.276 [2024-07-22 20:29:50.065319] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065322] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065326] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5f9e0) 00:24:18.276 [2024-07-22 20:29:50.065333] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.276 [2024-07-22 20:29:50.065346] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7b50, cid 3, qid 0 00:24:18.276 [2024-07-22 20:29:50.065478] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.276 [2024-07-22 20:29:50.065487] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.276 [2024-07-22 20:29:50.065490] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065494] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7b50) on tqpair=0xe5f9e0 00:24:18.276 [2024-07-22 20:29:50.065501] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065505] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065508] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5f9e0) 00:24:18.276 [2024-07-22 20:29:50.065515] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.276 [2024-07-22 20:29:50.065531] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7b50, cid 3, qid 0 00:24:18.276 [2024-07-22 20:29:50.065678] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.276 [2024-07-22 20:29:50.065687] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.276 [2024-07-22 20:29:50.065691] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065695] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7b50) on tqpair=0xe5f9e0 00:24:18.276 [2024-07-22 20:29:50.065700] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:24:18.276 [2024-07-22 20:29:50.065705] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:24:18.276 [2024-07-22 20:29:50.065715] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065723] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5f9e0) 00:24:18.276 [2024-07-22 20:29:50.065730] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.276 [2024-07-22 20:29:50.065743] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7b50, cid 3, qid 0 00:24:18.276 [2024-07-22 20:29:50.065870] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.276 [2024-07-22 20:29:50.065878] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.276 [2024-07-22 20:29:50.065883] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065887] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7b50) on tqpair=0xe5f9e0 00:24:18.276 [2024-07-22 20:29:50.065898] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065902] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.065906] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5f9e0) 00:24:18.276 [2024-07-22 20:29:50.065916] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.276 [2024-07-22 20:29:50.065928] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7b50, cid 3, qid 0 00:24:18.276 [2024-07-22 20:29:50.070052] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.276 [2024-07-22 20:29:50.070065] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.276 [2024-07-22 20:29:50.070068] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.070072] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7b50) on tqpair=0xe5f9e0 00:24:18.276 [2024-07-22 20:29:50.070083] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.070087] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.070090] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5f9e0) 00:24:18.276 [2024-07-22 20:29:50.070097] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:18.276 [2024-07-22 20:29:50.070110] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xec7b50, cid 3, qid 0 00:24:18.276 [2024-07-22 20:29:50.070320] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:24:18.276 [2024-07-22 20:29:50.070329] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:24:18.276 [2024-07-22 20:29:50.070332] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:24:18.276 [2024-07-22 20:29:50.070336] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xec7b50) on tqpair=0xe5f9e0 00:24:18.276 [2024-07-22 20:29:50.070343] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:24:18.276 0 Kelvin (-273 Celsius) 00:24:18.276 Available Spare: 0% 00:24:18.276 Available Spare Threshold: 0% 00:24:18.276 Life Percentage Used: 0% 00:24:18.276 Data Units Read: 0 00:24:18.276 Data Units Written: 0 00:24:18.276 Host Read Commands: 0 00:24:18.276 Host Write Commands: 0 00:24:18.276 Controller Busy Time: 0 minutes 00:24:18.276 Power Cycles: 0 00:24:18.276 Power On Hours: 0 hours 00:24:18.276 Unsafe Shutdowns: 0 00:24:18.276 Unrecoverable Media Errors: 0 00:24:18.276 Lifetime Error Log Entries: 0 00:24:18.276 Warning Temperature Time: 0 minutes 00:24:18.276 Critical Temperature Time: 0 minutes 00:24:18.276 00:24:18.276 Number of Queues 00:24:18.276 ================ 00:24:18.276 Number of I/O Submission Queues: 127 00:24:18.276 Number of I/O Completion Queues: 127 00:24:18.276 00:24:18.276 Active Namespaces 00:24:18.276 ================= 00:24:18.276 Namespace ID:1 00:24:18.276 Error Recovery Timeout: Unlimited 00:24:18.276 Command Set Identifier: NVM (00h) 00:24:18.276 Deallocate: Supported 00:24:18.276 Deallocated/Unwritten Error: Not Supported 00:24:18.276 Deallocated Read Value: Unknown 00:24:18.276 Deallocate in Write Zeroes: Not Supported 00:24:18.276 Deallocated Guard Field: 0xFFFF 00:24:18.276 Flush: Supported 00:24:18.277 Reservation: Supported 00:24:18.277 Namespace Sharing Capabilities: Multiple Controllers 00:24:18.277 Size (in LBAs): 131072 (0GiB) 00:24:18.277 Capacity (in LBAs): 131072 (0GiB) 00:24:18.277 Utilization (in LBAs): 131072 (0GiB) 00:24:18.277 NGUID: ABCDEF0123456789ABCDEF0123456789 00:24:18.277 EUI64: ABCDEF0123456789 00:24:18.277 UUID: 9748a3e4-3478-410a-89cb-b78cfa631d70 00:24:18.277 Thin Provisioning: Not Supported 00:24:18.277 Per-NS Atomic Units: Yes 00:24:18.277 Atomic Boundary Size (Normal): 0 00:24:18.277 Atomic Boundary Size (PFail): 0 00:24:18.277 Atomic Boundary Offset: 0 00:24:18.277 Maximum Single Source Range Length: 65535 00:24:18.277 Maximum Copy Length: 65535 00:24:18.277 Maximum Source Range Count: 1 00:24:18.277 NGUID/EUI64 Never Reused: No 00:24:18.277 Namespace Write Protected: No 00:24:18.277 Number of LBA Formats: 1 00:24:18.277 Current LBA Format: LBA Format #00 00:24:18.277 LBA Format #00: Data Size: 512 Metadata Size: 0 00:24:18.277 00:24:18.277 20:29:50 -- host/identify.sh@51 -- # sync 00:24:18.277 20:29:50 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:18.277 20:29:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:18.277 20:29:50 -- common/autotest_common.sh@10 -- # set +x 00:24:18.277 20:29:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:18.277 20:29:50 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:24:18.277 20:29:50 -- host/identify.sh@56 -- # nvmftestfini 00:24:18.277 20:29:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:18.277 20:29:50 -- nvmf/common.sh@116 -- # sync 00:24:18.277 20:29:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:18.277 20:29:50 -- nvmf/common.sh@119 -- # set +e 00:24:18.277 20:29:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:18.277 20:29:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:18.277 rmmod nvme_tcp 00:24:18.277 rmmod nvme_fabrics 00:24:18.277 rmmod nvme_keyring 00:24:18.277 20:29:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:18.277 20:29:50 -- nvmf/common.sh@123 -- # set -e 00:24:18.277 20:29:50 -- nvmf/common.sh@124 -- # return 0 00:24:18.277 20:29:50 -- nvmf/common.sh@477 -- # '[' -n 3517090 ']' 00:24:18.277 20:29:50 -- nvmf/common.sh@478 -- # killprocess 3517090 00:24:18.277 20:29:50 -- common/autotest_common.sh@926 -- # '[' -z 3517090 ']' 00:24:18.277 20:29:50 -- common/autotest_common.sh@930 -- # kill -0 3517090 00:24:18.277 20:29:50 -- common/autotest_common.sh@931 -- # uname 00:24:18.277 20:29:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:18.277 20:29:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3517090 00:24:18.277 20:29:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:18.277 20:29:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:18.277 20:29:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3517090' 00:24:18.277 killing process with pid 3517090 00:24:18.277 20:29:50 -- common/autotest_common.sh@945 -- # kill 3517090 00:24:18.277 [2024-07-22 20:29:50.191056] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:24:18.277 20:29:50 -- common/autotest_common.sh@950 -- # wait 3517090 00:24:18.537 20:29:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:18.537 20:29:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:18.537 20:29:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:18.537 20:29:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:18.537 20:29:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:18.537 20:29:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:18.537 20:29:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:18.537 20:29:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:21.074 20:29:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:21.074 00:24:21.074 real 0m9.524s 00:24:21.074 user 0m7.654s 00:24:21.074 sys 0m4.590s 00:24:21.074 20:29:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:21.074 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:24:21.074 ************************************ 00:24:21.074 END TEST nvmf_identify 00:24:21.074 ************************************ 00:24:21.074 20:29:52 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:24:21.074 20:29:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:21.074 20:29:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:21.074 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:24:21.074 ************************************ 00:24:21.074 START TEST nvmf_perf 00:24:21.074 ************************************ 00:24:21.074 20:29:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:24:21.074 * Looking for test storage... 00:24:21.074 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:21.074 20:29:52 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:21.074 20:29:52 -- nvmf/common.sh@7 -- # uname -s 00:24:21.074 20:29:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:21.074 20:29:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:21.074 20:29:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:21.074 20:29:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:21.074 20:29:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:21.074 20:29:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:21.074 20:29:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:21.074 20:29:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:21.074 20:29:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:21.074 20:29:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:21.074 20:29:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:24:21.074 20:29:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:24:21.074 20:29:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:21.074 20:29:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:21.075 20:29:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:21.075 20:29:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:21.075 20:29:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:21.075 20:29:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:21.075 20:29:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:21.075 20:29:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.075 20:29:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.075 20:29:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.075 20:29:52 -- paths/export.sh@5 -- # export PATH 00:24:21.075 20:29:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.075 20:29:52 -- nvmf/common.sh@46 -- # : 0 00:24:21.075 20:29:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:21.075 20:29:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:21.075 20:29:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:21.075 20:29:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:21.075 20:29:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:21.075 20:29:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:21.075 20:29:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:21.075 20:29:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:21.075 20:29:52 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:24:21.075 20:29:52 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:24:21.075 20:29:52 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:21.075 20:29:52 -- host/perf.sh@17 -- # nvmftestinit 00:24:21.075 20:29:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:21.075 20:29:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:21.075 20:29:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:21.075 20:29:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:21.075 20:29:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:21.075 20:29:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:21.075 20:29:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:21.075 20:29:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:21.075 20:29:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:21.075 20:29:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:21.075 20:29:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:21.075 20:29:52 -- common/autotest_common.sh@10 -- # set +x 00:24:26.396 20:29:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:26.396 20:29:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:26.396 20:29:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:26.396 20:29:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:26.396 20:29:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:26.396 20:29:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:26.396 20:29:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:26.396 20:29:57 -- nvmf/common.sh@294 -- # net_devs=() 00:24:26.396 20:29:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:26.396 20:29:57 -- nvmf/common.sh@295 -- # e810=() 00:24:26.396 20:29:57 -- nvmf/common.sh@295 -- # local -ga e810 00:24:26.396 20:29:57 -- nvmf/common.sh@296 -- # x722=() 00:24:26.396 20:29:57 -- nvmf/common.sh@296 -- # local -ga x722 00:24:26.396 20:29:57 -- nvmf/common.sh@297 -- # mlx=() 00:24:26.396 20:29:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:26.396 20:29:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:26.396 20:29:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:26.396 20:29:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:26.396 20:29:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:26.396 20:29:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:26.396 20:29:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:24:26.396 Found 0000:86:00.0 (0x8086 - 0x159b) 00:24:26.396 20:29:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:26.396 20:29:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:24:26.396 Found 0000:86:00.1 (0x8086 - 0x159b) 00:24:26.396 20:29:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:26.396 20:29:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:26.396 20:29:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:26.396 20:29:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:26.396 20:29:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:26.396 20:29:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:24:26.396 Found net devices under 0000:86:00.0: cvl_0_0 00:24:26.396 20:29:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:26.396 20:29:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:26.396 20:29:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:26.396 20:29:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:26.396 20:29:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:26.396 20:29:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:24:26.396 Found net devices under 0000:86:00.1: cvl_0_1 00:24:26.396 20:29:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:26.396 20:29:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:26.396 20:29:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:26.396 20:29:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:26.396 20:29:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:26.396 20:29:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:26.396 20:29:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:26.396 20:29:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:26.396 20:29:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:26.396 20:29:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:26.396 20:29:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:26.396 20:29:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:26.396 20:29:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:26.396 20:29:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:26.396 20:29:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:26.396 20:29:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:26.396 20:29:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:26.396 20:29:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:26.396 20:29:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:26.396 20:29:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:26.396 20:29:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:26.396 20:29:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:26.396 20:29:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:26.396 20:29:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:26.396 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:26.396 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.170 ms 00:24:26.396 00:24:26.396 --- 10.0.0.2 ping statistics --- 00:24:26.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:26.396 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:24:26.396 20:29:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:26.396 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:26.396 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.201 ms 00:24:26.396 00:24:26.396 --- 10.0.0.1 ping statistics --- 00:24:26.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:26.396 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:24:26.396 20:29:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:26.396 20:29:57 -- nvmf/common.sh@410 -- # return 0 00:24:26.396 20:29:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:26.396 20:29:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:26.396 20:29:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:26.396 20:29:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:26.396 20:29:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:26.396 20:29:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:26.396 20:29:57 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:24:26.396 20:29:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:26.396 20:29:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:26.396 20:29:57 -- common/autotest_common.sh@10 -- # set +x 00:24:26.396 20:29:57 -- nvmf/common.sh@469 -- # nvmfpid=3520662 00:24:26.396 20:29:57 -- nvmf/common.sh@470 -- # waitforlisten 3520662 00:24:26.396 20:29:57 -- common/autotest_common.sh@819 -- # '[' -z 3520662 ']' 00:24:26.396 20:29:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:26.396 20:29:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:26.396 20:29:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:26.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:26.396 20:29:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:26.396 20:29:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:26.396 20:29:57 -- common/autotest_common.sh@10 -- # set +x 00:24:26.396 [2024-07-22 20:29:57.798100] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:24:26.397 [2024-07-22 20:29:57.798142] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:26.397 EAL: No free 2048 kB hugepages reported on node 1 00:24:26.397 [2024-07-22 20:29:57.854423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:26.397 [2024-07-22 20:29:57.937536] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:26.397 [2024-07-22 20:29:57.937638] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:26.397 [2024-07-22 20:29:57.937645] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:26.397 [2024-07-22 20:29:57.937652] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:26.397 [2024-07-22 20:29:57.937688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:26.397 [2024-07-22 20:29:57.937775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:26.397 [2024-07-22 20:29:57.937801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:26.397 [2024-07-22 20:29:57.937802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:26.964 20:29:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:26.964 20:29:58 -- common/autotest_common.sh@852 -- # return 0 00:24:26.964 20:29:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:26.964 20:29:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:26.964 20:29:58 -- common/autotest_common.sh@10 -- # set +x 00:24:26.964 20:29:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:26.964 20:29:58 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:26.964 20:29:58 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:24:30.251 20:30:01 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:24:30.251 20:30:01 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:24:30.251 20:30:01 -- host/perf.sh@30 -- # local_nvme_trid=0000:5e:00.0 00:24:30.251 20:30:01 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:24:30.251 20:30:02 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:24:30.251 20:30:02 -- host/perf.sh@33 -- # '[' -n 0000:5e:00.0 ']' 00:24:30.251 20:30:02 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:24:30.251 20:30:02 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:24:30.251 20:30:02 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:24:30.510 [2024-07-22 20:30:02.190818] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:30.510 20:30:02 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:30.510 20:30:02 -- host/perf.sh@45 -- # for bdev in $bdevs 00:24:30.510 20:30:02 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:30.768 20:30:02 -- host/perf.sh@45 -- # for bdev in $bdevs 00:24:30.768 20:30:02 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:24:31.027 20:30:02 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:31.027 [2024-07-22 20:30:02.925650] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:31.027 20:30:02 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:31.286 20:30:03 -- host/perf.sh@52 -- # '[' -n 0000:5e:00.0 ']' 00:24:31.286 20:30:03 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:24:31.286 20:30:03 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:24:31.286 20:30:03 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:24:32.665 Initializing NVMe Controllers 00:24:32.665 Attached to NVMe Controller at 0000:5e:00.0 [8086:0a54] 00:24:32.665 Associating PCIE (0000:5e:00.0) NSID 1 with lcore 0 00:24:32.665 Initialization complete. Launching workers. 00:24:32.665 ======================================================== 00:24:32.665 Latency(us) 00:24:32.665 Device Information : IOPS MiB/s Average min max 00:24:32.665 PCIE (0000:5e:00.0) NSID 1 from core 0: 99164.15 387.36 322.26 9.55 8220.16 00:24:32.665 ======================================================== 00:24:32.665 Total : 99164.15 387.36 322.26 9.55 8220.16 00:24:32.665 00:24:32.665 20:30:04 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:32.665 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.042 Initializing NVMe Controllers 00:24:34.042 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:34.042 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:34.042 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:24:34.042 Initialization complete. Launching workers. 00:24:34.042 ======================================================== 00:24:34.042 Latency(us) 00:24:34.042 Device Information : IOPS MiB/s Average min max 00:24:34.042 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 120.00 0.47 8598.42 400.10 45495.82 00:24:34.042 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 41.00 0.16 25473.28 7968.57 47895.27 00:24:34.042 ======================================================== 00:24:34.042 Total : 161.00 0.63 12895.74 400.10 47895.27 00:24:34.042 00:24:34.042 20:30:05 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:34.042 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.977 Initializing NVMe Controllers 00:24:34.977 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:34.977 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:34.977 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:24:34.977 Initialization complete. Launching workers. 00:24:34.977 ======================================================== 00:24:34.977 Latency(us) 00:24:34.977 Device Information : IOPS MiB/s Average min max 00:24:34.977 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7898.03 30.85 4052.47 825.49 12484.09 00:24:34.977 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3804.38 14.86 8417.83 4502.00 16655.55 00:24:34.977 ======================================================== 00:24:34.977 Total : 11702.42 45.71 5471.62 825.49 16655.55 00:24:34.977 00:24:34.977 20:30:06 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:24:34.977 20:30:06 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:24:34.977 20:30:06 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:35.235 EAL: No free 2048 kB hugepages reported on node 1 00:24:37.800 Initializing NVMe Controllers 00:24:37.800 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:37.800 Controller IO queue size 128, less than required. 00:24:37.800 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:37.800 Controller IO queue size 128, less than required. 00:24:37.800 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:37.800 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:37.800 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:24:37.800 Initialization complete. Launching workers. 00:24:37.800 ======================================================== 00:24:37.800 Latency(us) 00:24:37.800 Device Information : IOPS MiB/s Average min max 00:24:37.800 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 958.49 239.62 136888.10 72547.26 206930.68 00:24:37.800 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 579.99 145.00 227111.49 62354.44 335328.27 00:24:37.800 ======================================================== 00:24:37.800 Total : 1538.48 384.62 170901.47 62354.44 335328.27 00:24:37.800 00:24:37.800 20:30:09 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:24:37.800 EAL: No free 2048 kB hugepages reported on node 1 00:24:37.800 No valid NVMe controllers or AIO or URING devices found 00:24:37.800 Initializing NVMe Controllers 00:24:37.800 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:37.800 Controller IO queue size 128, less than required. 00:24:37.800 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:37.800 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:24:37.800 Controller IO queue size 128, less than required. 00:24:37.800 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:37.800 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:24:37.800 WARNING: Some requested NVMe devices were skipped 00:24:37.800 20:30:09 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:24:37.800 EAL: No free 2048 kB hugepages reported on node 1 00:24:41.085 Initializing NVMe Controllers 00:24:41.085 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:41.085 Controller IO queue size 128, less than required. 00:24:41.085 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:41.085 Controller IO queue size 128, less than required. 00:24:41.085 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:41.085 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:41.085 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:24:41.085 Initialization complete. Launching workers. 00:24:41.085 00:24:41.085 ==================== 00:24:41.085 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:24:41.085 TCP transport: 00:24:41.085 polls: 48911 00:24:41.085 idle_polls: 19786 00:24:41.085 sock_completions: 29125 00:24:41.085 nvme_completions: 3471 00:24:41.085 submitted_requests: 5407 00:24:41.085 queued_requests: 1 00:24:41.085 00:24:41.085 ==================== 00:24:41.085 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:24:41.085 TCP transport: 00:24:41.085 polls: 45436 00:24:41.085 idle_polls: 15360 00:24:41.085 sock_completions: 30076 00:24:41.085 nvme_completions: 3232 00:24:41.085 submitted_requests: 4996 00:24:41.085 queued_requests: 1 00:24:41.085 ======================================================== 00:24:41.085 Latency(us) 00:24:41.085 Device Information : IOPS MiB/s Average min max 00:24:41.085 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 930.90 232.72 144800.31 78852.61 286753.05 00:24:41.085 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 870.93 217.73 149849.83 86330.96 265274.83 00:24:41.085 ======================================================== 00:24:41.085 Total : 1801.83 450.46 147241.05 78852.61 286753.05 00:24:41.085 00:24:41.085 20:30:12 -- host/perf.sh@66 -- # sync 00:24:41.085 20:30:12 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:41.085 20:30:12 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:24:41.085 20:30:12 -- host/perf.sh@71 -- # '[' -n 0000:5e:00.0 ']' 00:24:41.085 20:30:12 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:24:44.370 20:30:15 -- host/perf.sh@72 -- # ls_guid=41de4acb-0226-4f86-b902-b620201ba1b3 00:24:44.370 20:30:15 -- host/perf.sh@73 -- # get_lvs_free_mb 41de4acb-0226-4f86-b902-b620201ba1b3 00:24:44.370 20:30:15 -- common/autotest_common.sh@1343 -- # local lvs_uuid=41de4acb-0226-4f86-b902-b620201ba1b3 00:24:44.370 20:30:15 -- common/autotest_common.sh@1344 -- # local lvs_info 00:24:44.370 20:30:15 -- common/autotest_common.sh@1345 -- # local fc 00:24:44.370 20:30:15 -- common/autotest_common.sh@1346 -- # local cs 00:24:44.370 20:30:15 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:44.370 20:30:16 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:24:44.370 { 00:24:44.370 "uuid": "41de4acb-0226-4f86-b902-b620201ba1b3", 00:24:44.370 "name": "lvs_0", 00:24:44.370 "base_bdev": "Nvme0n1", 00:24:44.370 "total_data_clusters": 238234, 00:24:44.370 "free_clusters": 238234, 00:24:44.370 "block_size": 512, 00:24:44.370 "cluster_size": 4194304 00:24:44.370 } 00:24:44.370 ]' 00:24:44.370 20:30:16 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="41de4acb-0226-4f86-b902-b620201ba1b3") .free_clusters' 00:24:44.370 20:30:16 -- common/autotest_common.sh@1348 -- # fc=238234 00:24:44.370 20:30:16 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="41de4acb-0226-4f86-b902-b620201ba1b3") .cluster_size' 00:24:44.370 20:30:16 -- common/autotest_common.sh@1349 -- # cs=4194304 00:24:44.370 20:30:16 -- common/autotest_common.sh@1352 -- # free_mb=952936 00:24:44.370 20:30:16 -- common/autotest_common.sh@1353 -- # echo 952936 00:24:44.370 952936 00:24:44.370 20:30:16 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:24:44.370 20:30:16 -- host/perf.sh@78 -- # free_mb=20480 00:24:44.370 20:30:16 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 41de4acb-0226-4f86-b902-b620201ba1b3 lbd_0 20480 00:24:44.629 20:30:16 -- host/perf.sh@80 -- # lb_guid=7eead123-e4b5-4dcf-9dd5-8b289f1292e5 00:24:44.629 20:30:16 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 7eead123-e4b5-4dcf-9dd5-8b289f1292e5 lvs_n_0 00:24:45.198 20:30:17 -- host/perf.sh@83 -- # ls_nested_guid=cb607470-7a57-4f1f-a4d3-80c34237ec81 00:24:45.198 20:30:17 -- host/perf.sh@84 -- # get_lvs_free_mb cb607470-7a57-4f1f-a4d3-80c34237ec81 00:24:45.198 20:30:17 -- common/autotest_common.sh@1343 -- # local lvs_uuid=cb607470-7a57-4f1f-a4d3-80c34237ec81 00:24:45.198 20:30:17 -- common/autotest_common.sh@1344 -- # local lvs_info 00:24:45.198 20:30:17 -- common/autotest_common.sh@1345 -- # local fc 00:24:45.198 20:30:17 -- common/autotest_common.sh@1346 -- # local cs 00:24:45.198 20:30:17 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:45.457 20:30:17 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:24:45.457 { 00:24:45.457 "uuid": "41de4acb-0226-4f86-b902-b620201ba1b3", 00:24:45.457 "name": "lvs_0", 00:24:45.457 "base_bdev": "Nvme0n1", 00:24:45.457 "total_data_clusters": 238234, 00:24:45.457 "free_clusters": 233114, 00:24:45.457 "block_size": 512, 00:24:45.457 "cluster_size": 4194304 00:24:45.457 }, 00:24:45.457 { 00:24:45.457 "uuid": "cb607470-7a57-4f1f-a4d3-80c34237ec81", 00:24:45.457 "name": "lvs_n_0", 00:24:45.457 "base_bdev": "7eead123-e4b5-4dcf-9dd5-8b289f1292e5", 00:24:45.457 "total_data_clusters": 5114, 00:24:45.457 "free_clusters": 5114, 00:24:45.457 "block_size": 512, 00:24:45.457 "cluster_size": 4194304 00:24:45.457 } 00:24:45.457 ]' 00:24:45.457 20:30:17 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="cb607470-7a57-4f1f-a4d3-80c34237ec81") .free_clusters' 00:24:45.457 20:30:17 -- common/autotest_common.sh@1348 -- # fc=5114 00:24:45.457 20:30:17 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="cb607470-7a57-4f1f-a4d3-80c34237ec81") .cluster_size' 00:24:45.457 20:30:17 -- common/autotest_common.sh@1349 -- # cs=4194304 00:24:45.457 20:30:17 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:24:45.457 20:30:17 -- common/autotest_common.sh@1353 -- # echo 20456 00:24:45.457 20456 00:24:45.457 20:30:17 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:24:45.457 20:30:17 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u cb607470-7a57-4f1f-a4d3-80c34237ec81 lbd_nest_0 20456 00:24:45.716 20:30:17 -- host/perf.sh@88 -- # lb_nested_guid=2da9393d-7991-4649-b161-97a198a653af 00:24:45.716 20:30:17 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:45.976 20:30:17 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:24:45.976 20:30:17 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 2da9393d-7991-4649-b161-97a198a653af 00:24:45.976 20:30:17 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:46.235 20:30:18 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:24:46.235 20:30:18 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:24:46.235 20:30:18 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:46.235 20:30:18 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:46.235 20:30:18 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:46.235 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.439 Initializing NVMe Controllers 00:24:58.439 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:58.439 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:58.439 Initialization complete. Launching workers. 00:24:58.439 ======================================================== 00:24:58.439 Latency(us) 00:24:58.439 Device Information : IOPS MiB/s Average min max 00:24:58.439 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.10 0.02 22697.77 247.62 46498.07 00:24:58.439 ======================================================== 00:24:58.439 Total : 44.10 0.02 22697.77 247.62 46498.07 00:24:58.439 00:24:58.439 20:30:28 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:58.439 20:30:28 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:58.439 EAL: No free 2048 kB hugepages reported on node 1 00:25:08.467 Initializing NVMe Controllers 00:25:08.467 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:08.467 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:08.467 Initialization complete. Launching workers. 00:25:08.467 ======================================================== 00:25:08.467 Latency(us) 00:25:08.467 Device Information : IOPS MiB/s Average min max 00:25:08.467 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 82.60 10.32 12126.08 4986.54 49827.69 00:25:08.467 ======================================================== 00:25:08.467 Total : 82.60 10.32 12126.08 4986.54 49827.69 00:25:08.467 00:25:08.467 20:30:38 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:25:08.467 20:30:38 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:08.467 20:30:38 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:08.467 EAL: No free 2048 kB hugepages reported on node 1 00:25:18.445 Initializing NVMe Controllers 00:25:18.445 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:18.445 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:18.445 Initialization complete. Launching workers. 00:25:18.445 ======================================================== 00:25:18.445 Latency(us) 00:25:18.445 Device Information : IOPS MiB/s Average min max 00:25:18.445 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7960.38 3.89 4020.18 433.74 12071.52 00:25:18.445 ======================================================== 00:25:18.445 Total : 7960.38 3.89 4020.18 433.74 12071.52 00:25:18.445 00:25:18.445 20:30:48 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:18.445 20:30:48 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:18.445 EAL: No free 2048 kB hugepages reported on node 1 00:25:28.426 Initializing NVMe Controllers 00:25:28.426 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:28.426 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:28.426 Initialization complete. Launching workers. 00:25:28.426 ======================================================== 00:25:28.426 Latency(us) 00:25:28.426 Device Information : IOPS MiB/s Average min max 00:25:28.426 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1689.24 211.16 18948.68 1270.63 53565.55 00:25:28.426 ======================================================== 00:25:28.426 Total : 1689.24 211.16 18948.68 1270.63 53565.55 00:25:28.426 00:25:28.426 20:30:59 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:25:28.426 20:30:59 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:28.427 20:30:59 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:28.427 EAL: No free 2048 kB hugepages reported on node 1 00:25:38.406 Initializing NVMe Controllers 00:25:38.406 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:38.406 Controller IO queue size 128, less than required. 00:25:38.406 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:38.406 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:38.406 Initialization complete. Launching workers. 00:25:38.406 ======================================================== 00:25:38.406 Latency(us) 00:25:38.406 Device Information : IOPS MiB/s Average min max 00:25:38.406 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15093.40 7.37 8485.94 1388.02 22793.13 00:25:38.406 ======================================================== 00:25:38.407 Total : 15093.40 7.37 8485.94 1388.02 22793.13 00:25:38.407 00:25:38.407 20:31:09 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:38.407 20:31:09 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:38.407 EAL: No free 2048 kB hugepages reported on node 1 00:25:48.389 Initializing NVMe Controllers 00:25:48.389 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:48.389 Controller IO queue size 128, less than required. 00:25:48.389 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:48.389 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:48.389 Initialization complete. Launching workers. 00:25:48.389 ======================================================== 00:25:48.389 Latency(us) 00:25:48.389 Device Information : IOPS MiB/s Average min max 00:25:48.389 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1155.94 144.49 110859.46 16295.32 207576.09 00:25:48.389 ======================================================== 00:25:48.389 Total : 1155.94 144.49 110859.46 16295.32 207576.09 00:25:48.389 00:25:48.389 20:31:19 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:48.389 20:31:20 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 2da9393d-7991-4649-b161-97a198a653af 00:25:48.956 20:31:20 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:49.215 20:31:20 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7eead123-e4b5-4dcf-9dd5-8b289f1292e5 00:25:49.475 20:31:21 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:49.475 20:31:21 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:25:49.475 20:31:21 -- host/perf.sh@114 -- # nvmftestfini 00:25:49.475 20:31:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:49.475 20:31:21 -- nvmf/common.sh@116 -- # sync 00:25:49.475 20:31:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:49.475 20:31:21 -- nvmf/common.sh@119 -- # set +e 00:25:49.475 20:31:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:49.475 20:31:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:49.475 rmmod nvme_tcp 00:25:49.734 rmmod nvme_fabrics 00:25:49.734 rmmod nvme_keyring 00:25:49.734 20:31:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:49.734 20:31:21 -- nvmf/common.sh@123 -- # set -e 00:25:49.734 20:31:21 -- nvmf/common.sh@124 -- # return 0 00:25:49.734 20:31:21 -- nvmf/common.sh@477 -- # '[' -n 3520662 ']' 00:25:49.734 20:31:21 -- nvmf/common.sh@478 -- # killprocess 3520662 00:25:49.734 20:31:21 -- common/autotest_common.sh@926 -- # '[' -z 3520662 ']' 00:25:49.734 20:31:21 -- common/autotest_common.sh@930 -- # kill -0 3520662 00:25:49.734 20:31:21 -- common/autotest_common.sh@931 -- # uname 00:25:49.734 20:31:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:49.734 20:31:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3520662 00:25:49.734 20:31:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:49.734 20:31:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:49.734 20:31:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3520662' 00:25:49.734 killing process with pid 3520662 00:25:49.734 20:31:21 -- common/autotest_common.sh@945 -- # kill 3520662 00:25:49.734 20:31:21 -- common/autotest_common.sh@950 -- # wait 3520662 00:25:51.637 20:31:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:51.637 20:31:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:51.637 20:31:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:51.637 20:31:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:51.637 20:31:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:51.637 20:31:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:51.637 20:31:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:51.637 20:31:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:53.547 20:31:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:53.547 00:25:53.547 real 1m32.584s 00:25:53.547 user 5m35.298s 00:25:53.547 sys 0m13.429s 00:25:53.547 20:31:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:53.547 20:31:25 -- common/autotest_common.sh@10 -- # set +x 00:25:53.547 ************************************ 00:25:53.547 END TEST nvmf_perf 00:25:53.547 ************************************ 00:25:53.547 20:31:25 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:53.547 20:31:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:53.547 20:31:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:53.547 20:31:25 -- common/autotest_common.sh@10 -- # set +x 00:25:53.547 ************************************ 00:25:53.547 START TEST nvmf_fio_host 00:25:53.547 ************************************ 00:25:53.547 20:31:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:53.547 * Looking for test storage... 00:25:53.547 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:53.547 20:31:25 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:53.547 20:31:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:53.547 20:31:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:53.547 20:31:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:53.547 20:31:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.547 20:31:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.547 20:31:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.547 20:31:25 -- paths/export.sh@5 -- # export PATH 00:25:53.547 20:31:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.547 20:31:25 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:53.547 20:31:25 -- nvmf/common.sh@7 -- # uname -s 00:25:53.547 20:31:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:53.547 20:31:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:53.547 20:31:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:53.547 20:31:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:53.547 20:31:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:53.547 20:31:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:53.547 20:31:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:53.547 20:31:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:53.547 20:31:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:53.547 20:31:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:53.547 20:31:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:25:53.547 20:31:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:25:53.547 20:31:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:53.547 20:31:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:53.547 20:31:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:53.547 20:31:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:53.547 20:31:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:53.547 20:31:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:53.548 20:31:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:53.548 20:31:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.548 20:31:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.548 20:31:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.548 20:31:25 -- paths/export.sh@5 -- # export PATH 00:25:53.548 20:31:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.548 20:31:25 -- nvmf/common.sh@46 -- # : 0 00:25:53.548 20:31:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:53.548 20:31:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:53.548 20:31:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:53.548 20:31:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:53.548 20:31:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:53.548 20:31:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:53.548 20:31:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:53.548 20:31:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:53.548 20:31:25 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:53.548 20:31:25 -- host/fio.sh@14 -- # nvmftestinit 00:25:53.548 20:31:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:53.548 20:31:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:53.548 20:31:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:53.548 20:31:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:53.548 20:31:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:53.548 20:31:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:53.548 20:31:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:53.548 20:31:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:53.548 20:31:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:53.548 20:31:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:53.548 20:31:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:53.548 20:31:25 -- common/autotest_common.sh@10 -- # set +x 00:25:58.868 20:31:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:58.868 20:31:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:58.868 20:31:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:58.868 20:31:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:58.868 20:31:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:58.868 20:31:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:58.868 20:31:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:58.868 20:31:30 -- nvmf/common.sh@294 -- # net_devs=() 00:25:58.868 20:31:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:58.868 20:31:30 -- nvmf/common.sh@295 -- # e810=() 00:25:58.868 20:31:30 -- nvmf/common.sh@295 -- # local -ga e810 00:25:58.868 20:31:30 -- nvmf/common.sh@296 -- # x722=() 00:25:58.868 20:31:30 -- nvmf/common.sh@296 -- # local -ga x722 00:25:58.868 20:31:30 -- nvmf/common.sh@297 -- # mlx=() 00:25:58.868 20:31:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:58.868 20:31:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:58.868 20:31:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:58.868 20:31:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:58.868 20:31:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:58.868 20:31:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:58.868 20:31:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:25:58.868 Found 0000:86:00.0 (0x8086 - 0x159b) 00:25:58.868 20:31:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:58.868 20:31:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:25:58.868 Found 0000:86:00.1 (0x8086 - 0x159b) 00:25:58.868 20:31:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:58.868 20:31:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:58.868 20:31:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:58.868 20:31:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:58.868 20:31:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:58.868 20:31:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:25:58.868 Found net devices under 0000:86:00.0: cvl_0_0 00:25:58.868 20:31:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:58.868 20:31:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:58.868 20:31:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:58.868 20:31:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:58.868 20:31:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:58.868 20:31:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:25:58.868 Found net devices under 0000:86:00.1: cvl_0_1 00:25:58.868 20:31:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:58.868 20:31:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:58.868 20:31:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:58.868 20:31:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:58.868 20:31:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:58.868 20:31:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:58.868 20:31:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:58.868 20:31:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:58.868 20:31:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:58.868 20:31:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:58.868 20:31:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:58.868 20:31:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:58.868 20:31:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:58.868 20:31:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:58.868 20:31:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:58.868 20:31:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:58.868 20:31:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:58.868 20:31:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:58.868 20:31:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:58.868 20:31:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:58.868 20:31:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:58.868 20:31:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:58.868 20:31:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:58.868 20:31:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:58.868 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:58.868 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:25:58.868 00:25:58.868 --- 10.0.0.2 ping statistics --- 00:25:58.868 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:58.868 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:25:58.868 20:31:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:58.868 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:58.868 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:25:58.868 00:25:58.868 --- 10.0.0.1 ping statistics --- 00:25:58.868 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:58.868 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:25:58.868 20:31:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:58.868 20:31:30 -- nvmf/common.sh@410 -- # return 0 00:25:58.868 20:31:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:58.868 20:31:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:58.868 20:31:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:58.868 20:31:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:58.868 20:31:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:58.868 20:31:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:58.868 20:31:30 -- host/fio.sh@16 -- # [[ y != y ]] 00:25:58.868 20:31:30 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:25:58.868 20:31:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:58.868 20:31:30 -- common/autotest_common.sh@10 -- # set +x 00:25:58.868 20:31:30 -- host/fio.sh@24 -- # nvmfpid=3538589 00:25:58.868 20:31:30 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:58.868 20:31:30 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:58.868 20:31:30 -- host/fio.sh@28 -- # waitforlisten 3538589 00:25:58.868 20:31:30 -- common/autotest_common.sh@819 -- # '[' -z 3538589 ']' 00:25:58.868 20:31:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:58.868 20:31:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:58.868 20:31:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:58.868 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:58.868 20:31:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:58.868 20:31:30 -- common/autotest_common.sh@10 -- # set +x 00:25:59.128 [2024-07-22 20:31:30.845263] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:25:59.128 [2024-07-22 20:31:30.845311] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:59.128 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.128 [2024-07-22 20:31:30.906690] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:59.128 [2024-07-22 20:31:30.980383] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:59.128 [2024-07-22 20:31:30.980511] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:59.128 [2024-07-22 20:31:30.980519] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:59.128 [2024-07-22 20:31:30.980525] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:59.128 [2024-07-22 20:31:30.980566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:59.128 [2024-07-22 20:31:30.980669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:59.128 [2024-07-22 20:31:30.980758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:59.128 [2024-07-22 20:31:30.980759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:00.066 20:31:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:00.066 20:31:31 -- common/autotest_common.sh@852 -- # return 0 00:26:00.066 20:31:31 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:26:00.066 [2024-07-22 20:31:31.803744] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:00.066 20:31:31 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:26:00.066 20:31:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:00.066 20:31:31 -- common/autotest_common.sh@10 -- # set +x 00:26:00.066 20:31:31 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:26:00.326 Malloc1 00:26:00.326 20:31:32 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:00.326 20:31:32 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:26:00.586 20:31:32 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:00.845 [2024-07-22 20:31:32.581804] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:00.845 20:31:32 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:01.123 20:31:32 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:26:01.123 20:31:32 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:01.123 20:31:32 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:01.123 20:31:32 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:26:01.123 20:31:32 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:01.123 20:31:32 -- common/autotest_common.sh@1318 -- # local sanitizers 00:26:01.123 20:31:32 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:01.123 20:31:32 -- common/autotest_common.sh@1320 -- # shift 00:26:01.123 20:31:32 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:26:01.123 20:31:32 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:26:01.123 20:31:32 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:01.123 20:31:32 -- common/autotest_common.sh@1324 -- # grep libasan 00:26:01.123 20:31:32 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:26:01.123 20:31:32 -- common/autotest_common.sh@1324 -- # asan_lib= 00:26:01.123 20:31:32 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:26:01.123 20:31:32 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:26:01.123 20:31:32 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:01.123 20:31:32 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:26:01.123 20:31:32 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:26:01.123 20:31:32 -- common/autotest_common.sh@1324 -- # asan_lib= 00:26:01.123 20:31:32 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:26:01.123 20:31:32 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:01.123 20:31:32 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:01.383 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:26:01.383 fio-3.35 00:26:01.383 Starting 1 thread 00:26:01.383 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.906 00:26:03.906 test: (groupid=0, jobs=1): err= 0: pid=3539143: Mon Jul 22 20:31:35 2024 00:26:03.906 read: IOPS=12.1k, BW=47.3MiB/s (49.6MB/s)(94.9MiB/2005msec) 00:26:03.906 slat (nsec): min=1611, max=4751.9k, avg=2369.02, stdev=30539.43 00:26:03.906 clat (usec): min=3563, max=16069, avg=6011.10, stdev=906.17 00:26:03.906 lat (usec): min=3565, max=16074, avg=6013.47, stdev=906.46 00:26:03.906 clat percentiles (usec): 00:26:03.906 | 1.00th=[ 4490], 5.00th=[ 4948], 10.00th=[ 5211], 20.00th=[ 5473], 00:26:03.906 | 30.00th=[ 5604], 40.00th=[ 5735], 50.00th=[ 5866], 60.00th=[ 5997], 00:26:03.906 | 70.00th=[ 6194], 80.00th=[ 6456], 90.00th=[ 6980], 95.00th=[ 7570], 00:26:03.906 | 99.00th=[ 9110], 99.50th=[10159], 99.90th=[14615], 99.95th=[14746], 00:26:03.906 | 99.99th=[15795] 00:26:03.906 bw ( KiB/s): min=46152, max=49512, per=99.97%, avg=48430.00, stdev=1535.99, samples=4 00:26:03.906 iops : min=11538, max=12378, avg=12107.50, stdev=384.00, samples=4 00:26:03.906 write: IOPS=12.1k, BW=47.1MiB/s (49.4MB/s)(94.5MiB/2005msec); 0 zone resets 00:26:03.906 slat (nsec): min=1664, max=248997, avg=2305.65, stdev=1773.05 00:26:03.906 clat (usec): min=2157, max=9036, avg=4491.27, stdev=584.07 00:26:03.906 lat (usec): min=2160, max=9041, avg=4493.57, stdev=584.23 00:26:03.906 clat percentiles (usec): 00:26:03.906 | 1.00th=[ 2900], 5.00th=[ 3458], 10.00th=[ 3785], 20.00th=[ 4113], 00:26:03.906 | 30.00th=[ 4293], 40.00th=[ 4424], 50.00th=[ 4555], 60.00th=[ 4621], 00:26:03.906 | 70.00th=[ 4752], 80.00th=[ 4883], 90.00th=[ 5080], 95.00th=[ 5211], 00:26:03.906 | 99.00th=[ 5669], 99.50th=[ 6915], 99.90th=[ 8717], 99.95th=[ 8717], 00:26:03.906 | 99.99th=[ 8979] 00:26:03.906 bw ( KiB/s): min=46656, max=49496, per=100.00%, avg=48260.00, stdev=1182.53, samples=4 00:26:03.906 iops : min=11664, max=12374, avg=12065.00, stdev=295.63, samples=4 00:26:03.906 lat (msec) : 4=7.98%, 10=91.76%, 20=0.26% 00:26:03.906 cpu : usr=66.22%, sys=28.49%, ctx=41, majf=0, minf=4 00:26:03.906 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:26:03.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:03.906 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:03.906 issued rwts: total=24282,24190,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:03.906 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:03.906 00:26:03.906 Run status group 0 (all jobs): 00:26:03.906 READ: bw=47.3MiB/s (49.6MB/s), 47.3MiB/s-47.3MiB/s (49.6MB/s-49.6MB/s), io=94.9MiB (99.5MB), run=2005-2005msec 00:26:03.906 WRITE: bw=47.1MiB/s (49.4MB/s), 47.1MiB/s-47.1MiB/s (49.4MB/s-49.4MB/s), io=94.5MiB (99.1MB), run=2005-2005msec 00:26:03.906 20:31:35 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:03.906 20:31:35 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:03.906 20:31:35 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:26:03.906 20:31:35 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:03.906 20:31:35 -- common/autotest_common.sh@1318 -- # local sanitizers 00:26:03.906 20:31:35 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:03.906 20:31:35 -- common/autotest_common.sh@1320 -- # shift 00:26:03.907 20:31:35 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:26:03.907 20:31:35 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:26:03.907 20:31:35 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:03.907 20:31:35 -- common/autotest_common.sh@1324 -- # grep libasan 00:26:03.907 20:31:35 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:26:03.907 20:31:35 -- common/autotest_common.sh@1324 -- # asan_lib= 00:26:03.907 20:31:35 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:26:03.907 20:31:35 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:26:03.907 20:31:35 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:03.907 20:31:35 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:26:03.907 20:31:35 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:26:03.907 20:31:35 -- common/autotest_common.sh@1324 -- # asan_lib= 00:26:03.907 20:31:35 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:26:03.907 20:31:35 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:03.907 20:31:35 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:03.907 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:26:03.907 fio-3.35 00:26:03.907 Starting 1 thread 00:26:03.907 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.433 00:26:06.433 test: (groupid=0, jobs=1): err= 0: pid=3539727: Mon Jul 22 20:31:38 2024 00:26:06.433 read: IOPS=9920, BW=155MiB/s (163MB/s)(310MiB/2003msec) 00:26:06.433 slat (usec): min=2, max=183, avg= 2.95, stdev= 2.46 00:26:06.433 clat (usec): min=1679, max=34012, avg=7782.43, stdev=3010.58 00:26:06.433 lat (usec): min=1681, max=34014, avg=7785.39, stdev=3011.27 00:26:06.433 clat percentiles (usec): 00:26:06.433 | 1.00th=[ 3851], 5.00th=[ 4555], 10.00th=[ 5014], 20.00th=[ 5669], 00:26:06.433 | 30.00th=[ 6325], 40.00th=[ 6849], 50.00th=[ 7373], 60.00th=[ 7832], 00:26:06.433 | 70.00th=[ 8291], 80.00th=[ 8848], 90.00th=[10159], 95.00th=[13566], 00:26:06.433 | 99.00th=[20579], 99.50th=[22676], 99.90th=[23462], 99.95th=[24249], 00:26:06.433 | 99.99th=[30016] 00:26:06.433 bw ( KiB/s): min=71136, max=87392, per=50.36%, avg=79928.00, stdev=6680.64, samples=4 00:26:06.433 iops : min= 4446, max= 5462, avg=4995.50, stdev=417.54, samples=4 00:26:06.433 write: IOPS=6018, BW=94.0MiB/s (98.6MB/s)(164MiB/1739msec); 0 zone resets 00:26:06.433 slat (usec): min=30, max=2377, avg=33.04, stdev=25.56 00:26:06.433 clat (usec): min=2404, max=28175, avg=8892.78, stdev=2769.49 00:26:06.433 lat (usec): min=2438, max=28208, avg=8925.81, stdev=2774.99 00:26:06.433 clat percentiles (usec): 00:26:06.433 | 1.00th=[ 5669], 5.00th=[ 6325], 10.00th=[ 6718], 20.00th=[ 7308], 00:26:06.433 | 30.00th=[ 7701], 40.00th=[ 8029], 50.00th=[ 8356], 60.00th=[ 8717], 00:26:06.433 | 70.00th=[ 9110], 80.00th=[ 9634], 90.00th=[10683], 95.00th=[13698], 00:26:06.433 | 99.00th=[22152], 99.50th=[23462], 99.90th=[25035], 99.95th=[25035], 00:26:06.433 | 99.99th=[25297] 00:26:06.433 bw ( KiB/s): min=74880, max=90880, per=86.53%, avg=83328.00, stdev=6561.22, samples=4 00:26:06.433 iops : min= 4680, max= 5680, avg=5208.00, stdev=410.08, samples=4 00:26:06.433 lat (msec) : 2=0.02%, 4=1.02%, 10=86.51%, 20=10.79%, 50=1.66% 00:26:06.433 cpu : usr=81.38%, sys=13.73%, ctx=64, majf=0, minf=1 00:26:06.433 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:26:06.433 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:06.433 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:06.433 issued rwts: total=19870,10467,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:06.433 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:06.433 00:26:06.433 Run status group 0 (all jobs): 00:26:06.433 READ: bw=155MiB/s (163MB/s), 155MiB/s-155MiB/s (163MB/s-163MB/s), io=310MiB (326MB), run=2003-2003msec 00:26:06.433 WRITE: bw=94.0MiB/s (98.6MB/s), 94.0MiB/s-94.0MiB/s (98.6MB/s-98.6MB/s), io=164MiB (171MB), run=1739-1739msec 00:26:06.433 20:31:38 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:06.433 20:31:38 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:26:06.433 20:31:38 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:26:06.433 20:31:38 -- host/fio.sh@51 -- # get_nvme_bdfs 00:26:06.433 20:31:38 -- common/autotest_common.sh@1498 -- # bdfs=() 00:26:06.433 20:31:38 -- common/autotest_common.sh@1498 -- # local bdfs 00:26:06.433 20:31:38 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:26:06.433 20:31:38 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:06.433 20:31:38 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:26:06.433 20:31:38 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:26:06.433 20:31:38 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:5e:00.0 00:26:06.433 20:31:38 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:5e:00.0 -i 10.0.0.2 00:26:09.709 Nvme0n1 00:26:09.709 20:31:41 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:26:12.231 20:31:44 -- host/fio.sh@53 -- # ls_guid=cc5fbda7-71f4-415d-aa89-b054889534f8 00:26:12.231 20:31:44 -- host/fio.sh@54 -- # get_lvs_free_mb cc5fbda7-71f4-415d-aa89-b054889534f8 00:26:12.231 20:31:44 -- common/autotest_common.sh@1343 -- # local lvs_uuid=cc5fbda7-71f4-415d-aa89-b054889534f8 00:26:12.231 20:31:44 -- common/autotest_common.sh@1344 -- # local lvs_info 00:26:12.231 20:31:44 -- common/autotest_common.sh@1345 -- # local fc 00:26:12.231 20:31:44 -- common/autotest_common.sh@1346 -- # local cs 00:26:12.231 20:31:44 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:12.488 20:31:44 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:26:12.488 { 00:26:12.488 "uuid": "cc5fbda7-71f4-415d-aa89-b054889534f8", 00:26:12.488 "name": "lvs_0", 00:26:12.488 "base_bdev": "Nvme0n1", 00:26:12.488 "total_data_clusters": 930, 00:26:12.488 "free_clusters": 930, 00:26:12.488 "block_size": 512, 00:26:12.488 "cluster_size": 1073741824 00:26:12.488 } 00:26:12.488 ]' 00:26:12.488 20:31:44 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="cc5fbda7-71f4-415d-aa89-b054889534f8") .free_clusters' 00:26:12.488 20:31:44 -- common/autotest_common.sh@1348 -- # fc=930 00:26:12.488 20:31:44 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="cc5fbda7-71f4-415d-aa89-b054889534f8") .cluster_size' 00:26:12.488 20:31:44 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:26:12.488 20:31:44 -- common/autotest_common.sh@1352 -- # free_mb=952320 00:26:12.488 20:31:44 -- common/autotest_common.sh@1353 -- # echo 952320 00:26:12.488 952320 00:26:12.488 20:31:44 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:26:13.052 9e5dace7-c238-4457-8dd9-12b5c80603f5 00:26:13.052 20:31:44 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:26:13.052 20:31:44 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:26:13.309 20:31:45 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:26:13.566 20:31:45 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:13.566 20:31:45 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:13.566 20:31:45 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:26:13.566 20:31:45 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:13.566 20:31:45 -- common/autotest_common.sh@1318 -- # local sanitizers 00:26:13.566 20:31:45 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:13.566 20:31:45 -- common/autotest_common.sh@1320 -- # shift 00:26:13.566 20:31:45 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:26:13.566 20:31:45 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:26:13.566 20:31:45 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:13.566 20:31:45 -- common/autotest_common.sh@1324 -- # grep libasan 00:26:13.566 20:31:45 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:26:13.566 20:31:45 -- common/autotest_common.sh@1324 -- # asan_lib= 00:26:13.566 20:31:45 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:26:13.566 20:31:45 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:26:13.566 20:31:45 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:13.566 20:31:45 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:26:13.567 20:31:45 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:26:13.567 20:31:45 -- common/autotest_common.sh@1324 -- # asan_lib= 00:26:13.567 20:31:45 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:26:13.567 20:31:45 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:13.567 20:31:45 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:13.824 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:26:13.824 fio-3.35 00:26:13.824 Starting 1 thread 00:26:13.824 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.347 00:26:16.347 test: (groupid=0, jobs=1): err= 0: pid=3541499: Mon Jul 22 20:31:48 2024 00:26:16.347 read: IOPS=7832, BW=30.6MiB/s (32.1MB/s)(61.3MiB/2005msec) 00:26:16.347 slat (nsec): min=1563, max=94581, avg=1729.39, stdev=1033.62 00:26:16.347 clat (msec): min=2, max=176, avg= 9.22, stdev=10.80 00:26:16.347 lat (msec): min=2, max=176, avg= 9.23, stdev=10.80 00:26:16.347 clat percentiles (msec): 00:26:16.347 | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:26:16.347 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:26:16.347 | 70.00th=[ 9], 80.00th=[ 10], 90.00th=[ 11], 95.00th=[ 12], 00:26:16.347 | 99.00th=[ 15], 99.50th=[ 17], 99.90th=[ 176], 99.95th=[ 176], 00:26:16.347 | 99.99th=[ 176] 00:26:16.347 bw ( KiB/s): min=21144, max=35600, per=99.72%, avg=31242.00, stdev=6789.61, samples=4 00:26:16.347 iops : min= 5286, max= 8900, avg=7810.50, stdev=1697.40, samples=4 00:26:16.347 write: IOPS=7803, BW=30.5MiB/s (32.0MB/s)(61.1MiB/2005msec); 0 zone resets 00:26:16.347 slat (nsec): min=1628, max=81064, avg=1815.00, stdev=704.87 00:26:16.347 clat (usec): min=226, max=172742, avg=7025.06, stdev=9914.02 00:26:16.347 lat (usec): min=228, max=172754, avg=7026.87, stdev=9914.19 00:26:16.347 clat percentiles (msec): 00:26:16.347 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:26:16.347 | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 7], 60.00th=[ 7], 00:26:16.347 | 70.00th=[ 7], 80.00th=[ 8], 90.00th=[ 8], 95.00th=[ 8], 00:26:16.347 | 99.00th=[ 10], 99.50th=[ 11], 99.90th=[ 171], 99.95th=[ 171], 00:26:16.347 | 99.99th=[ 174] 00:26:16.347 bw ( KiB/s): min=22224, max=34960, per=99.97%, avg=31204.00, stdev=6015.25, samples=4 00:26:16.347 iops : min= 5556, max= 8740, avg=7801.00, stdev=1503.81, samples=4 00:26:16.347 lat (usec) : 250=0.01%, 1000=0.01% 00:26:16.347 lat (msec) : 2=0.04%, 4=0.44%, 10=92.64%, 20=6.47%, 250=0.41% 00:26:16.347 cpu : usr=65.87%, sys=28.99%, ctx=51, majf=0, minf=4 00:26:16.347 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:26:16.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:16.347 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:16.347 issued rwts: total=15704,15646,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:16.347 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:16.347 00:26:16.347 Run status group 0 (all jobs): 00:26:16.347 READ: bw=30.6MiB/s (32.1MB/s), 30.6MiB/s-30.6MiB/s (32.1MB/s-32.1MB/s), io=61.3MiB (64.3MB), run=2005-2005msec 00:26:16.347 WRITE: bw=30.5MiB/s (32.0MB/s), 30.5MiB/s-30.5MiB/s (32.0MB/s-32.0MB/s), io=61.1MiB (64.1MB), run=2005-2005msec 00:26:16.347 20:31:48 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:16.604 20:31:48 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:26:17.536 20:31:49 -- host/fio.sh@64 -- # ls_nested_guid=f7652374-376d-4c73-bc6d-570ddfa18046 00:26:17.536 20:31:49 -- host/fio.sh@65 -- # get_lvs_free_mb f7652374-376d-4c73-bc6d-570ddfa18046 00:26:17.536 20:31:49 -- common/autotest_common.sh@1343 -- # local lvs_uuid=f7652374-376d-4c73-bc6d-570ddfa18046 00:26:17.536 20:31:49 -- common/autotest_common.sh@1344 -- # local lvs_info 00:26:17.536 20:31:49 -- common/autotest_common.sh@1345 -- # local fc 00:26:17.536 20:31:49 -- common/autotest_common.sh@1346 -- # local cs 00:26:17.536 20:31:49 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:17.793 20:31:49 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:26:17.793 { 00:26:17.793 "uuid": "cc5fbda7-71f4-415d-aa89-b054889534f8", 00:26:17.793 "name": "lvs_0", 00:26:17.793 "base_bdev": "Nvme0n1", 00:26:17.793 "total_data_clusters": 930, 00:26:17.793 "free_clusters": 0, 00:26:17.793 "block_size": 512, 00:26:17.793 "cluster_size": 1073741824 00:26:17.793 }, 00:26:17.793 { 00:26:17.793 "uuid": "f7652374-376d-4c73-bc6d-570ddfa18046", 00:26:17.793 "name": "lvs_n_0", 00:26:17.793 "base_bdev": "9e5dace7-c238-4457-8dd9-12b5c80603f5", 00:26:17.793 "total_data_clusters": 237847, 00:26:17.793 "free_clusters": 237847, 00:26:17.793 "block_size": 512, 00:26:17.793 "cluster_size": 4194304 00:26:17.793 } 00:26:17.793 ]' 00:26:17.793 20:31:49 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="f7652374-376d-4c73-bc6d-570ddfa18046") .free_clusters' 00:26:17.793 20:31:49 -- common/autotest_common.sh@1348 -- # fc=237847 00:26:17.793 20:31:49 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="f7652374-376d-4c73-bc6d-570ddfa18046") .cluster_size' 00:26:17.793 20:31:49 -- common/autotest_common.sh@1349 -- # cs=4194304 00:26:17.793 20:31:49 -- common/autotest_common.sh@1352 -- # free_mb=951388 00:26:17.793 20:31:49 -- common/autotest_common.sh@1353 -- # echo 951388 00:26:17.793 951388 00:26:17.793 20:31:49 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:26:18.356 ad54f8f8-6d8f-42b6-84ba-884141ec5046 00:26:18.357 20:31:50 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:26:18.614 20:31:50 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:26:18.614 20:31:50 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:26:18.870 20:31:50 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:18.870 20:31:50 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:18.870 20:31:50 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:26:18.871 20:31:50 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:18.871 20:31:50 -- common/autotest_common.sh@1318 -- # local sanitizers 00:26:18.871 20:31:50 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:18.871 20:31:50 -- common/autotest_common.sh@1320 -- # shift 00:26:18.871 20:31:50 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:26:18.871 20:31:50 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:26:18.871 20:31:50 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:18.871 20:31:50 -- common/autotest_common.sh@1324 -- # grep libasan 00:26:18.871 20:31:50 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:26:18.871 20:31:50 -- common/autotest_common.sh@1324 -- # asan_lib= 00:26:18.871 20:31:50 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:26:18.871 20:31:50 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:26:18.871 20:31:50 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:18.871 20:31:50 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:26:18.871 20:31:50 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:26:18.871 20:31:50 -- common/autotest_common.sh@1324 -- # asan_lib= 00:26:18.871 20:31:50 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:26:18.871 20:31:50 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:18.871 20:31:50 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:19.128 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:26:19.128 fio-3.35 00:26:19.128 Starting 1 thread 00:26:19.128 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.650 00:26:21.650 test: (groupid=0, jobs=1): err= 0: pid=3542552: Mon Jul 22 20:31:53 2024 00:26:21.650 read: IOPS=7968, BW=31.1MiB/s (32.6MB/s)(62.5MiB/2007msec) 00:26:21.650 slat (nsec): min=1644, max=110486, avg=2227.71, stdev=1269.56 00:26:21.650 clat (usec): min=2998, max=15391, avg=8926.71, stdev=759.30 00:26:21.650 lat (usec): min=3003, max=15393, avg=8928.93, stdev=759.22 00:26:21.650 clat percentiles (usec): 00:26:21.650 | 1.00th=[ 7177], 5.00th=[ 7767], 10.00th=[ 8029], 20.00th=[ 8356], 00:26:21.650 | 30.00th=[ 8586], 40.00th=[ 8717], 50.00th=[ 8848], 60.00th=[ 9110], 00:26:21.650 | 70.00th=[ 9372], 80.00th=[ 9503], 90.00th=[ 9896], 95.00th=[10159], 00:26:21.650 | 99.00th=[10683], 99.50th=[10814], 99.90th=[12256], 99.95th=[13566], 00:26:21.650 | 99.99th=[14746] 00:26:21.650 bw ( KiB/s): min=30880, max=32264, per=99.92%, avg=31850.00, stdev=652.49, samples=4 00:26:21.650 iops : min= 7720, max= 8066, avg=7962.50, stdev=163.12, samples=4 00:26:21.650 write: IOPS=7945, BW=31.0MiB/s (32.5MB/s)(62.3MiB/2007msec); 0 zone resets 00:26:21.650 slat (nsec): min=1708, max=100299, avg=2336.77, stdev=949.89 00:26:21.650 clat (usec): min=1918, max=13454, avg=7093.81, stdev=669.21 00:26:21.650 lat (usec): min=1924, max=13456, avg=7096.15, stdev=669.17 00:26:21.650 clat percentiles (usec): 00:26:21.650 | 1.00th=[ 5538], 5.00th=[ 6063], 10.00th=[ 6325], 20.00th=[ 6587], 00:26:21.650 | 30.00th=[ 6783], 40.00th=[ 6980], 50.00th=[ 7111], 60.00th=[ 7242], 00:26:21.650 | 70.00th=[ 7439], 80.00th=[ 7635], 90.00th=[ 7898], 95.00th=[ 8094], 00:26:21.650 | 99.00th=[ 8586], 99.50th=[ 8717], 99.90th=[11600], 99.95th=[12518], 00:26:21.650 | 99.99th=[13435] 00:26:21.650 bw ( KiB/s): min=31744, max=31808, per=99.98%, avg=31776.00, stdev=36.95, samples=4 00:26:21.650 iops : min= 7936, max= 7952, avg=7944.00, stdev= 9.24, samples=4 00:26:21.650 lat (msec) : 2=0.01%, 4=0.10%, 10=96.15%, 20=3.75% 00:26:21.650 cpu : usr=64.31%, sys=31.46%, ctx=51, majf=0, minf=4 00:26:21.650 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:26:21.650 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:21.650 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:21.650 issued rwts: total=15993,15947,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:21.650 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:21.650 00:26:21.650 Run status group 0 (all jobs): 00:26:21.650 READ: bw=31.1MiB/s (32.6MB/s), 31.1MiB/s-31.1MiB/s (32.6MB/s-32.6MB/s), io=62.5MiB (65.5MB), run=2007-2007msec 00:26:21.650 WRITE: bw=31.0MiB/s (32.5MB/s), 31.0MiB/s-31.0MiB/s (32.5MB/s-32.5MB/s), io=62.3MiB (65.3MB), run=2007-2007msec 00:26:21.650 20:31:53 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:26:21.908 20:31:53 -- host/fio.sh@74 -- # sync 00:26:21.908 20:31:53 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_n_0/lbd_nest_0 00:26:26.150 20:31:57 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:26:26.150 20:31:57 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:26:28.679 20:32:00 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:26:28.679 20:32:00 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:26:30.578 20:32:02 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:26:30.578 20:32:02 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:26:30.578 20:32:02 -- host/fio.sh@86 -- # nvmftestfini 00:26:30.578 20:32:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:30.578 20:32:02 -- nvmf/common.sh@116 -- # sync 00:26:30.578 20:32:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:30.578 20:32:02 -- nvmf/common.sh@119 -- # set +e 00:26:30.578 20:32:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:30.578 20:32:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:30.578 rmmod nvme_tcp 00:26:30.578 rmmod nvme_fabrics 00:26:30.578 rmmod nvme_keyring 00:26:30.578 20:32:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:30.578 20:32:02 -- nvmf/common.sh@123 -- # set -e 00:26:30.578 20:32:02 -- nvmf/common.sh@124 -- # return 0 00:26:30.578 20:32:02 -- nvmf/common.sh@477 -- # '[' -n 3538589 ']' 00:26:30.578 20:32:02 -- nvmf/common.sh@478 -- # killprocess 3538589 00:26:30.578 20:32:02 -- common/autotest_common.sh@926 -- # '[' -z 3538589 ']' 00:26:30.578 20:32:02 -- common/autotest_common.sh@930 -- # kill -0 3538589 00:26:30.578 20:32:02 -- common/autotest_common.sh@931 -- # uname 00:26:30.578 20:32:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:30.578 20:32:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3538589 00:26:30.578 20:32:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:30.578 20:32:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:30.578 20:32:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3538589' 00:26:30.578 killing process with pid 3538589 00:26:30.578 20:32:02 -- common/autotest_common.sh@945 -- # kill 3538589 00:26:30.578 20:32:02 -- common/autotest_common.sh@950 -- # wait 3538589 00:26:30.837 20:32:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:30.837 20:32:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:30.837 20:32:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:30.837 20:32:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:30.837 20:32:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:30.837 20:32:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:30.837 20:32:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:30.837 20:32:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:32.747 20:32:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:32.747 00:26:32.747 real 0m39.528s 00:26:32.747 user 2m38.266s 00:26:32.747 sys 0m8.725s 00:26:32.747 20:32:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:32.747 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:26:32.747 ************************************ 00:26:32.747 END TEST nvmf_fio_host 00:26:32.747 ************************************ 00:26:33.006 20:32:04 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:26:33.006 20:32:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:33.006 20:32:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:33.006 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:26:33.006 ************************************ 00:26:33.006 START TEST nvmf_failover 00:26:33.006 ************************************ 00:26:33.006 20:32:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:26:33.006 * Looking for test storage... 00:26:33.006 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:33.006 20:32:04 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:33.006 20:32:04 -- nvmf/common.sh@7 -- # uname -s 00:26:33.006 20:32:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:33.006 20:32:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:33.006 20:32:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:33.006 20:32:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:33.006 20:32:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:33.006 20:32:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:33.006 20:32:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:33.006 20:32:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:33.006 20:32:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:33.006 20:32:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:33.006 20:32:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:26:33.006 20:32:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:26:33.006 20:32:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:33.006 20:32:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:33.006 20:32:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:33.006 20:32:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:33.006 20:32:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:33.006 20:32:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:33.006 20:32:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:33.006 20:32:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.006 20:32:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.007 20:32:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.007 20:32:04 -- paths/export.sh@5 -- # export PATH 00:26:33.007 20:32:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.007 20:32:04 -- nvmf/common.sh@46 -- # : 0 00:26:33.007 20:32:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:33.007 20:32:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:33.007 20:32:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:33.007 20:32:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:33.007 20:32:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:33.007 20:32:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:33.007 20:32:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:33.007 20:32:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:33.007 20:32:04 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:33.007 20:32:04 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:33.007 20:32:04 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:33.007 20:32:04 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:26:33.007 20:32:04 -- host/failover.sh@18 -- # nvmftestinit 00:26:33.007 20:32:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:33.007 20:32:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:33.007 20:32:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:33.007 20:32:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:33.007 20:32:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:33.007 20:32:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:33.007 20:32:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:33.007 20:32:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:33.007 20:32:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:33.007 20:32:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:33.007 20:32:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:33.007 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:26:38.284 20:32:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:38.284 20:32:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:38.284 20:32:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:38.284 20:32:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:38.284 20:32:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:38.284 20:32:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:38.284 20:32:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:38.284 20:32:09 -- nvmf/common.sh@294 -- # net_devs=() 00:26:38.284 20:32:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:38.284 20:32:09 -- nvmf/common.sh@295 -- # e810=() 00:26:38.284 20:32:09 -- nvmf/common.sh@295 -- # local -ga e810 00:26:38.284 20:32:09 -- nvmf/common.sh@296 -- # x722=() 00:26:38.284 20:32:09 -- nvmf/common.sh@296 -- # local -ga x722 00:26:38.284 20:32:09 -- nvmf/common.sh@297 -- # mlx=() 00:26:38.284 20:32:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:38.284 20:32:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:38.284 20:32:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:38.284 20:32:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:38.284 20:32:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:38.284 20:32:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:38.284 20:32:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:38.284 20:32:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:38.284 20:32:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:38.285 20:32:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:26:38.285 Found 0000:86:00.0 (0x8086 - 0x159b) 00:26:38.285 20:32:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:38.285 20:32:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:26:38.285 Found 0000:86:00.1 (0x8086 - 0x159b) 00:26:38.285 20:32:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:38.285 20:32:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:38.285 20:32:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:38.285 20:32:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:38.285 20:32:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:38.285 20:32:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:26:38.285 Found net devices under 0000:86:00.0: cvl_0_0 00:26:38.285 20:32:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:38.285 20:32:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:38.285 20:32:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:38.285 20:32:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:38.285 20:32:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:38.285 20:32:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:26:38.285 Found net devices under 0000:86:00.1: cvl_0_1 00:26:38.285 20:32:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:38.285 20:32:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:38.285 20:32:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:38.285 20:32:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:38.285 20:32:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:38.285 20:32:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:38.285 20:32:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:38.285 20:32:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:38.285 20:32:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:38.285 20:32:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:38.285 20:32:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:38.285 20:32:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:38.285 20:32:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:38.285 20:32:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:38.285 20:32:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:38.285 20:32:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:38.285 20:32:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:38.285 20:32:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:38.285 20:32:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:38.285 20:32:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:38.285 20:32:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:38.285 20:32:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:38.285 20:32:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:38.285 20:32:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:38.285 20:32:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:38.285 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:38.285 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.171 ms 00:26:38.285 00:26:38.285 --- 10.0.0.2 ping statistics --- 00:26:38.285 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:38.285 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:26:38.285 20:32:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:38.285 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:38.285 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.227 ms 00:26:38.285 00:26:38.285 --- 10.0.0.1 ping statistics --- 00:26:38.285 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:38.285 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:26:38.285 20:32:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:38.285 20:32:10 -- nvmf/common.sh@410 -- # return 0 00:26:38.285 20:32:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:38.285 20:32:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:38.285 20:32:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:38.285 20:32:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:38.285 20:32:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:38.285 20:32:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:38.285 20:32:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:38.285 20:32:10 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:26:38.285 20:32:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:38.285 20:32:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:38.285 20:32:10 -- common/autotest_common.sh@10 -- # set +x 00:26:38.285 20:32:10 -- nvmf/common.sh@469 -- # nvmfpid=3547721 00:26:38.285 20:32:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:38.285 20:32:10 -- nvmf/common.sh@470 -- # waitforlisten 3547721 00:26:38.285 20:32:10 -- common/autotest_common.sh@819 -- # '[' -z 3547721 ']' 00:26:38.285 20:32:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:38.285 20:32:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:38.285 20:32:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:38.285 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:38.285 20:32:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:38.285 20:32:10 -- common/autotest_common.sh@10 -- # set +x 00:26:38.285 [2024-07-22 20:32:10.108319] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:26:38.285 [2024-07-22 20:32:10.108361] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:38.285 EAL: No free 2048 kB hugepages reported on node 1 00:26:38.285 [2024-07-22 20:32:10.166409] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:38.544 [2024-07-22 20:32:10.239684] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:38.544 [2024-07-22 20:32:10.239797] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:38.544 [2024-07-22 20:32:10.239804] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:38.544 [2024-07-22 20:32:10.239811] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:38.544 [2024-07-22 20:32:10.239951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:38.544 [2024-07-22 20:32:10.240035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:38.544 [2024-07-22 20:32:10.240037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:39.110 20:32:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:39.110 20:32:10 -- common/autotest_common.sh@852 -- # return 0 00:26:39.110 20:32:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:39.110 20:32:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:39.110 20:32:10 -- common/autotest_common.sh@10 -- # set +x 00:26:39.110 20:32:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:39.110 20:32:10 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:26:39.369 [2024-07-22 20:32:11.109482] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:39.369 20:32:11 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:26:39.627 Malloc0 00:26:39.627 20:32:11 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:39.627 20:32:11 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:39.885 20:32:11 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:40.143 [2024-07-22 20:32:11.833837] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:40.143 20:32:11 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:40.143 [2024-07-22 20:32:12.002338] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:40.143 20:32:12 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:40.402 [2024-07-22 20:32:12.170905] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:26:40.402 20:32:12 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:26:40.402 20:32:12 -- host/failover.sh@31 -- # bdevperf_pid=3548003 00:26:40.402 20:32:12 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:40.402 20:32:12 -- host/failover.sh@34 -- # waitforlisten 3548003 /var/tmp/bdevperf.sock 00:26:40.402 20:32:12 -- common/autotest_common.sh@819 -- # '[' -z 3548003 ']' 00:26:40.402 20:32:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:40.402 20:32:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:40.402 20:32:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:40.402 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:40.402 20:32:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:40.402 20:32:12 -- common/autotest_common.sh@10 -- # set +x 00:26:41.335 20:32:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:41.335 20:32:13 -- common/autotest_common.sh@852 -- # return 0 00:26:41.335 20:32:13 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:41.592 NVMe0n1 00:26:41.592 20:32:13 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:42.159 00:26:42.159 20:32:13 -- host/failover.sh@39 -- # run_test_pid=3548351 00:26:42.159 20:32:13 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:42.159 20:32:13 -- host/failover.sh@41 -- # sleep 1 00:26:43.093 20:32:14 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:43.093 [2024-07-22 20:32:14.985537] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985604] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985612] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985619] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985625] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985632] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985638] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985659] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985672] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985678] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985684] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985695] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985701] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985707] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985713] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985725] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985731] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985737] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985743] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985748] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985754] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985760] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985767] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985778] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985785] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985790] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985808] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985821] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985829] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985835] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985847] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985853] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985859] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985865] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985877] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985883] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985889] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985894] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985900] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985912] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.093 [2024-07-22 20:32:14.985917] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985923] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985929] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985935] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985941] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985953] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985964] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985970] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985976] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.985995] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986015] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986027] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986033] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986038] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986055] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986061] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986067] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986073] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986091] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986097] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986108] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986120] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 [2024-07-22 20:32:14.986126] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3d600 is same with the state(5) to be set 00:26:43.094 20:32:15 -- host/failover.sh@45 -- # sleep 3 00:26:46.376 20:32:18 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:46.635 00:26:46.635 20:32:18 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:46.635 [2024-07-22 20:32:18.550125] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550171] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550178] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550185] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550190] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550196] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550202] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550208] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550214] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550225] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550236] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550242] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550247] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550253] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550258] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550264] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550270] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550276] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550282] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550294] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550300] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550322] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550340] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550345] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550363] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550369] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550375] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550387] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550393] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550399] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550405] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550411] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550417] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550428] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550441] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550447] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550459] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550472] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550478] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550497] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550510] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550522] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550528] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.635 [2024-07-22 20:32:18.550534] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e240 is same with the state(5) to be set 00:26:46.894 20:32:18 -- host/failover.sh@50 -- # sleep 3 00:26:50.177 20:32:21 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:50.177 [2024-07-22 20:32:21.744951] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:50.177 20:32:21 -- host/failover.sh@55 -- # sleep 1 00:26:51.113 20:32:22 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:51.113 [2024-07-22 20:32:22.934378] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934420] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934427] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934434] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934446] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934452] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934458] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934463] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934469] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934475] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934480] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934486] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934498] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934515] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934532] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934550] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934555] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934561] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934567] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934578] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934584] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934590] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934601] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934607] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934613] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934620] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934626] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934632] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934638] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.113 [2024-07-22 20:32:22.934644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934656] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934662] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934676] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934682] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934688] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934695] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934701] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934707] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934713] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934725] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934731] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934737] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934743] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934749] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934767] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934779] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934786] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934791] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934797] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934803] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934809] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934816] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934822] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934829] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934835] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 [2024-07-22 20:32:22.934842] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a98c10 is same with the state(5) to be set 00:26:51.114 20:32:22 -- host/failover.sh@59 -- # wait 3548351 00:26:57.713 0 00:26:57.713 20:32:28 -- host/failover.sh@61 -- # killprocess 3548003 00:26:57.713 20:32:28 -- common/autotest_common.sh@926 -- # '[' -z 3548003 ']' 00:26:57.713 20:32:28 -- common/autotest_common.sh@930 -- # kill -0 3548003 00:26:57.713 20:32:28 -- common/autotest_common.sh@931 -- # uname 00:26:57.713 20:32:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:57.713 20:32:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3548003 00:26:57.713 20:32:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:57.713 20:32:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:57.713 20:32:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3548003' 00:26:57.713 killing process with pid 3548003 00:26:57.713 20:32:29 -- common/autotest_common.sh@945 -- # kill 3548003 00:26:57.713 20:32:29 -- common/autotest_common.sh@950 -- # wait 3548003 00:26:57.713 20:32:29 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:57.713 [2024-07-22 20:32:12.229527] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:26:57.713 [2024-07-22 20:32:12.229579] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3548003 ] 00:26:57.713 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.713 [2024-07-22 20:32:12.284420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.713 [2024-07-22 20:32:12.357685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:57.713 Running I/O for 15 seconds... 00:26:57.713 [2024-07-22 20:32:14.986523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:14024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:14040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:13440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:13456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:13464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:13472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:13520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:13552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:13560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:14072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:14088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:14096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:14104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:14112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:14136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:14176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:14184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:14192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:14200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:13592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:13640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:13656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.986988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:13672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.713 [2024-07-22 20:32:14.986994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.713 [2024-07-22 20:32:14.987002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:13696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:13712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:14224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:14280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:14296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:14304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:14312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:14320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:14328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:14336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:14352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:13728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:13736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:13744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:13752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:13760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:13792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:14360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:14376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:14384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:14392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:14400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:14408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:14424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:14432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:14440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:14448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:14464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:14472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:14480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.714 [2024-07-22 20:32:14.987572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.714 [2024-07-22 20:32:14.987580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:13832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.714 [2024-07-22 20:32:14.987586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:13848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:13856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:13888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:13920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:13952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:13976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:14488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:14496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:14504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:14512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:14520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.987781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:14016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:14032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:14048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:14056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:14080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:14120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:14152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:14536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:14544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:14552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:14560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.987959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:14568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.987973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:14576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.987987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.987995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:14584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:14592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:14600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:14608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:14616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:14624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.715 [2024-07-22 20:32:14.988081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:14632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:14640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:14648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:14656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.715 [2024-07-22 20:32:14.988145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:14664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.715 [2024-07-22 20:32:14.988151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:14672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.716 [2024-07-22 20:32:14.988166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:14680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.716 [2024-07-22 20:32:14.988180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:14688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.716 [2024-07-22 20:32:14.988194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:14696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.716 [2024-07-22 20:32:14.988208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:14704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:14712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:14720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:14728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.716 [2024-07-22 20:32:14.988272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:14736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:14744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.716 [2024-07-22 20:32:14.988300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:14752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:14760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.716 [2024-07-22 20:32:14.988328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:14768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.716 [2024-07-22 20:32:14.988342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:14776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:14208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:14216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:14232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:14248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:14264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:14272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:14.988459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8a010 is same with the state(5) to be set 00:26:57.716 [2024-07-22 20:32:14.988475] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:57.716 [2024-07-22 20:32:14.988481] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:57.716 [2024-07-22 20:32:14.988487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14288 len:8 PRP1 0x0 PRP2 0x0 00:26:57.716 [2024-07-22 20:32:14.988494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988536] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xb8a010 was disconnected and freed. reset controller. 00:26:57.716 [2024-07-22 20:32:14.988549] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:57.716 [2024-07-22 20:32:14.988571] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.716 [2024-07-22 20:32:14.988579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988586] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.716 [2024-07-22 20:32:14.988592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988599] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.716 [2024-07-22 20:32:14.988605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988613] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.716 [2024-07-22 20:32:14.988619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:14.988625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:57.716 [2024-07-22 20:32:14.990345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:57.716 [2024-07-22 20:32:14.990367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb94010 (9): Bad file descriptor 00:26:57.716 [2024-07-22 20:32:15.020103] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:57.716 [2024-07-22 20:32:18.550794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:112400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:112408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:111704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:111712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:111728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:111736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:111744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:111768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:111784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.716 [2024-07-22 20:32:18.550956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.716 [2024-07-22 20:32:18.550963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:111792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.550970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.550979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:112440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.550986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.550993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:112448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:112464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:112472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:112496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:112504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:112512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:111808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:111824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:111832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:111864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:111872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:111888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:111912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:111944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:112536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:112544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:112560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:112568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:111952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:111968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:111976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:112024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:112032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:112072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:112080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:112120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:112584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:112592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:112600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.717 [2024-07-22 20:32:18.551414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.717 [2024-07-22 20:32:18.551422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:112608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:112632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:112640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:112648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:112656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:112672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:112688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:112696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:112704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:112712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:112720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:112728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:112736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:112744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:112752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:112760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:112768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:112776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:112144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:112152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:112160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:112192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:112200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:112208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:112232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:112240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:112784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:112792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:112800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:112808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:112816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:112824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:112832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:112840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:112848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:112856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:112864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:112872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.718 [2024-07-22 20:32:18.551965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:112880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.718 [2024-07-22 20:32:18.551979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.718 [2024-07-22 20:32:18.551987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:112888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.551993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:112896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:112904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:112248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:112264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:112296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:112312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:112320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:112328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:112344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:112368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:112912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:112920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:112928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:112936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:112944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:112952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:112960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:112968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:112976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:112984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:112992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:113000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:113008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:112384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:112392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:112416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:112424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:112432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:112456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:112480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:112488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:113016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:113024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:113032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:113040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:113048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:113056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:113064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.719 [2024-07-22 20:32:18.552547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.719 [2024-07-22 20:32:18.552555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:113072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.719 [2024-07-22 20:32:18.552561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:113080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.720 [2024-07-22 20:32:18.552576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:112520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:18.552590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:112528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:18.552603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:112552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:18.552617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:112576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:18.552631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:112616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:18.552646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:112624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:18.552659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:112664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:18.552673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8c120 is same with the state(5) to be set 00:26:57.720 [2024-07-22 20:32:18.552691] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:57.720 [2024-07-22 20:32:18.552695] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:57.720 [2024-07-22 20:32:18.552702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:112680 len:8 PRP1 0x0 PRP2 0x0 00:26:57.720 [2024-07-22 20:32:18.552709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552749] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xb8c120 was disconnected and freed. reset controller. 00:26:57.720 [2024-07-22 20:32:18.552758] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:26:57.720 [2024-07-22 20:32:18.552781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.720 [2024-07-22 20:32:18.552788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.720 [2024-07-22 20:32:18.552802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552809] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.720 [2024-07-22 20:32:18.552815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552821] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.720 [2024-07-22 20:32:18.552828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:18.552835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:57.720 [2024-07-22 20:32:18.554612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:57.720 [2024-07-22 20:32:18.554635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb94010 (9): Bad file descriptor 00:26:57.720 [2024-07-22 20:32:18.588726] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:57.720 [2024-07-22 20:32:22.935098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:63224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:63232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:63240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:63256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:63264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:63280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:62696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:62712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:62720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:62736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:62744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:62768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:62776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:62792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:63328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:62816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:62840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:62856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:62864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:62872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:62888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.720 [2024-07-22 20:32:22.935447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:62896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.720 [2024-07-22 20:32:22.935453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:62928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:63336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:63344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:63352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:63392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:63400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:63408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:63416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:63432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:63440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:63456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:63472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:63480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:63488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:63504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:63512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:62936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:62944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:62992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:63016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:63024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:63032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:63048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:63064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:63520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.935820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:63528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.935835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:63536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.935850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:63544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.935865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:63552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:63560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:63568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.935908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:63576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.935922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:63584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:63592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.935952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:63600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:63608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.935981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.935990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:63616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.935997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.936005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:63624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.721 [2024-07-22 20:32:22.936011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.936020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:63632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.721 [2024-07-22 20:32:22.936026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.721 [2024-07-22 20:32:22.936034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:63640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:63648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:63656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:63664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:63672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:63680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:63688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:63696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:63072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:63080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:63088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:63128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:63136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:63168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:63176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:63184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:63704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:63712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:63720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:63728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:63736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:63744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:63752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:63760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:63768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:63776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:63784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:63792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:63800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.722 [2024-07-22 20:32:22.936456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:63808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.722 [2024-07-22 20:32:22.936481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:63816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.722 [2024-07-22 20:32:22.936487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:63824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:63832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:63216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:63248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:63272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:63288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:63296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:63304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:63312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:63320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:63840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:63848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:63856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:63864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:63872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:63880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:63888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:63896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:63904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:63912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:63920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:63928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:63936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:63944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:63952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:63960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:63968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:63976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:57.723 [2024-07-22 20:32:22.936901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:63360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:63368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:63376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:63384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:63424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:63448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.936989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.936997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:63464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.723 [2024-07-22 20:32:22.937003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.937010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xba0560 is same with the state(5) to be set 00:26:57.723 [2024-07-22 20:32:22.937019] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:57.723 [2024-07-22 20:32:22.937024] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:57.723 [2024-07-22 20:32:22.937030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:63496 len:8 PRP1 0x0 PRP2 0x0 00:26:57.723 [2024-07-22 20:32:22.937036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.723 [2024-07-22 20:32:22.937084] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xba0560 was disconnected and freed. reset controller. 00:26:57.723 [2024-07-22 20:32:22.937093] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:26:57.723 [2024-07-22 20:32:22.937114] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.723 [2024-07-22 20:32:22.937123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.724 [2024-07-22 20:32:22.937130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.724 [2024-07-22 20:32:22.937136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.724 [2024-07-22 20:32:22.937143] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.724 [2024-07-22 20:32:22.937149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.724 [2024-07-22 20:32:22.937156] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:57.724 [2024-07-22 20:32:22.937162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:57.724 [2024-07-22 20:32:22.937169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:57.724 [2024-07-22 20:32:22.939087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:57.724 [2024-07-22 20:32:22.939113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb94010 (9): Bad file descriptor 00:26:57.724 [2024-07-22 20:32:23.007445] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:57.724 00:26:57.724 Latency(us) 00:26:57.724 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:57.724 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:57.724 Verification LBA range: start 0x0 length 0x4000 00:26:57.724 NVMe0n1 : 15.00 16672.42 65.13 620.96 0.00 7388.50 897.56 16184.54 00:26:57.724 =================================================================================================================== 00:26:57.724 Total : 16672.42 65.13 620.96 0.00 7388.50 897.56 16184.54 00:26:57.724 Received shutdown signal, test time was about 15.000000 seconds 00:26:57.724 00:26:57.724 Latency(us) 00:26:57.724 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:57.724 =================================================================================================================== 00:26:57.724 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:57.724 20:32:29 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:26:57.724 20:32:29 -- host/failover.sh@65 -- # count=3 00:26:57.724 20:32:29 -- host/failover.sh@67 -- # (( count != 3 )) 00:26:57.724 20:32:29 -- host/failover.sh@73 -- # bdevperf_pid=3550802 00:26:57.724 20:32:29 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:26:57.724 20:32:29 -- host/failover.sh@75 -- # waitforlisten 3550802 /var/tmp/bdevperf.sock 00:26:57.724 20:32:29 -- common/autotest_common.sh@819 -- # '[' -z 3550802 ']' 00:26:57.724 20:32:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:57.724 20:32:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:57.724 20:32:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:57.724 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:57.724 20:32:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:57.724 20:32:29 -- common/autotest_common.sh@10 -- # set +x 00:26:58.289 20:32:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:58.289 20:32:30 -- common/autotest_common.sh@852 -- # return 0 00:26:58.289 20:32:30 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:58.547 [2024-07-22 20:32:30.234790] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:58.547 20:32:30 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:58.547 [2024-07-22 20:32:30.399280] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:26:58.547 20:32:30 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:58.805 NVMe0n1 00:26:59.062 20:32:30 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:59.320 00:26:59.320 20:32:31 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:59.577 00:26:59.577 20:32:31 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:59.577 20:32:31 -- host/failover.sh@82 -- # grep -q NVMe0 00:26:59.835 20:32:31 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:59.835 20:32:31 -- host/failover.sh@87 -- # sleep 3 00:27:03.116 20:32:34 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:03.116 20:32:34 -- host/failover.sh@88 -- # grep -q NVMe0 00:27:03.116 20:32:34 -- host/failover.sh@90 -- # run_test_pid=3551745 00:27:03.116 20:32:34 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:03.116 20:32:34 -- host/failover.sh@92 -- # wait 3551745 00:27:04.489 0 00:27:04.489 20:32:36 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:04.489 [2024-07-22 20:32:29.268409] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:27:04.489 [2024-07-22 20:32:29.268461] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3550802 ] 00:27:04.489 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.489 [2024-07-22 20:32:29.323715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:04.489 [2024-07-22 20:32:29.390737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:04.489 [2024-07-22 20:32:31.702019] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:27:04.489 [2024-07-22 20:32:31.702067] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:04.489 [2024-07-22 20:32:31.702079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:04.489 [2024-07-22 20:32:31.702087] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:04.490 [2024-07-22 20:32:31.702094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:04.490 [2024-07-22 20:32:31.702101] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:04.490 [2024-07-22 20:32:31.702107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:04.490 [2024-07-22 20:32:31.702114] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:04.490 [2024-07-22 20:32:31.702121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:04.490 [2024-07-22 20:32:31.702128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.490 [2024-07-22 20:32:31.702148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.490 [2024-07-22 20:32:31.702160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x226f010 (9): Bad file descriptor 00:27:04.490 [2024-07-22 20:32:31.713482] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:04.490 Running I/O for 1 seconds... 00:27:04.490 00:27:04.490 Latency(us) 00:27:04.490 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.490 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:04.490 Verification LBA range: start 0x0 length 0x4000 00:27:04.490 NVMe0n1 : 1.05 15978.64 62.42 0.00 0.00 7719.28 2122.80 46274.11 00:27:04.490 =================================================================================================================== 00:27:04.490 Total : 15978.64 62.42 0.00 0.00 7719.28 2122.80 46274.11 00:27:04.490 20:32:36 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:04.490 20:32:36 -- host/failover.sh@95 -- # grep -q NVMe0 00:27:04.490 20:32:36 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:04.490 20:32:36 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:04.490 20:32:36 -- host/failover.sh@99 -- # grep -q NVMe0 00:27:04.747 20:32:36 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:05.004 20:32:36 -- host/failover.sh@101 -- # sleep 3 00:27:08.285 20:32:39 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:08.285 20:32:39 -- host/failover.sh@103 -- # grep -q NVMe0 00:27:08.285 20:32:39 -- host/failover.sh@108 -- # killprocess 3550802 00:27:08.285 20:32:39 -- common/autotest_common.sh@926 -- # '[' -z 3550802 ']' 00:27:08.285 20:32:39 -- common/autotest_common.sh@930 -- # kill -0 3550802 00:27:08.285 20:32:39 -- common/autotest_common.sh@931 -- # uname 00:27:08.285 20:32:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:08.285 20:32:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3550802 00:27:08.285 20:32:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:08.285 20:32:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:08.285 20:32:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3550802' 00:27:08.285 killing process with pid 3550802 00:27:08.285 20:32:40 -- common/autotest_common.sh@945 -- # kill 3550802 00:27:08.285 20:32:40 -- common/autotest_common.sh@950 -- # wait 3550802 00:27:08.285 20:32:40 -- host/failover.sh@110 -- # sync 00:27:08.285 20:32:40 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:08.543 20:32:40 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:27:08.543 20:32:40 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:08.543 20:32:40 -- host/failover.sh@116 -- # nvmftestfini 00:27:08.543 20:32:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:08.543 20:32:40 -- nvmf/common.sh@116 -- # sync 00:27:08.543 20:32:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:08.543 20:32:40 -- nvmf/common.sh@119 -- # set +e 00:27:08.543 20:32:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:08.543 20:32:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:08.543 rmmod nvme_tcp 00:27:08.543 rmmod nvme_fabrics 00:27:08.543 rmmod nvme_keyring 00:27:08.543 20:32:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:08.543 20:32:40 -- nvmf/common.sh@123 -- # set -e 00:27:08.543 20:32:40 -- nvmf/common.sh@124 -- # return 0 00:27:08.543 20:32:40 -- nvmf/common.sh@477 -- # '[' -n 3547721 ']' 00:27:08.543 20:32:40 -- nvmf/common.sh@478 -- # killprocess 3547721 00:27:08.543 20:32:40 -- common/autotest_common.sh@926 -- # '[' -z 3547721 ']' 00:27:08.543 20:32:40 -- common/autotest_common.sh@930 -- # kill -0 3547721 00:27:08.543 20:32:40 -- common/autotest_common.sh@931 -- # uname 00:27:08.543 20:32:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:08.543 20:32:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3547721 00:27:08.802 20:32:40 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:08.802 20:32:40 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:08.802 20:32:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3547721' 00:27:08.802 killing process with pid 3547721 00:27:08.802 20:32:40 -- common/autotest_common.sh@945 -- # kill 3547721 00:27:08.802 20:32:40 -- common/autotest_common.sh@950 -- # wait 3547721 00:27:08.802 20:32:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:08.802 20:32:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:08.802 20:32:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:08.802 20:32:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:08.802 20:32:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:08.802 20:32:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:08.802 20:32:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:08.802 20:32:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:11.335 20:32:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:11.335 00:27:11.335 real 0m38.077s 00:27:11.335 user 2m3.181s 00:27:11.335 sys 0m7.371s 00:27:11.335 20:32:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:11.335 20:32:42 -- common/autotest_common.sh@10 -- # set +x 00:27:11.335 ************************************ 00:27:11.335 END TEST nvmf_failover 00:27:11.335 ************************************ 00:27:11.335 20:32:42 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:27:11.335 20:32:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:11.335 20:32:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:11.335 20:32:42 -- common/autotest_common.sh@10 -- # set +x 00:27:11.335 ************************************ 00:27:11.335 START TEST nvmf_discovery 00:27:11.335 ************************************ 00:27:11.335 20:32:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:27:11.335 * Looking for test storage... 00:27:11.335 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:11.335 20:32:42 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:11.335 20:32:42 -- nvmf/common.sh@7 -- # uname -s 00:27:11.335 20:32:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:11.335 20:32:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:11.335 20:32:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:11.335 20:32:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:11.335 20:32:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:11.335 20:32:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:11.335 20:32:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:11.335 20:32:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:11.335 20:32:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:11.335 20:32:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:11.335 20:32:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:27:11.335 20:32:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:27:11.335 20:32:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:11.335 20:32:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:11.335 20:32:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:11.335 20:32:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:11.335 20:32:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:11.335 20:32:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:11.335 20:32:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:11.335 20:32:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:11.335 20:32:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:11.335 20:32:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:11.335 20:32:42 -- paths/export.sh@5 -- # export PATH 00:27:11.335 20:32:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:11.335 20:32:42 -- nvmf/common.sh@46 -- # : 0 00:27:11.335 20:32:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:11.335 20:32:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:11.335 20:32:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:11.335 20:32:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:11.335 20:32:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:11.335 20:32:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:11.335 20:32:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:11.335 20:32:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:11.335 20:32:42 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:27:11.335 20:32:42 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:27:11.335 20:32:42 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:27:11.335 20:32:42 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:27:11.335 20:32:42 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:27:11.335 20:32:42 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:27:11.335 20:32:42 -- host/discovery.sh@25 -- # nvmftestinit 00:27:11.335 20:32:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:11.335 20:32:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:11.335 20:32:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:11.335 20:32:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:11.335 20:32:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:11.335 20:32:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:11.335 20:32:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:11.335 20:32:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:11.335 20:32:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:11.335 20:32:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:11.335 20:32:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:11.335 20:32:42 -- common/autotest_common.sh@10 -- # set +x 00:27:16.608 20:32:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:16.608 20:32:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:16.608 20:32:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:16.608 20:32:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:16.608 20:32:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:16.608 20:32:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:16.608 20:32:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:16.608 20:32:48 -- nvmf/common.sh@294 -- # net_devs=() 00:27:16.608 20:32:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:16.608 20:32:48 -- nvmf/common.sh@295 -- # e810=() 00:27:16.608 20:32:48 -- nvmf/common.sh@295 -- # local -ga e810 00:27:16.608 20:32:48 -- nvmf/common.sh@296 -- # x722=() 00:27:16.608 20:32:48 -- nvmf/common.sh@296 -- # local -ga x722 00:27:16.608 20:32:48 -- nvmf/common.sh@297 -- # mlx=() 00:27:16.608 20:32:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:16.608 20:32:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:16.608 20:32:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:16.608 20:32:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:16.608 20:32:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:16.608 20:32:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:16.608 20:32:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:27:16.608 Found 0000:86:00.0 (0x8086 - 0x159b) 00:27:16.608 20:32:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:16.608 20:32:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:27:16.608 Found 0000:86:00.1 (0x8086 - 0x159b) 00:27:16.608 20:32:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:16.608 20:32:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:16.608 20:32:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:16.608 20:32:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:16.608 20:32:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:16.608 20:32:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:27:16.608 Found net devices under 0000:86:00.0: cvl_0_0 00:27:16.608 20:32:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:16.608 20:32:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:16.608 20:32:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:16.608 20:32:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:16.608 20:32:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:16.608 20:32:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:27:16.608 Found net devices under 0000:86:00.1: cvl_0_1 00:27:16.608 20:32:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:16.608 20:32:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:16.608 20:32:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:16.608 20:32:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:16.608 20:32:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:16.608 20:32:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:16.608 20:32:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:16.608 20:32:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:16.608 20:32:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:16.608 20:32:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:16.608 20:32:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:16.608 20:32:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:16.608 20:32:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:16.608 20:32:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:16.608 20:32:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:16.608 20:32:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:16.608 20:32:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:16.608 20:32:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:16.608 20:32:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:16.608 20:32:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:16.608 20:32:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:16.608 20:32:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:16.608 20:32:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:16.608 20:32:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:16.608 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:16.608 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.281 ms 00:27:16.608 00:27:16.608 --- 10.0.0.2 ping statistics --- 00:27:16.608 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:16.608 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:27:16.608 20:32:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:16.608 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:16.608 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.224 ms 00:27:16.608 00:27:16.608 --- 10.0.0.1 ping statistics --- 00:27:16.608 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:16.608 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:27:16.608 20:32:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:16.608 20:32:48 -- nvmf/common.sh@410 -- # return 0 00:27:16.608 20:32:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:16.608 20:32:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:16.608 20:32:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:16.608 20:32:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:16.608 20:32:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:16.608 20:32:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:16.608 20:32:48 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:27:16.608 20:32:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:16.608 20:32:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:16.608 20:32:48 -- common/autotest_common.sh@10 -- # set +x 00:27:16.608 20:32:48 -- nvmf/common.sh@469 -- # nvmfpid=3556212 00:27:16.608 20:32:48 -- nvmf/common.sh@470 -- # waitforlisten 3556212 00:27:16.608 20:32:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:27:16.608 20:32:48 -- common/autotest_common.sh@819 -- # '[' -z 3556212 ']' 00:27:16.608 20:32:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:16.608 20:32:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:16.608 20:32:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:16.608 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:16.608 20:32:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:16.608 20:32:48 -- common/autotest_common.sh@10 -- # set +x 00:27:16.608 [2024-07-22 20:32:48.507970] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:27:16.608 [2024-07-22 20:32:48.508014] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:16.608 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.867 [2024-07-22 20:32:48.564994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:16.867 [2024-07-22 20:32:48.634959] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:16.867 [2024-07-22 20:32:48.635079] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:16.867 [2024-07-22 20:32:48.635087] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:16.867 [2024-07-22 20:32:48.635093] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:16.867 [2024-07-22 20:32:48.635111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:17.435 20:32:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:17.435 20:32:49 -- common/autotest_common.sh@852 -- # return 0 00:27:17.435 20:32:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:17.435 20:32:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:17.435 20:32:49 -- common/autotest_common.sh@10 -- # set +x 00:27:17.435 20:32:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:17.435 20:32:49 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:17.435 20:32:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:17.435 20:32:49 -- common/autotest_common.sh@10 -- # set +x 00:27:17.435 [2024-07-22 20:32:49.329917] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:17.435 20:32:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:17.435 20:32:49 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:27:17.435 20:32:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:17.435 20:32:49 -- common/autotest_common.sh@10 -- # set +x 00:27:17.435 [2024-07-22 20:32:49.342088] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:27:17.435 20:32:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:17.435 20:32:49 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:27:17.435 20:32:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:17.435 20:32:49 -- common/autotest_common.sh@10 -- # set +x 00:27:17.435 null0 00:27:17.435 20:32:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:17.435 20:32:49 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:27:17.435 20:32:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:17.435 20:32:49 -- common/autotest_common.sh@10 -- # set +x 00:27:17.435 null1 00:27:17.435 20:32:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:17.435 20:32:49 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:27:17.435 20:32:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:17.435 20:32:49 -- common/autotest_common.sh@10 -- # set +x 00:27:17.435 20:32:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:17.435 20:32:49 -- host/discovery.sh@45 -- # hostpid=3556323 00:27:17.436 20:32:49 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:27:17.436 20:32:49 -- host/discovery.sh@46 -- # waitforlisten 3556323 /tmp/host.sock 00:27:17.436 20:32:49 -- common/autotest_common.sh@819 -- # '[' -z 3556323 ']' 00:27:17.694 20:32:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:27:17.694 20:32:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:17.694 20:32:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:27:17.694 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:27:17.694 20:32:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:17.694 20:32:49 -- common/autotest_common.sh@10 -- # set +x 00:27:17.694 [2024-07-22 20:32:49.415683] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:27:17.695 [2024-07-22 20:32:49.415727] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3556323 ] 00:27:17.695 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.695 [2024-07-22 20:32:49.469952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:17.695 [2024-07-22 20:32:49.547165] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:17.695 [2024-07-22 20:32:49.547280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:18.632 20:32:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:18.632 20:32:50 -- common/autotest_common.sh@852 -- # return 0 00:27:18.632 20:32:50 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:18.632 20:32:50 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@72 -- # notify_id=0 00:27:18.632 20:32:50 -- host/discovery.sh@78 -- # get_subsystem_names 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # sort 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # xargs 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:27:18.632 20:32:50 -- host/discovery.sh@79 -- # get_bdev_list 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # sort 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # xargs 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:27:18.632 20:32:50 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@82 -- # get_subsystem_names 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # sort 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # xargs 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:27:18.632 20:32:50 -- host/discovery.sh@83 -- # get_bdev_list 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # sort 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # xargs 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:27:18.632 20:32:50 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@86 -- # get_subsystem_names 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # sort 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # xargs 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:27:18.632 20:32:50 -- host/discovery.sh@87 -- # get_bdev_list 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # xargs 00:27:18.632 20:32:50 -- host/discovery.sh@55 -- # sort 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:27:18.632 20:32:50 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.632 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.632 [2024-07-22 20:32:50.557305] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:18.632 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.632 20:32:50 -- host/discovery.sh@92 -- # get_subsystem_names 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:18.632 20:32:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:18.632 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.633 20:32:50 -- host/discovery.sh@59 -- # sort 00:27:18.633 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.633 20:32:50 -- host/discovery.sh@59 -- # xargs 00:27:18.890 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.890 20:32:50 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:27:18.890 20:32:50 -- host/discovery.sh@93 -- # get_bdev_list 00:27:18.890 20:32:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:18.890 20:32:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:18.890 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.890 20:32:50 -- host/discovery.sh@55 -- # sort 00:27:18.890 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.890 20:32:50 -- host/discovery.sh@55 -- # xargs 00:27:18.890 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.890 20:32:50 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:27:18.890 20:32:50 -- host/discovery.sh@94 -- # get_notification_count 00:27:18.890 20:32:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:27:18.890 20:32:50 -- host/discovery.sh@74 -- # jq '. | length' 00:27:18.890 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.890 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.890 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.890 20:32:50 -- host/discovery.sh@74 -- # notification_count=0 00:27:18.890 20:32:50 -- host/discovery.sh@75 -- # notify_id=0 00:27:18.890 20:32:50 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:27:18.890 20:32:50 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:27:18.890 20:32:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.890 20:32:50 -- common/autotest_common.sh@10 -- # set +x 00:27:18.890 20:32:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.890 20:32:50 -- host/discovery.sh@100 -- # sleep 1 00:27:19.458 [2024-07-22 20:32:51.291257] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:27:19.458 [2024-07-22 20:32:51.291282] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:27:19.458 [2024-07-22 20:32:51.291296] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:19.458 [2024-07-22 20:32:51.377557] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:27:19.716 [2024-07-22 20:32:51.561889] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:27:19.716 [2024-07-22 20:32:51.561907] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:27:19.976 20:32:51 -- host/discovery.sh@101 -- # get_subsystem_names 00:27:19.976 20:32:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:19.976 20:32:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:19.976 20:32:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:19.976 20:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:19.976 20:32:51 -- host/discovery.sh@59 -- # sort 00:27:19.976 20:32:51 -- host/discovery.sh@59 -- # xargs 00:27:19.976 20:32:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:19.976 20:32:51 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:27:19.976 20:32:51 -- host/discovery.sh@102 -- # get_bdev_list 00:27:19.976 20:32:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:19.976 20:32:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:19.976 20:32:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:19.976 20:32:51 -- host/discovery.sh@55 -- # sort 00:27:19.976 20:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:19.976 20:32:51 -- host/discovery.sh@55 -- # xargs 00:27:19.976 20:32:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:19.976 20:32:51 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:27:19.976 20:32:51 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:27:19.976 20:32:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:27:19.976 20:32:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:27:19.976 20:32:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:19.976 20:32:51 -- host/discovery.sh@63 -- # sort -n 00:27:19.976 20:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:19.976 20:32:51 -- host/discovery.sh@63 -- # xargs 00:27:19.976 20:32:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:19.976 20:32:51 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:27:19.976 20:32:51 -- host/discovery.sh@104 -- # get_notification_count 00:27:19.976 20:32:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:27:19.976 20:32:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:19.976 20:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:19.976 20:32:51 -- host/discovery.sh@74 -- # jq '. | length' 00:27:19.976 20:32:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:20.235 20:32:51 -- host/discovery.sh@74 -- # notification_count=1 00:27:20.235 20:32:51 -- host/discovery.sh@75 -- # notify_id=1 00:27:20.235 20:32:51 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:27:20.235 20:32:51 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:27:20.235 20:32:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:20.235 20:32:51 -- common/autotest_common.sh@10 -- # set +x 00:27:20.235 20:32:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:20.235 20:32:51 -- host/discovery.sh@109 -- # sleep 1 00:27:21.174 20:32:52 -- host/discovery.sh@110 -- # get_bdev_list 00:27:21.174 20:32:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:21.174 20:32:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:21.174 20:32:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:21.174 20:32:52 -- host/discovery.sh@55 -- # sort 00:27:21.174 20:32:52 -- common/autotest_common.sh@10 -- # set +x 00:27:21.174 20:32:52 -- host/discovery.sh@55 -- # xargs 00:27:21.174 20:32:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:21.174 20:32:52 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:21.174 20:32:52 -- host/discovery.sh@111 -- # get_notification_count 00:27:21.174 20:32:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:27:21.174 20:32:52 -- host/discovery.sh@74 -- # jq '. | length' 00:27:21.174 20:32:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:21.174 20:32:52 -- common/autotest_common.sh@10 -- # set +x 00:27:21.174 20:32:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:21.174 20:32:53 -- host/discovery.sh@74 -- # notification_count=1 00:27:21.174 20:32:53 -- host/discovery.sh@75 -- # notify_id=2 00:27:21.174 20:32:53 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:27:21.175 20:32:53 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:27:21.175 20:32:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:21.175 20:32:53 -- common/autotest_common.sh@10 -- # set +x 00:27:21.175 [2024-07-22 20:32:53.040231] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:21.175 [2024-07-22 20:32:53.041364] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:27:21.175 [2024-07-22 20:32:53.041385] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:21.175 20:32:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:21.175 20:32:53 -- host/discovery.sh@117 -- # sleep 1 00:27:21.434 [2024-07-22 20:32:53.167759] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:27:21.434 [2024-07-22 20:32:53.306618] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:27:21.434 [2024-07-22 20:32:53.306633] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:27:21.434 [2024-07-22 20:32:53.306638] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:27:22.371 20:32:54 -- host/discovery.sh@118 -- # get_subsystem_names 00:27:22.371 20:32:54 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:22.371 20:32:54 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:22.371 20:32:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.371 20:32:54 -- host/discovery.sh@59 -- # sort 00:27:22.371 20:32:54 -- common/autotest_common.sh@10 -- # set +x 00:27:22.371 20:32:54 -- host/discovery.sh@59 -- # xargs 00:27:22.371 20:32:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@119 -- # get_bdev_list 00:27:22.371 20:32:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:22.371 20:32:54 -- host/discovery.sh@55 -- # xargs 00:27:22.371 20:32:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:22.371 20:32:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.371 20:32:54 -- host/discovery.sh@55 -- # sort 00:27:22.371 20:32:54 -- common/autotest_common.sh@10 -- # set +x 00:27:22.371 20:32:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:27:22.371 20:32:54 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:27:22.371 20:32:54 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:27:22.371 20:32:54 -- host/discovery.sh@63 -- # sort -n 00:27:22.371 20:32:54 -- host/discovery.sh@63 -- # xargs 00:27:22.371 20:32:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.371 20:32:54 -- common/autotest_common.sh@10 -- # set +x 00:27:22.371 20:32:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@121 -- # get_notification_count 00:27:22.371 20:32:54 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:27:22.371 20:32:54 -- host/discovery.sh@74 -- # jq '. | length' 00:27:22.371 20:32:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.371 20:32:54 -- common/autotest_common.sh@10 -- # set +x 00:27:22.371 20:32:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@74 -- # notification_count=0 00:27:22.371 20:32:54 -- host/discovery.sh@75 -- # notify_id=2 00:27:22.371 20:32:54 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:22.371 20:32:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.371 20:32:54 -- common/autotest_common.sh@10 -- # set +x 00:27:22.371 [2024-07-22 20:32:54.236396] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:22.371 [2024-07-22 20:32:54.236420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.371 [2024-07-22 20:32:54.236429] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:22.371 [2024-07-22 20:32:54.236436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.371 [2024-07-22 20:32:54.236443] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:22.371 [2024-07-22 20:32:54.236450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.371 [2024-07-22 20:32:54.236457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:22.371 [2024-07-22 20:32:54.236464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:22.371 [2024-07-22 20:32:54.236470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc989f0 is same with the state(5) to be set 00:27:22.371 [2024-07-22 20:32:54.236617] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:27:22.371 [2024-07-22 20:32:54.236630] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:22.371 20:32:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.371 20:32:54 -- host/discovery.sh@127 -- # sleep 1 00:27:22.371 [2024-07-22 20:32:54.246407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc989f0 (9): Bad file descriptor 00:27:22.371 [2024-07-22 20:32:54.256446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:22.371 [2024-07-22 20:32:54.256869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.371 [2024-07-22 20:32:54.257247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.371 [2024-07-22 20:32:54.257258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc989f0 with addr=10.0.0.2, port=4420 00:27:22.371 [2024-07-22 20:32:54.257265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc989f0 is same with the state(5) to be set 00:27:22.371 [2024-07-22 20:32:54.257277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc989f0 (9): Bad file descriptor 00:27:22.371 [2024-07-22 20:32:54.257293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:22.371 [2024-07-22 20:32:54.257299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:22.371 [2024-07-22 20:32:54.257307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:22.371 [2024-07-22 20:32:54.257317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:22.371 [2024-07-22 20:32:54.266496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:22.371 [2024-07-22 20:32:54.266858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.371 [2024-07-22 20:32:54.267276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.371 [2024-07-22 20:32:54.267287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc989f0 with addr=10.0.0.2, port=4420 00:27:22.371 [2024-07-22 20:32:54.267293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc989f0 is same with the state(5) to be set 00:27:22.371 [2024-07-22 20:32:54.267304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc989f0 (9): Bad file descriptor 00:27:22.371 [2024-07-22 20:32:54.267313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:22.371 [2024-07-22 20:32:54.267319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:22.371 [2024-07-22 20:32:54.267326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:22.371 [2024-07-22 20:32:54.267343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:22.371 [2024-07-22 20:32:54.276544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:22.371 [2024-07-22 20:32:54.276958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.371 [2024-07-22 20:32:54.277295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.371 [2024-07-22 20:32:54.277306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc989f0 with addr=10.0.0.2, port=4420 00:27:22.371 [2024-07-22 20:32:54.277312] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc989f0 is same with the state(5) to be set 00:27:22.371 [2024-07-22 20:32:54.277322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc989f0 (9): Bad file descriptor 00:27:22.371 [2024-07-22 20:32:54.277331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:22.371 [2024-07-22 20:32:54.277337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:22.371 [2024-07-22 20:32:54.277344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:22.371 [2024-07-22 20:32:54.277353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:22.371 [2024-07-22 20:32:54.286590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:22.371 [2024-07-22 20:32:54.287009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.371 [2024-07-22 20:32:54.287405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.371 [2024-07-22 20:32:54.287416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc989f0 with addr=10.0.0.2, port=4420 00:27:22.371 [2024-07-22 20:32:54.287422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc989f0 is same with the state(5) to be set 00:27:22.371 [2024-07-22 20:32:54.287433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc989f0 (9): Bad file descriptor 00:27:22.372 [2024-07-22 20:32:54.287449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:22.372 [2024-07-22 20:32:54.287456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:22.372 [2024-07-22 20:32:54.287462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:22.372 [2024-07-22 20:32:54.287471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:22.372 [2024-07-22 20:32:54.296641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:22.372 [2024-07-22 20:32:54.297069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.372 [2024-07-22 20:32:54.297399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.372 [2024-07-22 20:32:54.297413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc989f0 with addr=10.0.0.2, port=4420 00:27:22.372 [2024-07-22 20:32:54.297419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc989f0 is same with the state(5) to be set 00:27:22.372 [2024-07-22 20:32:54.297429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc989f0 (9): Bad file descriptor 00:27:22.372 [2024-07-22 20:32:54.297438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:22.372 [2024-07-22 20:32:54.297444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:22.372 [2024-07-22 20:32:54.297451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:22.372 [2024-07-22 20:32:54.297460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:22.372 [2024-07-22 20:32:54.306687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:22.372 [2024-07-22 20:32:54.307127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.372 [2024-07-22 20:32:54.307545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.372 [2024-07-22 20:32:54.307555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc989f0 with addr=10.0.0.2, port=4420 00:27:22.372 [2024-07-22 20:32:54.307562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc989f0 is same with the state(5) to be set 00:27:22.372 [2024-07-22 20:32:54.307571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc989f0 (9): Bad file descriptor 00:27:22.372 [2024-07-22 20:32:54.307587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:22.372 [2024-07-22 20:32:54.307594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:22.372 [2024-07-22 20:32:54.307600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:22.372 [2024-07-22 20:32:54.307609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:22.631 [2024-07-22 20:32:54.316734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:22.631 [2024-07-22 20:32:54.317102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.631 [2024-07-22 20:32:54.317502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:22.631 [2024-07-22 20:32:54.317512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc989f0 with addr=10.0.0.2, port=4420 00:27:22.631 [2024-07-22 20:32:54.317518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc989f0 is same with the state(5) to be set 00:27:22.631 [2024-07-22 20:32:54.317528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc989f0 (9): Bad file descriptor 00:27:22.631 [2024-07-22 20:32:54.317537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:22.631 [2024-07-22 20:32:54.317543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:22.631 [2024-07-22 20:32:54.317549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:22.631 [2024-07-22 20:32:54.317557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:22.631 [2024-07-22 20:32:54.324643] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:27:22.631 [2024-07-22 20:32:54.324659] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:27:23.570 20:32:55 -- host/discovery.sh@128 -- # get_subsystem_names 00:27:23.570 20:32:55 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:23.570 20:32:55 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:23.570 20:32:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.570 20:32:55 -- host/discovery.sh@59 -- # sort 00:27:23.570 20:32:55 -- common/autotest_common.sh@10 -- # set +x 00:27:23.570 20:32:55 -- host/discovery.sh@59 -- # xargs 00:27:23.570 20:32:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@129 -- # get_bdev_list 00:27:23.570 20:32:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:23.570 20:32:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:23.570 20:32:55 -- host/discovery.sh@55 -- # sort 00:27:23.570 20:32:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.570 20:32:55 -- host/discovery.sh@55 -- # xargs 00:27:23.570 20:32:55 -- common/autotest_common.sh@10 -- # set +x 00:27:23.570 20:32:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:27:23.570 20:32:55 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:27:23.570 20:32:55 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:27:23.570 20:32:55 -- host/discovery.sh@63 -- # sort -n 00:27:23.570 20:32:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.570 20:32:55 -- host/discovery.sh@63 -- # xargs 00:27:23.570 20:32:55 -- common/autotest_common.sh@10 -- # set +x 00:27:23.570 20:32:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@131 -- # get_notification_count 00:27:23.570 20:32:55 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:27:23.570 20:32:55 -- host/discovery.sh@74 -- # jq '. | length' 00:27:23.570 20:32:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.570 20:32:55 -- common/autotest_common.sh@10 -- # set +x 00:27:23.570 20:32:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@74 -- # notification_count=0 00:27:23.570 20:32:55 -- host/discovery.sh@75 -- # notify_id=2 00:27:23.570 20:32:55 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:27:23.570 20:32:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.570 20:32:55 -- common/autotest_common.sh@10 -- # set +x 00:27:23.570 20:32:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.570 20:32:55 -- host/discovery.sh@135 -- # sleep 1 00:27:24.951 20:32:56 -- host/discovery.sh@136 -- # get_subsystem_names 00:27:24.951 20:32:56 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:27:24.951 20:32:56 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:27:24.951 20:32:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:24.951 20:32:56 -- host/discovery.sh@59 -- # sort 00:27:24.951 20:32:56 -- common/autotest_common.sh@10 -- # set +x 00:27:24.951 20:32:56 -- host/discovery.sh@59 -- # xargs 00:27:24.951 20:32:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:24.951 20:32:56 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:27:24.951 20:32:56 -- host/discovery.sh@137 -- # get_bdev_list 00:27:24.951 20:32:56 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:24.951 20:32:56 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:24.951 20:32:56 -- host/discovery.sh@55 -- # xargs 00:27:24.951 20:32:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:24.951 20:32:56 -- host/discovery.sh@55 -- # sort 00:27:24.951 20:32:56 -- common/autotest_common.sh@10 -- # set +x 00:27:24.951 20:32:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:24.951 20:32:56 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:27:24.951 20:32:56 -- host/discovery.sh@138 -- # get_notification_count 00:27:24.951 20:32:56 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:27:24.951 20:32:56 -- host/discovery.sh@74 -- # jq '. | length' 00:27:24.951 20:32:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:24.951 20:32:56 -- common/autotest_common.sh@10 -- # set +x 00:27:24.951 20:32:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:24.951 20:32:56 -- host/discovery.sh@74 -- # notification_count=2 00:27:24.951 20:32:56 -- host/discovery.sh@75 -- # notify_id=4 00:27:24.951 20:32:56 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:27:24.951 20:32:56 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:24.951 20:32:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:24.951 20:32:56 -- common/autotest_common.sh@10 -- # set +x 00:27:25.889 [2024-07-22 20:32:57.667259] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:27:25.889 [2024-07-22 20:32:57.667275] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:27:25.889 [2024-07-22 20:32:57.667288] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:25.889 [2024-07-22 20:32:57.753541] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:27:25.889 [2024-07-22 20:32:57.820076] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:27:25.889 [2024-07-22 20:32:57.820103] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:27:25.889 20:32:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:25.889 20:32:57 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:25.889 20:32:57 -- common/autotest_common.sh@640 -- # local es=0 00:27:25.889 20:32:57 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:25.889 20:32:57 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:27:25.889 20:32:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:27:25.889 20:32:57 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:27:25.889 20:32:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:27:25.889 20:32:57 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:25.889 20:32:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:26.148 20:32:57 -- common/autotest_common.sh@10 -- # set +x 00:27:26.148 request: 00:27:26.148 { 00:27:26.148 "name": "nvme", 00:27:26.148 "trtype": "tcp", 00:27:26.148 "traddr": "10.0.0.2", 00:27:26.148 "hostnqn": "nqn.2021-12.io.spdk:test", 00:27:26.148 "adrfam": "ipv4", 00:27:26.148 "trsvcid": "8009", 00:27:26.148 "wait_for_attach": true, 00:27:26.148 "method": "bdev_nvme_start_discovery", 00:27:26.148 "req_id": 1 00:27:26.148 } 00:27:26.148 Got JSON-RPC error response 00:27:26.148 response: 00:27:26.148 { 00:27:26.148 "code": -17, 00:27:26.148 "message": "File exists" 00:27:26.148 } 00:27:26.148 20:32:57 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:27:26.148 20:32:57 -- common/autotest_common.sh@643 -- # es=1 00:27:26.148 20:32:57 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:27:26.148 20:32:57 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:27:26.148 20:32:57 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:27:26.148 20:32:57 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:27:26.148 20:32:57 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:27:26.148 20:32:57 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:27:26.148 20:32:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:26.148 20:32:57 -- host/discovery.sh@67 -- # sort 00:27:26.148 20:32:57 -- common/autotest_common.sh@10 -- # set +x 00:27:26.148 20:32:57 -- host/discovery.sh@67 -- # xargs 00:27:26.148 20:32:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:26.148 20:32:57 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:27:26.148 20:32:57 -- host/discovery.sh@147 -- # get_bdev_list 00:27:26.148 20:32:57 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:26.148 20:32:57 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:26.148 20:32:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:26.148 20:32:57 -- host/discovery.sh@55 -- # sort 00:27:26.148 20:32:57 -- common/autotest_common.sh@10 -- # set +x 00:27:26.148 20:32:57 -- host/discovery.sh@55 -- # xargs 00:27:26.148 20:32:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:26.148 20:32:57 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:26.148 20:32:57 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:26.148 20:32:57 -- common/autotest_common.sh@640 -- # local es=0 00:27:26.148 20:32:57 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:26.148 20:32:57 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:27:26.148 20:32:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:27:26.148 20:32:57 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:27:26.148 20:32:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:27:26.148 20:32:57 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:27:26.148 20:32:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:26.148 20:32:57 -- common/autotest_common.sh@10 -- # set +x 00:27:26.148 request: 00:27:26.148 { 00:27:26.148 "name": "nvme_second", 00:27:26.148 "trtype": "tcp", 00:27:26.148 "traddr": "10.0.0.2", 00:27:26.148 "hostnqn": "nqn.2021-12.io.spdk:test", 00:27:26.148 "adrfam": "ipv4", 00:27:26.148 "trsvcid": "8009", 00:27:26.148 "wait_for_attach": true, 00:27:26.148 "method": "bdev_nvme_start_discovery", 00:27:26.148 "req_id": 1 00:27:26.148 } 00:27:26.148 Got JSON-RPC error response 00:27:26.148 response: 00:27:26.148 { 00:27:26.148 "code": -17, 00:27:26.148 "message": "File exists" 00:27:26.148 } 00:27:26.148 20:32:57 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:27:26.148 20:32:57 -- common/autotest_common.sh@643 -- # es=1 00:27:26.148 20:32:57 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:27:26.148 20:32:57 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:27:26.148 20:32:57 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:27:26.148 20:32:57 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:27:26.148 20:32:57 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:27:26.148 20:32:57 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:27:26.148 20:32:57 -- host/discovery.sh@67 -- # xargs 00:27:26.148 20:32:57 -- host/discovery.sh@67 -- # sort 00:27:26.148 20:32:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:26.148 20:32:57 -- common/autotest_common.sh@10 -- # set +x 00:27:26.148 20:32:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:26.148 20:32:58 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:27:26.148 20:32:58 -- host/discovery.sh@153 -- # get_bdev_list 00:27:26.148 20:32:58 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:26.148 20:32:58 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:27:26.148 20:32:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:26.148 20:32:58 -- host/discovery.sh@55 -- # sort 00:27:26.148 20:32:58 -- common/autotest_common.sh@10 -- # set +x 00:27:26.148 20:32:58 -- host/discovery.sh@55 -- # xargs 00:27:26.148 20:32:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:26.148 20:32:58 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:27:26.148 20:32:58 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:27:26.148 20:32:58 -- common/autotest_common.sh@640 -- # local es=0 00:27:26.148 20:32:58 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:27:26.148 20:32:58 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:27:26.148 20:32:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:27:26.148 20:32:58 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:27:26.148 20:32:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:27:26.148 20:32:58 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:27:26.148 20:32:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:26.148 20:32:58 -- common/autotest_common.sh@10 -- # set +x 00:27:27.525 [2024-07-22 20:32:59.071756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-07-22 20:32:59.072110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.525 [2024-07-22 20:32:59.072123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xca1960 with addr=10.0.0.2, port=8010 00:27:27.525 [2024-07-22 20:32:59.072137] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:27.525 [2024-07-22 20:32:59.072144] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:27.525 [2024-07-22 20:32:59.072150] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:27:28.459 [2024-07-22 20:33:00.074101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.459 [2024-07-22 20:33:00.074531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.459 [2024-07-22 20:33:00.074543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xca1960 with addr=10.0.0.2, port=8010 00:27:28.459 [2024-07-22 20:33:00.074559] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:28.459 [2024-07-22 20:33:00.074567] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:28.459 [2024-07-22 20:33:00.074574] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:27:29.392 [2024-07-22 20:33:01.076197] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:27:29.392 request: 00:27:29.392 { 00:27:29.392 "name": "nvme_second", 00:27:29.392 "trtype": "tcp", 00:27:29.392 "traddr": "10.0.0.2", 00:27:29.392 "hostnqn": "nqn.2021-12.io.spdk:test", 00:27:29.392 "adrfam": "ipv4", 00:27:29.392 "trsvcid": "8010", 00:27:29.392 "attach_timeout_ms": 3000, 00:27:29.392 "method": "bdev_nvme_start_discovery", 00:27:29.392 "req_id": 1 00:27:29.392 } 00:27:29.393 Got JSON-RPC error response 00:27:29.393 response: 00:27:29.393 { 00:27:29.393 "code": -110, 00:27:29.393 "message": "Connection timed out" 00:27:29.393 } 00:27:29.393 20:33:01 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:27:29.393 20:33:01 -- common/autotest_common.sh@643 -- # es=1 00:27:29.393 20:33:01 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:27:29.393 20:33:01 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:27:29.393 20:33:01 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:27:29.393 20:33:01 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:27:29.393 20:33:01 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:27:29.393 20:33:01 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:27:29.393 20:33:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:29.393 20:33:01 -- host/discovery.sh@67 -- # sort 00:27:29.393 20:33:01 -- common/autotest_common.sh@10 -- # set +x 00:27:29.393 20:33:01 -- host/discovery.sh@67 -- # xargs 00:27:29.393 20:33:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:29.393 20:33:01 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:27:29.393 20:33:01 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:27:29.393 20:33:01 -- host/discovery.sh@162 -- # kill 3556323 00:27:29.393 20:33:01 -- host/discovery.sh@163 -- # nvmftestfini 00:27:29.393 20:33:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:29.393 20:33:01 -- nvmf/common.sh@116 -- # sync 00:27:29.393 20:33:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:29.393 20:33:01 -- nvmf/common.sh@119 -- # set +e 00:27:29.393 20:33:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:29.393 20:33:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:29.393 rmmod nvme_tcp 00:27:29.393 rmmod nvme_fabrics 00:27:29.393 rmmod nvme_keyring 00:27:29.393 20:33:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:29.393 20:33:01 -- nvmf/common.sh@123 -- # set -e 00:27:29.393 20:33:01 -- nvmf/common.sh@124 -- # return 0 00:27:29.393 20:33:01 -- nvmf/common.sh@477 -- # '[' -n 3556212 ']' 00:27:29.393 20:33:01 -- nvmf/common.sh@478 -- # killprocess 3556212 00:27:29.393 20:33:01 -- common/autotest_common.sh@926 -- # '[' -z 3556212 ']' 00:27:29.393 20:33:01 -- common/autotest_common.sh@930 -- # kill -0 3556212 00:27:29.393 20:33:01 -- common/autotest_common.sh@931 -- # uname 00:27:29.393 20:33:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:29.393 20:33:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3556212 00:27:29.393 20:33:01 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:29.393 20:33:01 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:29.393 20:33:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3556212' 00:27:29.393 killing process with pid 3556212 00:27:29.393 20:33:01 -- common/autotest_common.sh@945 -- # kill 3556212 00:27:29.393 20:33:01 -- common/autotest_common.sh@950 -- # wait 3556212 00:27:29.651 20:33:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:29.651 20:33:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:29.651 20:33:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:29.651 20:33:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:29.651 20:33:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:29.651 20:33:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:29.651 20:33:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:29.651 20:33:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:32.185 20:33:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:32.185 00:27:32.185 real 0m20.681s 00:27:32.185 user 0m27.779s 00:27:32.185 sys 0m5.589s 00:27:32.185 20:33:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:32.185 20:33:03 -- common/autotest_common.sh@10 -- # set +x 00:27:32.185 ************************************ 00:27:32.185 END TEST nvmf_discovery 00:27:32.185 ************************************ 00:27:32.185 20:33:03 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:27:32.185 20:33:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:32.185 20:33:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:32.185 20:33:03 -- common/autotest_common.sh@10 -- # set +x 00:27:32.185 ************************************ 00:27:32.185 START TEST nvmf_discovery_remove_ifc 00:27:32.185 ************************************ 00:27:32.185 20:33:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:27:32.185 * Looking for test storage... 00:27:32.185 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:32.185 20:33:03 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:32.185 20:33:03 -- nvmf/common.sh@7 -- # uname -s 00:27:32.185 20:33:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:32.185 20:33:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:32.185 20:33:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:32.185 20:33:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:32.185 20:33:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:32.185 20:33:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:32.185 20:33:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:32.185 20:33:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:32.185 20:33:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:32.185 20:33:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:32.185 20:33:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:27:32.185 20:33:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:27:32.185 20:33:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:32.185 20:33:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:32.185 20:33:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:32.185 20:33:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:32.185 20:33:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:32.185 20:33:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:32.185 20:33:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:32.185 20:33:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.185 20:33:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.185 20:33:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.185 20:33:03 -- paths/export.sh@5 -- # export PATH 00:27:32.185 20:33:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:32.185 20:33:03 -- nvmf/common.sh@46 -- # : 0 00:27:32.185 20:33:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:32.185 20:33:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:32.185 20:33:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:32.185 20:33:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:32.185 20:33:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:32.185 20:33:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:32.185 20:33:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:32.185 20:33:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:32.185 20:33:03 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:27:32.185 20:33:03 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:27:32.185 20:33:03 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:27:32.185 20:33:03 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:27:32.185 20:33:03 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:27:32.185 20:33:03 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:27:32.185 20:33:03 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:27:32.185 20:33:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:32.185 20:33:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:32.185 20:33:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:32.185 20:33:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:32.185 20:33:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:32.185 20:33:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:32.185 20:33:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:32.185 20:33:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:32.185 20:33:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:32.186 20:33:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:32.186 20:33:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:32.186 20:33:03 -- common/autotest_common.sh@10 -- # set +x 00:27:37.463 20:33:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:37.463 20:33:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:37.463 20:33:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:37.463 20:33:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:37.463 20:33:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:37.463 20:33:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:37.463 20:33:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:37.463 20:33:08 -- nvmf/common.sh@294 -- # net_devs=() 00:27:37.463 20:33:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:37.463 20:33:08 -- nvmf/common.sh@295 -- # e810=() 00:27:37.463 20:33:08 -- nvmf/common.sh@295 -- # local -ga e810 00:27:37.463 20:33:08 -- nvmf/common.sh@296 -- # x722=() 00:27:37.463 20:33:08 -- nvmf/common.sh@296 -- # local -ga x722 00:27:37.463 20:33:08 -- nvmf/common.sh@297 -- # mlx=() 00:27:37.463 20:33:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:37.463 20:33:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:37.463 20:33:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:37.463 20:33:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:37.463 20:33:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:37.463 20:33:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:37.463 20:33:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:27:37.463 Found 0000:86:00.0 (0x8086 - 0x159b) 00:27:37.463 20:33:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:37.463 20:33:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:27:37.463 Found 0000:86:00.1 (0x8086 - 0x159b) 00:27:37.463 20:33:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:37.463 20:33:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:37.463 20:33:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:37.463 20:33:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:37.463 20:33:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:37.463 20:33:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:27:37.463 Found net devices under 0000:86:00.0: cvl_0_0 00:27:37.463 20:33:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:37.463 20:33:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:37.463 20:33:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:37.463 20:33:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:37.463 20:33:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:37.463 20:33:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:27:37.463 Found net devices under 0000:86:00.1: cvl_0_1 00:27:37.463 20:33:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:37.463 20:33:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:37.463 20:33:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:37.463 20:33:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:37.463 20:33:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:37.463 20:33:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:37.463 20:33:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:37.463 20:33:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:37.463 20:33:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:37.463 20:33:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:37.463 20:33:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:37.463 20:33:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:37.463 20:33:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:37.464 20:33:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:37.464 20:33:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:37.464 20:33:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:37.464 20:33:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:37.464 20:33:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:37.464 20:33:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:37.464 20:33:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:37.464 20:33:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:37.464 20:33:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:37.464 20:33:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:37.464 20:33:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:37.464 20:33:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:37.464 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:37.464 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:27:37.464 00:27:37.464 --- 10.0.0.2 ping statistics --- 00:27:37.464 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:37.464 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:27:37.464 20:33:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:37.464 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:37.464 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.291 ms 00:27:37.464 00:27:37.464 --- 10.0.0.1 ping statistics --- 00:27:37.464 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:37.464 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:27:37.464 20:33:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:37.464 20:33:08 -- nvmf/common.sh@410 -- # return 0 00:27:37.464 20:33:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:37.464 20:33:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:37.464 20:33:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:37.464 20:33:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:37.464 20:33:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:37.464 20:33:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:37.464 20:33:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:37.464 20:33:08 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:27:37.464 20:33:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:37.464 20:33:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:37.464 20:33:08 -- common/autotest_common.sh@10 -- # set +x 00:27:37.464 20:33:09 -- nvmf/common.sh@469 -- # nvmfpid=3562176 00:27:37.464 20:33:09 -- nvmf/common.sh@470 -- # waitforlisten 3562176 00:27:37.464 20:33:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:27:37.464 20:33:09 -- common/autotest_common.sh@819 -- # '[' -z 3562176 ']' 00:27:37.464 20:33:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:37.464 20:33:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:37.464 20:33:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:37.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:37.464 20:33:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:37.464 20:33:09 -- common/autotest_common.sh@10 -- # set +x 00:27:37.464 [2024-07-22 20:33:09.049841] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:27:37.464 [2024-07-22 20:33:09.049887] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:37.464 EAL: No free 2048 kB hugepages reported on node 1 00:27:37.464 [2024-07-22 20:33:09.104971] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:37.464 [2024-07-22 20:33:09.182058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:37.464 [2024-07-22 20:33:09.182162] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:37.464 [2024-07-22 20:33:09.182169] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:37.464 [2024-07-22 20:33:09.182176] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:37.464 [2024-07-22 20:33:09.182190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:38.031 20:33:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:38.031 20:33:09 -- common/autotest_common.sh@852 -- # return 0 00:27:38.031 20:33:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:38.031 20:33:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:38.031 20:33:09 -- common/autotest_common.sh@10 -- # set +x 00:27:38.031 20:33:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:38.031 20:33:09 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:27:38.031 20:33:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:38.031 20:33:09 -- common/autotest_common.sh@10 -- # set +x 00:27:38.031 [2024-07-22 20:33:09.885650] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:38.031 [2024-07-22 20:33:09.893782] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:27:38.031 null0 00:27:38.031 [2024-07-22 20:33:09.925795] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:38.031 20:33:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:38.031 20:33:09 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3562556 00:27:38.031 20:33:09 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3562556 /tmp/host.sock 00:27:38.031 20:33:09 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:27:38.031 20:33:09 -- common/autotest_common.sh@819 -- # '[' -z 3562556 ']' 00:27:38.031 20:33:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:27:38.031 20:33:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:38.031 20:33:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:27:38.031 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:27:38.031 20:33:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:38.031 20:33:09 -- common/autotest_common.sh@10 -- # set +x 00:27:38.290 [2024-07-22 20:33:09.988754] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:27:38.290 [2024-07-22 20:33:09.988793] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3562556 ] 00:27:38.290 EAL: No free 2048 kB hugepages reported on node 1 00:27:38.290 [2024-07-22 20:33:10.043868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:38.290 [2024-07-22 20:33:10.130437] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:38.290 [2024-07-22 20:33:10.130551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:38.857 20:33:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:38.857 20:33:10 -- common/autotest_common.sh@852 -- # return 0 00:27:38.857 20:33:10 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:38.857 20:33:10 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:27:38.857 20:33:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:38.857 20:33:10 -- common/autotest_common.sh@10 -- # set +x 00:27:39.115 20:33:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.115 20:33:10 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:27:39.115 20:33:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.115 20:33:10 -- common/autotest_common.sh@10 -- # set +x 00:27:39.115 20:33:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.115 20:33:10 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:27:39.115 20:33:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.115 20:33:10 -- common/autotest_common.sh@10 -- # set +x 00:27:40.050 [2024-07-22 20:33:11.934821] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:27:40.050 [2024-07-22 20:33:11.934844] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:27:40.050 [2024-07-22 20:33:11.934858] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:40.308 [2024-07-22 20:33:12.065262] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:27:40.308 [2024-07-22 20:33:12.124378] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:27:40.308 [2024-07-22 20:33:12.124415] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:27:40.308 [2024-07-22 20:33:12.124437] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:27:40.308 [2024-07-22 20:33:12.124451] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:27:40.308 [2024-07-22 20:33:12.124469] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:27:40.308 20:33:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:40.308 20:33:12 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:27:40.308 20:33:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:40.308 20:33:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:40.308 20:33:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:40.308 20:33:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:40.308 20:33:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:40.308 20:33:12 -- common/autotest_common.sh@10 -- # set +x 00:27:40.308 20:33:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:40.308 [2024-07-22 20:33:12.134306] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1254980 was disconnected and freed. delete nvme_qpair. 00:27:40.308 20:33:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:40.309 20:33:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:27:40.309 20:33:12 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:27:40.309 20:33:12 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:27:40.567 20:33:12 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:27:40.567 20:33:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:40.567 20:33:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:40.567 20:33:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:40.567 20:33:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:40.567 20:33:12 -- common/autotest_common.sh@10 -- # set +x 00:27:40.567 20:33:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:40.567 20:33:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:40.567 20:33:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:40.567 20:33:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:27:40.567 20:33:12 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:41.502 20:33:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:41.502 20:33:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:41.502 20:33:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:41.502 20:33:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:41.502 20:33:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:41.503 20:33:13 -- common/autotest_common.sh@10 -- # set +x 00:27:41.503 20:33:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:41.503 20:33:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:41.503 20:33:13 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:27:41.503 20:33:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:42.877 20:33:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:42.877 20:33:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:42.877 20:33:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:42.877 20:33:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:42.877 20:33:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:42.877 20:33:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:42.877 20:33:14 -- common/autotest_common.sh@10 -- # set +x 00:27:42.877 20:33:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:42.877 20:33:14 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:27:42.877 20:33:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:43.812 20:33:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:43.812 20:33:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:43.812 20:33:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:43.812 20:33:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:43.812 20:33:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:43.812 20:33:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:43.812 20:33:15 -- common/autotest_common.sh@10 -- # set +x 00:27:43.812 20:33:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:43.812 20:33:15 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:27:43.812 20:33:15 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:44.747 20:33:16 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:44.747 20:33:16 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:44.747 20:33:16 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:44.747 20:33:16 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:44.747 20:33:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:44.747 20:33:16 -- common/autotest_common.sh@10 -- # set +x 00:27:44.747 20:33:16 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:44.747 20:33:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:44.747 20:33:16 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:27:44.747 20:33:16 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:45.682 20:33:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:45.682 20:33:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:45.682 20:33:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:45.682 20:33:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:45.682 20:33:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:45.682 20:33:17 -- common/autotest_common.sh@10 -- # set +x 00:27:45.682 20:33:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:45.682 20:33:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:45.682 [2024-07-22 20:33:17.565623] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:27:45.682 [2024-07-22 20:33:17.565661] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:45.682 [2024-07-22 20:33:17.565687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:45.683 [2024-07-22 20:33:17.565697] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:45.683 [2024-07-22 20:33:17.565704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:45.683 [2024-07-22 20:33:17.565711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:45.683 [2024-07-22 20:33:17.565717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:45.683 [2024-07-22 20:33:17.565724] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:45.683 [2024-07-22 20:33:17.565731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:45.683 [2024-07-22 20:33:17.565738] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:45.683 [2024-07-22 20:33:17.565745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:45.683 [2024-07-22 20:33:17.565751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x121bc50 is same with the state(5) to be set 00:27:45.683 20:33:17 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:27:45.683 20:33:17 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:45.683 [2024-07-22 20:33:17.575644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x121bc50 (9): Bad file descriptor 00:27:45.683 [2024-07-22 20:33:17.585684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:46.679 20:33:18 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:46.679 20:33:18 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:46.679 20:33:18 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:46.679 20:33:18 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:46.679 20:33:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:46.680 20:33:18 -- common/autotest_common.sh@10 -- # set +x 00:27:46.680 20:33:18 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:46.964 [2024-07-22 20:33:18.594060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:27:47.900 [2024-07-22 20:33:19.619063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:27:47.900 [2024-07-22 20:33:19.619107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x121bc50 with addr=10.0.0.2, port=4420 00:27:47.900 [2024-07-22 20:33:19.619124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x121bc50 is same with the state(5) to be set 00:27:47.900 [2024-07-22 20:33:19.619149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:27:47.900 [2024-07-22 20:33:19.619160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:27:47.900 [2024-07-22 20:33:19.619168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:27:47.900 [2024-07-22 20:33:19.619179] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:27:47.900 [2024-07-22 20:33:19.619548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x121bc50 (9): Bad file descriptor 00:27:47.900 [2024-07-22 20:33:19.619574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:47.900 [2024-07-22 20:33:19.619597] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:27:47.900 [2024-07-22 20:33:19.619621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.900 [2024-07-22 20:33:19.619634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.900 [2024-07-22 20:33:19.619646] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.900 [2024-07-22 20:33:19.619656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.900 [2024-07-22 20:33:19.619666] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.900 [2024-07-22 20:33:19.619675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.900 [2024-07-22 20:33:19.619685] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.900 [2024-07-22 20:33:19.619694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.900 [2024-07-22 20:33:19.619705] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:47.900 [2024-07-22 20:33:19.619714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:47.900 [2024-07-22 20:33:19.619723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:27:47.900 [2024-07-22 20:33:19.620151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x121b140 (9): Bad file descriptor 00:27:47.900 [2024-07-22 20:33:19.621163] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:27:47.900 [2024-07-22 20:33:19.621178] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:27:47.900 20:33:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:47.900 20:33:19 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:27:47.900 20:33:19 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:48.834 20:33:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:48.834 20:33:20 -- common/autotest_common.sh@10 -- # set +x 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:48.834 20:33:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:48.834 20:33:20 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:49.091 20:33:20 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:49.091 20:33:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:49.091 20:33:20 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:49.091 20:33:20 -- common/autotest_common.sh@10 -- # set +x 00:27:49.091 20:33:20 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:49.091 20:33:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:49.091 20:33:20 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:27:49.091 20:33:20 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:50.026 [2024-07-22 20:33:21.680856] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:27:50.026 [2024-07-22 20:33:21.680875] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:27:50.026 [2024-07-22 20:33:21.680890] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:27:50.026 [2024-07-22 20:33:21.812287] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:27:50.026 20:33:21 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:50.026 20:33:21 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:50.026 20:33:21 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:50.026 20:33:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:50.026 20:33:21 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:50.026 20:33:21 -- common/autotest_common.sh@10 -- # set +x 00:27:50.026 20:33:21 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:50.026 20:33:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:50.026 20:33:21 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:27:50.026 20:33:21 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:27:50.295 [2024-07-22 20:33:21.992180] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:27:50.296 [2024-07-22 20:33:21.992214] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:27:50.296 [2024-07-22 20:33:21.992230] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:27:50.296 [2024-07-22 20:33:21.992242] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:27:50.296 [2024-07-22 20:33:21.992249] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:27:50.296 [2024-07-22 20:33:21.999409] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x122a6e0 was disconnected and freed. delete nvme_qpair. 00:27:51.232 20:33:22 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:27:51.232 20:33:22 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:27:51.232 20:33:22 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:27:51.232 20:33:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.232 20:33:22 -- host/discovery_remove_ifc.sh@29 -- # sort 00:27:51.232 20:33:22 -- common/autotest_common.sh@10 -- # set +x 00:27:51.232 20:33:22 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:27:51.232 20:33:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.232 20:33:22 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:27:51.232 20:33:22 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:27:51.232 20:33:22 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3562556 00:27:51.232 20:33:22 -- common/autotest_common.sh@926 -- # '[' -z 3562556 ']' 00:27:51.232 20:33:22 -- common/autotest_common.sh@930 -- # kill -0 3562556 00:27:51.232 20:33:22 -- common/autotest_common.sh@931 -- # uname 00:27:51.232 20:33:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:51.233 20:33:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3562556 00:27:51.233 20:33:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:51.233 20:33:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:51.233 20:33:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3562556' 00:27:51.233 killing process with pid 3562556 00:27:51.233 20:33:22 -- common/autotest_common.sh@945 -- # kill 3562556 00:27:51.233 20:33:22 -- common/autotest_common.sh@950 -- # wait 3562556 00:27:51.233 20:33:23 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:27:51.233 20:33:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:51.233 20:33:23 -- nvmf/common.sh@116 -- # sync 00:27:51.233 20:33:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:51.233 20:33:23 -- nvmf/common.sh@119 -- # set +e 00:27:51.233 20:33:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:51.233 20:33:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:51.233 rmmod nvme_tcp 00:27:51.492 rmmod nvme_fabrics 00:27:51.492 rmmod nvme_keyring 00:27:51.492 20:33:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:51.492 20:33:23 -- nvmf/common.sh@123 -- # set -e 00:27:51.492 20:33:23 -- nvmf/common.sh@124 -- # return 0 00:27:51.492 20:33:23 -- nvmf/common.sh@477 -- # '[' -n 3562176 ']' 00:27:51.492 20:33:23 -- nvmf/common.sh@478 -- # killprocess 3562176 00:27:51.492 20:33:23 -- common/autotest_common.sh@926 -- # '[' -z 3562176 ']' 00:27:51.492 20:33:23 -- common/autotest_common.sh@930 -- # kill -0 3562176 00:27:51.492 20:33:23 -- common/autotest_common.sh@931 -- # uname 00:27:51.492 20:33:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:51.492 20:33:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3562176 00:27:51.492 20:33:23 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:51.492 20:33:23 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:51.492 20:33:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3562176' 00:27:51.492 killing process with pid 3562176 00:27:51.492 20:33:23 -- common/autotest_common.sh@945 -- # kill 3562176 00:27:51.492 20:33:23 -- common/autotest_common.sh@950 -- # wait 3562176 00:27:51.751 20:33:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:51.751 20:33:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:51.751 20:33:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:51.751 20:33:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:51.751 20:33:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:51.751 20:33:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:51.751 20:33:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:51.751 20:33:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:53.656 20:33:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:53.656 00:27:53.656 real 0m21.975s 00:27:53.656 user 0m27.574s 00:27:53.656 sys 0m5.258s 00:27:53.656 20:33:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:53.656 20:33:25 -- common/autotest_common.sh@10 -- # set +x 00:27:53.656 ************************************ 00:27:53.656 END TEST nvmf_discovery_remove_ifc 00:27:53.656 ************************************ 00:27:53.656 20:33:25 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:27:53.656 20:33:25 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:27:53.656 20:33:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:53.656 20:33:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:53.656 20:33:25 -- common/autotest_common.sh@10 -- # set +x 00:27:53.656 ************************************ 00:27:53.656 START TEST nvmf_digest 00:27:53.656 ************************************ 00:27:53.656 20:33:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:27:53.915 * Looking for test storage... 00:27:53.915 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:53.915 20:33:25 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:53.915 20:33:25 -- nvmf/common.sh@7 -- # uname -s 00:27:53.915 20:33:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:53.915 20:33:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:53.915 20:33:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:53.916 20:33:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:53.916 20:33:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:53.916 20:33:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:53.916 20:33:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:53.916 20:33:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:53.916 20:33:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:53.916 20:33:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:53.916 20:33:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:27:53.916 20:33:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:27:53.916 20:33:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:53.916 20:33:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:53.916 20:33:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:53.916 20:33:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:53.916 20:33:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:53.916 20:33:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:53.916 20:33:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:53.916 20:33:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.916 20:33:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.916 20:33:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.916 20:33:25 -- paths/export.sh@5 -- # export PATH 00:27:53.916 20:33:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.916 20:33:25 -- nvmf/common.sh@46 -- # : 0 00:27:53.916 20:33:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:53.916 20:33:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:53.916 20:33:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:53.916 20:33:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:53.916 20:33:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:53.916 20:33:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:53.916 20:33:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:53.916 20:33:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:53.916 20:33:25 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:27:53.916 20:33:25 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:27:53.916 20:33:25 -- host/digest.sh@16 -- # runtime=2 00:27:53.916 20:33:25 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:27:53.916 20:33:25 -- host/digest.sh@132 -- # nvmftestinit 00:27:53.916 20:33:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:53.916 20:33:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:53.916 20:33:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:53.916 20:33:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:53.916 20:33:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:53.916 20:33:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:53.916 20:33:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:53.916 20:33:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:53.916 20:33:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:53.916 20:33:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:53.916 20:33:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:53.916 20:33:25 -- common/autotest_common.sh@10 -- # set +x 00:27:59.184 20:33:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:59.184 20:33:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:59.184 20:33:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:59.184 20:33:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:59.184 20:33:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:59.184 20:33:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:59.184 20:33:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:59.184 20:33:30 -- nvmf/common.sh@294 -- # net_devs=() 00:27:59.184 20:33:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:59.184 20:33:30 -- nvmf/common.sh@295 -- # e810=() 00:27:59.184 20:33:30 -- nvmf/common.sh@295 -- # local -ga e810 00:27:59.184 20:33:30 -- nvmf/common.sh@296 -- # x722=() 00:27:59.184 20:33:30 -- nvmf/common.sh@296 -- # local -ga x722 00:27:59.184 20:33:30 -- nvmf/common.sh@297 -- # mlx=() 00:27:59.184 20:33:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:59.184 20:33:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:59.184 20:33:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:59.184 20:33:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:59.184 20:33:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:59.184 20:33:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:59.184 20:33:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:27:59.184 Found 0000:86:00.0 (0x8086 - 0x159b) 00:27:59.184 20:33:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:59.184 20:33:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:27:59.184 Found 0000:86:00.1 (0x8086 - 0x159b) 00:27:59.184 20:33:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:59.184 20:33:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:59.184 20:33:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:59.185 20:33:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:59.185 20:33:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:59.185 20:33:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:59.185 20:33:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:27:59.185 Found net devices under 0000:86:00.0: cvl_0_0 00:27:59.185 20:33:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:59.185 20:33:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:59.185 20:33:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:59.185 20:33:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:59.185 20:33:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:59.185 20:33:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:27:59.185 Found net devices under 0000:86:00.1: cvl_0_1 00:27:59.185 20:33:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:59.185 20:33:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:59.185 20:33:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:59.185 20:33:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:59.185 20:33:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:59.185 20:33:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:59.185 20:33:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:59.185 20:33:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:59.185 20:33:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:59.185 20:33:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:59.185 20:33:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:59.185 20:33:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:59.185 20:33:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:59.185 20:33:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:59.185 20:33:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:59.185 20:33:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:59.185 20:33:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:59.185 20:33:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:59.185 20:33:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:59.185 20:33:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:59.185 20:33:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:59.185 20:33:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:59.185 20:33:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:59.185 20:33:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:59.185 20:33:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:59.185 20:33:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:59.185 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:59.185 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:27:59.185 00:27:59.185 --- 10.0.0.2 ping statistics --- 00:27:59.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:59.185 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:27:59.185 20:33:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:59.185 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:59.185 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.232 ms 00:27:59.185 00:27:59.185 --- 10.0.0.1 ping statistics --- 00:27:59.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:59.185 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:27:59.185 20:33:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:59.185 20:33:30 -- nvmf/common.sh@410 -- # return 0 00:27:59.185 20:33:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:59.185 20:33:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:59.185 20:33:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:59.185 20:33:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:59.185 20:33:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:59.185 20:33:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:59.185 20:33:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:59.185 20:33:30 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:27:59.185 20:33:30 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:27:59.185 20:33:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:59.185 20:33:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:59.185 20:33:30 -- common/autotest_common.sh@10 -- # set +x 00:27:59.185 ************************************ 00:27:59.185 START TEST nvmf_digest_clean 00:27:59.185 ************************************ 00:27:59.185 20:33:30 -- common/autotest_common.sh@1104 -- # run_digest 00:27:59.185 20:33:30 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:27:59.185 20:33:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:59.185 20:33:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:59.185 20:33:30 -- common/autotest_common.sh@10 -- # set +x 00:27:59.185 20:33:30 -- nvmf/common.sh@469 -- # nvmfpid=3568236 00:27:59.185 20:33:30 -- nvmf/common.sh@470 -- # waitforlisten 3568236 00:27:59.185 20:33:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:59.185 20:33:30 -- common/autotest_common.sh@819 -- # '[' -z 3568236 ']' 00:27:59.185 20:33:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:59.185 20:33:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:59.185 20:33:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:59.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:59.185 20:33:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:59.185 20:33:30 -- common/autotest_common.sh@10 -- # set +x 00:27:59.185 [2024-07-22 20:33:30.981130] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:27:59.185 [2024-07-22 20:33:30.981174] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:59.185 EAL: No free 2048 kB hugepages reported on node 1 00:27:59.185 [2024-07-22 20:33:31.039502] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:59.185 [2024-07-22 20:33:31.110668] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:59.185 [2024-07-22 20:33:31.110776] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:59.185 [2024-07-22 20:33:31.110783] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:59.185 [2024-07-22 20:33:31.110789] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:59.185 [2024-07-22 20:33:31.110806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:00.120 20:33:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:00.120 20:33:31 -- common/autotest_common.sh@852 -- # return 0 00:28:00.120 20:33:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:00.120 20:33:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:00.120 20:33:31 -- common/autotest_common.sh@10 -- # set +x 00:28:00.120 20:33:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:00.120 20:33:31 -- host/digest.sh@120 -- # common_target_config 00:28:00.120 20:33:31 -- host/digest.sh@43 -- # rpc_cmd 00:28:00.120 20:33:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:00.120 20:33:31 -- common/autotest_common.sh@10 -- # set +x 00:28:00.120 null0 00:28:00.120 [2024-07-22 20:33:31.893961] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:00.120 [2024-07-22 20:33:31.918143] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:00.120 20:33:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:00.120 20:33:31 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:28:00.120 20:33:31 -- host/digest.sh@77 -- # local rw bs qd 00:28:00.120 20:33:31 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:28:00.120 20:33:31 -- host/digest.sh@80 -- # rw=randread 00:28:00.120 20:33:31 -- host/digest.sh@80 -- # bs=4096 00:28:00.120 20:33:31 -- host/digest.sh@80 -- # qd=128 00:28:00.120 20:33:31 -- host/digest.sh@82 -- # bperfpid=3568326 00:28:00.120 20:33:31 -- host/digest.sh@83 -- # waitforlisten 3568326 /var/tmp/bperf.sock 00:28:00.120 20:33:31 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:28:00.120 20:33:31 -- common/autotest_common.sh@819 -- # '[' -z 3568326 ']' 00:28:00.120 20:33:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:00.121 20:33:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:00.121 20:33:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:00.121 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:00.121 20:33:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:00.121 20:33:31 -- common/autotest_common.sh@10 -- # set +x 00:28:00.121 [2024-07-22 20:33:31.965276] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:00.121 [2024-07-22 20:33:31.965317] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3568326 ] 00:28:00.121 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.121 [2024-07-22 20:33:32.016165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:00.379 [2024-07-22 20:33:32.087606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:00.946 20:33:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:00.946 20:33:32 -- common/autotest_common.sh@852 -- # return 0 00:28:00.946 20:33:32 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:28:00.946 20:33:32 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:28:00.946 20:33:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:28:01.204 20:33:33 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:01.204 20:33:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:01.461 nvme0n1 00:28:01.719 20:33:33 -- host/digest.sh@91 -- # bperf_py perform_tests 00:28:01.719 20:33:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:01.719 Running I/O for 2 seconds... 00:28:03.616 00:28:03.616 Latency(us) 00:28:03.616 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:03.616 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:28:03.616 nvme0n1 : 2.00 27955.85 109.20 0.00 0.00 4574.09 1716.76 21769.35 00:28:03.616 =================================================================================================================== 00:28:03.617 Total : 27955.85 109.20 0.00 0.00 4574.09 1716.76 21769.35 00:28:03.617 0 00:28:03.617 20:33:35 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:28:03.617 20:33:35 -- host/digest.sh@92 -- # get_accel_stats 00:28:03.617 20:33:35 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:28:03.617 20:33:35 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:28:03.617 | select(.opcode=="crc32c") 00:28:03.617 | "\(.module_name) \(.executed)"' 00:28:03.617 20:33:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:28:03.875 20:33:35 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:28:03.875 20:33:35 -- host/digest.sh@93 -- # exp_module=software 00:28:03.875 20:33:35 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:28:03.875 20:33:35 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:28:03.875 20:33:35 -- host/digest.sh@97 -- # killprocess 3568326 00:28:03.875 20:33:35 -- common/autotest_common.sh@926 -- # '[' -z 3568326 ']' 00:28:03.875 20:33:35 -- common/autotest_common.sh@930 -- # kill -0 3568326 00:28:03.875 20:33:35 -- common/autotest_common.sh@931 -- # uname 00:28:03.875 20:33:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:03.875 20:33:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3568326 00:28:03.875 20:33:35 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:03.875 20:33:35 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:03.875 20:33:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3568326' 00:28:03.875 killing process with pid 3568326 00:28:03.875 20:33:35 -- common/autotest_common.sh@945 -- # kill 3568326 00:28:03.875 Received shutdown signal, test time was about 2.000000 seconds 00:28:03.875 00:28:03.875 Latency(us) 00:28:03.875 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:03.875 =================================================================================================================== 00:28:03.875 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:03.875 20:33:35 -- common/autotest_common.sh@950 -- # wait 3568326 00:28:04.134 20:33:35 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:28:04.134 20:33:35 -- host/digest.sh@77 -- # local rw bs qd 00:28:04.134 20:33:35 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:28:04.134 20:33:35 -- host/digest.sh@80 -- # rw=randread 00:28:04.134 20:33:35 -- host/digest.sh@80 -- # bs=131072 00:28:04.134 20:33:35 -- host/digest.sh@80 -- # qd=16 00:28:04.134 20:33:35 -- host/digest.sh@82 -- # bperfpid=3569036 00:28:04.134 20:33:35 -- host/digest.sh@83 -- # waitforlisten 3569036 /var/tmp/bperf.sock 00:28:04.134 20:33:35 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:28:04.134 20:33:35 -- common/autotest_common.sh@819 -- # '[' -z 3569036 ']' 00:28:04.134 20:33:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:04.134 20:33:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:04.134 20:33:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:04.134 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:04.134 20:33:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:04.134 20:33:35 -- common/autotest_common.sh@10 -- # set +x 00:28:04.134 [2024-07-22 20:33:35.967382] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:04.134 [2024-07-22 20:33:35.967429] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3569036 ] 00:28:04.134 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:04.134 Zero copy mechanism will not be used. 00:28:04.134 EAL: No free 2048 kB hugepages reported on node 1 00:28:04.134 [2024-07-22 20:33:36.019199] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:04.392 [2024-07-22 20:33:36.098858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:04.957 20:33:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:04.957 20:33:36 -- common/autotest_common.sh@852 -- # return 0 00:28:04.957 20:33:36 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:28:04.957 20:33:36 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:28:04.957 20:33:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:28:05.215 20:33:37 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:05.215 20:33:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:05.473 nvme0n1 00:28:05.473 20:33:37 -- host/digest.sh@91 -- # bperf_py perform_tests 00:28:05.473 20:33:37 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:05.731 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:05.731 Zero copy mechanism will not be used. 00:28:05.731 Running I/O for 2 seconds... 00:28:07.630 00:28:07.630 Latency(us) 00:28:07.630 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:07.630 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:28:07.630 nvme0n1 : 2.00 3087.00 385.88 0.00 0.00 5180.59 4729.99 14474.91 00:28:07.630 =================================================================================================================== 00:28:07.630 Total : 3087.00 385.88 0.00 0.00 5180.59 4729.99 14474.91 00:28:07.630 0 00:28:07.630 20:33:39 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:28:07.630 20:33:39 -- host/digest.sh@92 -- # get_accel_stats 00:28:07.630 20:33:39 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:28:07.630 | select(.opcode=="crc32c") 00:28:07.630 | "\(.module_name) \(.executed)"' 00:28:07.630 20:33:39 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:28:07.630 20:33:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:28:07.889 20:33:39 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:28:07.889 20:33:39 -- host/digest.sh@93 -- # exp_module=software 00:28:07.889 20:33:39 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:28:07.889 20:33:39 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:28:07.889 20:33:39 -- host/digest.sh@97 -- # killprocess 3569036 00:28:07.889 20:33:39 -- common/autotest_common.sh@926 -- # '[' -z 3569036 ']' 00:28:07.889 20:33:39 -- common/autotest_common.sh@930 -- # kill -0 3569036 00:28:07.889 20:33:39 -- common/autotest_common.sh@931 -- # uname 00:28:07.889 20:33:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:07.889 20:33:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3569036 00:28:07.889 20:33:39 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:07.889 20:33:39 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:07.889 20:33:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3569036' 00:28:07.889 killing process with pid 3569036 00:28:07.889 20:33:39 -- common/autotest_common.sh@945 -- # kill 3569036 00:28:07.889 Received shutdown signal, test time was about 2.000000 seconds 00:28:07.889 00:28:07.889 Latency(us) 00:28:07.889 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:07.889 =================================================================================================================== 00:28:07.889 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:07.889 20:33:39 -- common/autotest_common.sh@950 -- # wait 3569036 00:28:08.147 20:33:39 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:28:08.147 20:33:39 -- host/digest.sh@77 -- # local rw bs qd 00:28:08.147 20:33:39 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:28:08.147 20:33:39 -- host/digest.sh@80 -- # rw=randwrite 00:28:08.147 20:33:39 -- host/digest.sh@80 -- # bs=4096 00:28:08.147 20:33:39 -- host/digest.sh@80 -- # qd=128 00:28:08.147 20:33:39 -- host/digest.sh@82 -- # bperfpid=3569738 00:28:08.147 20:33:39 -- host/digest.sh@83 -- # waitforlisten 3569738 /var/tmp/bperf.sock 00:28:08.147 20:33:39 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:28:08.147 20:33:39 -- common/autotest_common.sh@819 -- # '[' -z 3569738 ']' 00:28:08.147 20:33:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:08.147 20:33:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:08.147 20:33:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:08.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:08.147 20:33:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:08.147 20:33:39 -- common/autotest_common.sh@10 -- # set +x 00:28:08.147 [2024-07-22 20:33:39.934173] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:08.147 [2024-07-22 20:33:39.934221] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3569738 ] 00:28:08.147 EAL: No free 2048 kB hugepages reported on node 1 00:28:08.147 [2024-07-22 20:33:39.984984] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:08.147 [2024-07-22 20:33:40.065761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:09.081 20:33:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:09.081 20:33:40 -- common/autotest_common.sh@852 -- # return 0 00:28:09.081 20:33:40 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:28:09.081 20:33:40 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:28:09.081 20:33:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:28:09.081 20:33:40 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:09.081 20:33:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:09.339 nvme0n1 00:28:09.339 20:33:41 -- host/digest.sh@91 -- # bperf_py perform_tests 00:28:09.339 20:33:41 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:09.597 Running I/O for 2 seconds... 00:28:11.516 00:28:11.516 Latency(us) 00:28:11.516 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:11.516 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:28:11.516 nvme0n1 : 2.00 28149.68 109.96 0.00 0.00 4539.48 2607.19 21655.37 00:28:11.516 =================================================================================================================== 00:28:11.516 Total : 28149.68 109.96 0.00 0.00 4539.48 2607.19 21655.37 00:28:11.516 0 00:28:11.516 20:33:43 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:28:11.516 20:33:43 -- host/digest.sh@92 -- # get_accel_stats 00:28:11.516 20:33:43 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:28:11.516 20:33:43 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:28:11.516 | select(.opcode=="crc32c") 00:28:11.516 | "\(.module_name) \(.executed)"' 00:28:11.516 20:33:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:28:11.808 20:33:43 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:28:11.808 20:33:43 -- host/digest.sh@93 -- # exp_module=software 00:28:11.808 20:33:43 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:28:11.808 20:33:43 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:28:11.808 20:33:43 -- host/digest.sh@97 -- # killprocess 3569738 00:28:11.808 20:33:43 -- common/autotest_common.sh@926 -- # '[' -z 3569738 ']' 00:28:11.808 20:33:43 -- common/autotest_common.sh@930 -- # kill -0 3569738 00:28:11.808 20:33:43 -- common/autotest_common.sh@931 -- # uname 00:28:11.808 20:33:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:11.808 20:33:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3569738 00:28:11.808 20:33:43 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:11.808 20:33:43 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:11.808 20:33:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3569738' 00:28:11.808 killing process with pid 3569738 00:28:11.808 20:33:43 -- common/autotest_common.sh@945 -- # kill 3569738 00:28:11.808 Received shutdown signal, test time was about 2.000000 seconds 00:28:11.808 00:28:11.808 Latency(us) 00:28:11.808 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:11.808 =================================================================================================================== 00:28:11.808 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:11.809 20:33:43 -- common/autotest_common.sh@950 -- # wait 3569738 00:28:12.067 20:33:43 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:28:12.067 20:33:43 -- host/digest.sh@77 -- # local rw bs qd 00:28:12.067 20:33:43 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:28:12.067 20:33:43 -- host/digest.sh@80 -- # rw=randwrite 00:28:12.067 20:33:43 -- host/digest.sh@80 -- # bs=131072 00:28:12.067 20:33:43 -- host/digest.sh@80 -- # qd=16 00:28:12.067 20:33:43 -- host/digest.sh@82 -- # bperfpid=3570403 00:28:12.067 20:33:43 -- host/digest.sh@83 -- # waitforlisten 3570403 /var/tmp/bperf.sock 00:28:12.067 20:33:43 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:28:12.067 20:33:43 -- common/autotest_common.sh@819 -- # '[' -z 3570403 ']' 00:28:12.067 20:33:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:12.067 20:33:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:12.067 20:33:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:12.067 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:12.067 20:33:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:12.067 20:33:43 -- common/autotest_common.sh@10 -- # set +x 00:28:12.067 [2024-07-22 20:33:43.829661] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:12.067 [2024-07-22 20:33:43.829708] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3570403 ] 00:28:12.067 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:12.067 Zero copy mechanism will not be used. 00:28:12.067 EAL: No free 2048 kB hugepages reported on node 1 00:28:12.067 [2024-07-22 20:33:43.881559] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:12.067 [2024-07-22 20:33:43.959148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:12.999 20:33:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:12.999 20:33:44 -- common/autotest_common.sh@852 -- # return 0 00:28:12.999 20:33:44 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:28:12.999 20:33:44 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:28:12.999 20:33:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:28:12.999 20:33:44 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:12.999 20:33:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:13.564 nvme0n1 00:28:13.565 20:33:45 -- host/digest.sh@91 -- # bperf_py perform_tests 00:28:13.565 20:33:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:13.565 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:13.565 Zero copy mechanism will not be used. 00:28:13.565 Running I/O for 2 seconds... 00:28:15.464 00:28:15.465 Latency(us) 00:28:15.465 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:15.465 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:28:15.465 nvme0n1 : 2.01 2233.42 279.18 0.00 0.00 7149.31 4473.54 22567.18 00:28:15.465 =================================================================================================================== 00:28:15.465 Total : 2233.42 279.18 0.00 0.00 7149.31 4473.54 22567.18 00:28:15.465 0 00:28:15.465 20:33:47 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:28:15.465 20:33:47 -- host/digest.sh@92 -- # get_accel_stats 00:28:15.465 20:33:47 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:28:15.465 20:33:47 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:28:15.465 | select(.opcode=="crc32c") 00:28:15.465 | "\(.module_name) \(.executed)"' 00:28:15.465 20:33:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:28:15.724 20:33:47 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:28:15.724 20:33:47 -- host/digest.sh@93 -- # exp_module=software 00:28:15.724 20:33:47 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:28:15.724 20:33:47 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:28:15.724 20:33:47 -- host/digest.sh@97 -- # killprocess 3570403 00:28:15.724 20:33:47 -- common/autotest_common.sh@926 -- # '[' -z 3570403 ']' 00:28:15.724 20:33:47 -- common/autotest_common.sh@930 -- # kill -0 3570403 00:28:15.724 20:33:47 -- common/autotest_common.sh@931 -- # uname 00:28:15.724 20:33:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:15.724 20:33:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3570403 00:28:15.724 20:33:47 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:15.724 20:33:47 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:15.724 20:33:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3570403' 00:28:15.724 killing process with pid 3570403 00:28:15.724 20:33:47 -- common/autotest_common.sh@945 -- # kill 3570403 00:28:15.724 Received shutdown signal, test time was about 2.000000 seconds 00:28:15.724 00:28:15.724 Latency(us) 00:28:15.724 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:15.724 =================================================================================================================== 00:28:15.724 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:15.724 20:33:47 -- common/autotest_common.sh@950 -- # wait 3570403 00:28:15.982 20:33:47 -- host/digest.sh@126 -- # killprocess 3568236 00:28:15.982 20:33:47 -- common/autotest_common.sh@926 -- # '[' -z 3568236 ']' 00:28:15.982 20:33:47 -- common/autotest_common.sh@930 -- # kill -0 3568236 00:28:15.982 20:33:47 -- common/autotest_common.sh@931 -- # uname 00:28:15.982 20:33:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:15.982 20:33:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3568236 00:28:15.982 20:33:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:15.982 20:33:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:15.982 20:33:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3568236' 00:28:15.982 killing process with pid 3568236 00:28:15.982 20:33:47 -- common/autotest_common.sh@945 -- # kill 3568236 00:28:15.982 20:33:47 -- common/autotest_common.sh@950 -- # wait 3568236 00:28:16.240 00:28:16.240 real 0m17.089s 00:28:16.240 user 0m33.426s 00:28:16.240 sys 0m3.703s 00:28:16.240 20:33:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:16.240 20:33:48 -- common/autotest_common.sh@10 -- # set +x 00:28:16.240 ************************************ 00:28:16.240 END TEST nvmf_digest_clean 00:28:16.240 ************************************ 00:28:16.240 20:33:48 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:28:16.240 20:33:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:16.240 20:33:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:16.240 20:33:48 -- common/autotest_common.sh@10 -- # set +x 00:28:16.240 ************************************ 00:28:16.240 START TEST nvmf_digest_error 00:28:16.240 ************************************ 00:28:16.240 20:33:48 -- common/autotest_common.sh@1104 -- # run_digest_error 00:28:16.240 20:33:48 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:28:16.240 20:33:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:16.240 20:33:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:16.240 20:33:48 -- common/autotest_common.sh@10 -- # set +x 00:28:16.240 20:33:48 -- nvmf/common.sh@469 -- # nvmfpid=3571153 00:28:16.240 20:33:48 -- nvmf/common.sh@470 -- # waitforlisten 3571153 00:28:16.240 20:33:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:28:16.240 20:33:48 -- common/autotest_common.sh@819 -- # '[' -z 3571153 ']' 00:28:16.240 20:33:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:16.240 20:33:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:16.240 20:33:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:16.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:16.240 20:33:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:16.240 20:33:48 -- common/autotest_common.sh@10 -- # set +x 00:28:16.240 [2024-07-22 20:33:48.114539] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:16.240 [2024-07-22 20:33:48.114587] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:16.240 EAL: No free 2048 kB hugepages reported on node 1 00:28:16.240 [2024-07-22 20:33:48.172266] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:16.498 [2024-07-22 20:33:48.241699] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:16.498 [2024-07-22 20:33:48.241815] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:16.498 [2024-07-22 20:33:48.241824] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:16.498 [2024-07-22 20:33:48.241830] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:16.498 [2024-07-22 20:33:48.241850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:17.065 20:33:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:17.065 20:33:48 -- common/autotest_common.sh@852 -- # return 0 00:28:17.065 20:33:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:17.065 20:33:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:17.065 20:33:48 -- common/autotest_common.sh@10 -- # set +x 00:28:17.065 20:33:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:17.065 20:33:48 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:28:17.065 20:33:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:17.065 20:33:48 -- common/autotest_common.sh@10 -- # set +x 00:28:17.065 [2024-07-22 20:33:48.943884] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:28:17.065 20:33:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:17.065 20:33:48 -- host/digest.sh@104 -- # common_target_config 00:28:17.065 20:33:48 -- host/digest.sh@43 -- # rpc_cmd 00:28:17.065 20:33:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:17.065 20:33:48 -- common/autotest_common.sh@10 -- # set +x 00:28:17.324 null0 00:28:17.324 [2024-07-22 20:33:49.037453] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:17.324 [2024-07-22 20:33:49.061631] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:17.324 20:33:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:17.324 20:33:49 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:28:17.324 20:33:49 -- host/digest.sh@54 -- # local rw bs qd 00:28:17.324 20:33:49 -- host/digest.sh@56 -- # rw=randread 00:28:17.324 20:33:49 -- host/digest.sh@56 -- # bs=4096 00:28:17.324 20:33:49 -- host/digest.sh@56 -- # qd=128 00:28:17.324 20:33:49 -- host/digest.sh@58 -- # bperfpid=3571215 00:28:17.324 20:33:49 -- host/digest.sh@60 -- # waitforlisten 3571215 /var/tmp/bperf.sock 00:28:17.324 20:33:49 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:28:17.324 20:33:49 -- common/autotest_common.sh@819 -- # '[' -z 3571215 ']' 00:28:17.324 20:33:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:17.324 20:33:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:17.324 20:33:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:17.324 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:17.324 20:33:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:17.324 20:33:49 -- common/autotest_common.sh@10 -- # set +x 00:28:17.324 [2024-07-22 20:33:49.109826] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:17.324 [2024-07-22 20:33:49.109868] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3571215 ] 00:28:17.324 EAL: No free 2048 kB hugepages reported on node 1 00:28:17.324 [2024-07-22 20:33:49.161725] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:17.324 [2024-07-22 20:33:49.232483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:18.259 20:33:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:18.259 20:33:49 -- common/autotest_common.sh@852 -- # return 0 00:28:18.259 20:33:49 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:28:18.259 20:33:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:28:18.259 20:33:50 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:28:18.259 20:33:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:18.259 20:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:18.259 20:33:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:18.259 20:33:50 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:18.259 20:33:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:18.517 nvme0n1 00:28:18.517 20:33:50 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:28:18.517 20:33:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:18.517 20:33:50 -- common/autotest_common.sh@10 -- # set +x 00:28:18.517 20:33:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:18.517 20:33:50 -- host/digest.sh@69 -- # bperf_py perform_tests 00:28:18.517 20:33:50 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:18.517 Running I/O for 2 seconds... 00:28:18.775 [2024-07-22 20:33:50.471450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.775 [2024-07-22 20:33:50.471485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6182 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.471496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.483284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.483310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5734 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.483319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.492735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.492757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:2101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.492766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.501533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.501553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:8686 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.501562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.510600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.510621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8488 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.510630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.519140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.519162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:7867 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.519170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.528554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.528575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:3117 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.528589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.537449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.537469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:7914 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.537478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.546214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.546235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:20140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.546244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.555488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.555508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5996 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.555516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.564134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.564154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:8764 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.564163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.572888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.572911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:22388 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.572919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.582283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.582304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:9098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.582312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.590934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.590955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9963 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.590964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.599581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.599603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:23634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.599612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.608882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.608907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.608916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.617627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.617649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23624 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.617659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.626430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.626452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:1757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.626461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.635897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.635918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:10510 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.635927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.644551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.644573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:661 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.644581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.653315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.653336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17695 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.653345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.662664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.662684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:23060 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.662692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.671362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.671383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:4544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.671391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.680132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.680153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:4688 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.680161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.688803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.688824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:1013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.688833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.698181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.698202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:23188 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.776 [2024-07-22 20:33:50.698210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:18.776 [2024-07-22 20:33:50.706983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:18.776 [2024-07-22 20:33:50.707004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:22632 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:18.777 [2024-07-22 20:33:50.707013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.035 [2024-07-22 20:33:50.715655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.035 [2024-07-22 20:33:50.715680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23529 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.035 [2024-07-22 20:33:50.715690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.724599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.724623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:13922 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.724632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.733794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.733816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:913 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.733825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.742979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.742999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:4533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.743008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.751743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.751763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:8299 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.751772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.760917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.760937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20399 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.760949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.769777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.769799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:16238 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.769807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.778590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.778611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:4871 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.778619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.787951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.787972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:20241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.787980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.796663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.796684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:23249 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.796692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.805476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.805497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20927 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.805505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.814108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.814129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:6252 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.814137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.823465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.823486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:4934 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.823494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.832366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.832387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:22642 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.832396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.841008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.841028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:17735 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.841036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.850402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.850423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20134 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.850431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.858986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.859007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:7845 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.859015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.867710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.867731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:4327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.867739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.877003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.877023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9721 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.877031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.885813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.885833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22818 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.885842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.894651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.894671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:21244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.894680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.903656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.903676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:9786 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.903685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.912260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.912280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.912291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.920636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.920657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20481 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.920665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.036 [2024-07-22 20:33:50.929718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.036 [2024-07-22 20:33:50.929738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:3140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.036 [2024-07-22 20:33:50.929745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.037 [2024-07-22 20:33:50.938070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.037 [2024-07-22 20:33:50.938090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:17953 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.037 [2024-07-22 20:33:50.938098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.037 [2024-07-22 20:33:50.946723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.037 [2024-07-22 20:33:50.946744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:7324 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.037 [2024-07-22 20:33:50.946752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.037 [2024-07-22 20:33:50.955192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.037 [2024-07-22 20:33:50.955213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:16914 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.037 [2024-07-22 20:33:50.955221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.037 [2024-07-22 20:33:50.964268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.037 [2024-07-22 20:33:50.964289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:10922 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.037 [2024-07-22 20:33:50.964297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.295 [2024-07-22 20:33:50.972829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.295 [2024-07-22 20:33:50.972854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:21508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.295 [2024-07-22 20:33:50.972864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.295 [2024-07-22 20:33:50.981621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.295 [2024-07-22 20:33:50.981646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:12901 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.295 [2024-07-22 20:33:50.981655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.295 [2024-07-22 20:33:50.990430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.295 [2024-07-22 20:33:50.990455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:14036 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.295 [2024-07-22 20:33:50.990464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.295 [2024-07-22 20:33:50.999634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.295 [2024-07-22 20:33:50.999654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:16520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.295 [2024-07-22 20:33:50.999663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.295 [2024-07-22 20:33:51.008474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.295 [2024-07-22 20:33:51.008495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11002 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.295 [2024-07-22 20:33:51.008503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.295 [2024-07-22 20:33:51.017974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.017996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:12548 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.018004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.026529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.026549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:3191 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.026557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.034606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.034627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:4203 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.034635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.043818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.043839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:10186 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.043847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.052570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.052590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:96 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.052598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.061167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.061187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.061195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.069808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.069828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:8973 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.069836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.078442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.078463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:1773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.078471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.086843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.086864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5516 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.086873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.096149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.096169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:1167 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.096177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.106309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.106329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:16732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.106337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.117034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.117060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7818 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.117068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.125106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.125127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:23757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.125135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.133274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.133295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:22226 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.133303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.141955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.141976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:19058 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.141987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.149927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.149948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:9336 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.149956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.160038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.160063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:10131 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.160071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.169075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.169094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:11669 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.169103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.178600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.178620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:18840 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.178628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.194292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.194312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:5183 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.194321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.205558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.205578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21123 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.205585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.214208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.214228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:8822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.214236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.222559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.222579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.222587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.296 [2024-07-22 20:33:51.231348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.296 [2024-07-22 20:33:51.231376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:16662 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.296 [2024-07-22 20:33:51.231386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.555 [2024-07-22 20:33:51.243972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.555 [2024-07-22 20:33:51.243996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:1904 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.555 [2024-07-22 20:33:51.244005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.555 [2024-07-22 20:33:51.256296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.555 [2024-07-22 20:33:51.256317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:454 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.555 [2024-07-22 20:33:51.256325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.555 [2024-07-22 20:33:51.266596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.555 [2024-07-22 20:33:51.266617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:18493 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.555 [2024-07-22 20:33:51.266625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.555 [2024-07-22 20:33:51.277052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.555 [2024-07-22 20:33:51.277073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:25573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.555 [2024-07-22 20:33:51.277081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.555 [2024-07-22 20:33:51.285456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.285476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:22367 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.285485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.295916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.295936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:4226 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.295944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.305690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.305711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:13633 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.305719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.313749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.313769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:3396 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.313777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.324051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.324072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:16515 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.324080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.335103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.335123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:23132 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.335131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.344251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.344283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.344291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.356913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.356934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:8056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.356942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.367354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.367374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:21567 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.367382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.376731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.376751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23474 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.376759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.389022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.389047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:11494 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.389056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.399600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.399620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19580 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.399628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.409445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.409465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:2342 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.409476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.416914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.416934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:3988 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.416942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.427654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.427675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:14382 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.427683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.439707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.439727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11254 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.439735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.449837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.449858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:3325 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.449866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.459822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.459841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:4546 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.459850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.467936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.467956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:11736 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.467964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.477461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.477482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:18748 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.477490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.556 [2024-07-22 20:33:51.486391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.556 [2024-07-22 20:33:51.486411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12982 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.556 [2024-07-22 20:33:51.486418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.497014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.497039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.497056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.507002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.507024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:4785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.507032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.515759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.515781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9559 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.515789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.524460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.524480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:3190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.524488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.533164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.533185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:20335 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.533193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.544206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.544227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:18868 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.544235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.553783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.553803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:255 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.553811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.561611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.561631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:18831 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.561639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.572541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.572562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:10205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.572573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.582274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.582295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:23053 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.582303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.590613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.590634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:2714 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.590642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.598914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.598935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:22661 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.598943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.608470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.608490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:7284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.608498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.618429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.618449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:1302 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.618457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.630530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.630551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:17473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.630559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.640063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.640082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.640090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.649412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.649432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:2660 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.649440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.659182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.659206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:6236 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.659214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.667747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.667767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:19898 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.667775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.676206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.676227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17927 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.676235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.685400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.685420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:17293 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.685428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.694595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.694615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7065 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.694623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.705814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.705836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:24190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.705844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.717379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.816 [2024-07-22 20:33:51.717400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:12171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.816 [2024-07-22 20:33:51.717409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.816 [2024-07-22 20:33:51.725612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.817 [2024-07-22 20:33:51.725632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:20605 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.817 [2024-07-22 20:33:51.725641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.817 [2024-07-22 20:33:51.735449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.817 [2024-07-22 20:33:51.735469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24251 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.817 [2024-07-22 20:33:51.735478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:19.817 [2024-07-22 20:33:51.746542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:19.817 [2024-07-22 20:33:51.746563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:12211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:19.817 [2024-07-22 20:33:51.746571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.756906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.756947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:12504 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.756961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.765868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.765891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:17014 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.765900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.776987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.777009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:4058 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.777017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.784692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.784712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:6706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.784721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.794955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.794976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:22117 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.794986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.802479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.802499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:23908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.802508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.813884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.813904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:15684 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.813913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.827917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.827937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:2178 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.827948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.838621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.838642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:17364 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.838650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.847902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.847927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:2539 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.847936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.855851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.855873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:14197 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.855882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.864560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.864580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:2266 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.864588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.875707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.875728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:16889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.875736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.885773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.885793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:5974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.885801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.893991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.894011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:21270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.894019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.902909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.902929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11042 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.076 [2024-07-22 20:33:51.902937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.076 [2024-07-22 20:33:51.911093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.076 [2024-07-22 20:33:51.911116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:4310 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.911124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.920303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.920323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:4520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.920331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.930905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.930925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:15109 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.930933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.940033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.940057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:4849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.940064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.948220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.948240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.948248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.956716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.956736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:3983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.956744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.966675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.966695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:13900 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.966702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.974545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.974566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:5519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.974574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.986245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.986265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:3260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.986273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:51.998618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:51.998641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6249 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:51.998649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.077 [2024-07-22 20:33:52.011883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.077 [2024-07-22 20:33:52.011906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:16935 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.077 [2024-07-22 20:33:52.011916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.335 [2024-07-22 20:33:52.021400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.335 [2024-07-22 20:33:52.021426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:18418 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.335 [2024-07-22 20:33:52.021436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.335 [2024-07-22 20:33:52.033857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.335 [2024-07-22 20:33:52.033880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:13242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.335 [2024-07-22 20:33:52.033889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.335 [2024-07-22 20:33:52.041668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.335 [2024-07-22 20:33:52.041690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:8777 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.335 [2024-07-22 20:33:52.041699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.335 [2024-07-22 20:33:52.051772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.335 [2024-07-22 20:33:52.051795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:3073 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.051803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.063519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.063540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:197 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.063548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.071071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.071092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.071100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.081072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.081093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:10219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.081105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.089456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.089477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22391 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.089485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.099259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.099281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:24156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.099289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.109488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.109509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:17823 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.109517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.117442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.117463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:15041 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.117471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.125675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.125695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18515 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.125703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.134727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.134748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:192 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.134756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.143209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.143231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:24478 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.143240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.151824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.151845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.151853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.160894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.160914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:22672 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.160922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.168976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.168996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:4009 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.169004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.177597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.177617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:18349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.177625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.186679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.186699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:1844 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.186707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.194961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.194981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:4699 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.194989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.203581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.203602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:17532 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.203610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.212615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.212636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:20307 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.212644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.220979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.220999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.221007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.229422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.229443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21008 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.229455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.238565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.238586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:22612 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.238594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.246979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.246998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:15680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.247006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.255351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.255371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10460 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.255379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.336 [2024-07-22 20:33:52.264358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.336 [2024-07-22 20:33:52.264378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:7224 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.336 [2024-07-22 20:33:52.264386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.594 [2024-07-22 20:33:52.273062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.594 [2024-07-22 20:33:52.273088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3574 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.594 [2024-07-22 20:33:52.273097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.594 [2024-07-22 20:33:52.281633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.281658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:15195 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.281666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.290645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.290666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23882 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.290675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.299049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.299071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5008 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.299079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.307559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.307584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:13275 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.307593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.316591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.316611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12468 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.316620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.324945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.324966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.324975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.334062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.334082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:1796 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.334090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.342580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.342599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:15913 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.342608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.351005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.351025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.351033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.359643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.359664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:23844 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.359672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.368488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.368507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25518 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.368516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.377032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.377057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:15545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.377066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.385503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.385524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:7012 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.385532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.394609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.394629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:11201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.394638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.402958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.402979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:13020 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.402987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.411662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.411682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.411690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.420481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.420501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:22226 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.420509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.428915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.428934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:24427 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.428942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.437406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.437426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:18439 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.437433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.446472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.446491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:14441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.446499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 [2024-07-22 20:33:52.454772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb669c0) 00:28:20.595 [2024-07-22 20:33:52.454791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:12717 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.595 [2024-07-22 20:33:52.454802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:20.595 00:28:20.595 Latency(us) 00:28:20.595 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:20.595 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:28:20.595 nvme0n1 : 2.00 27286.46 106.59 0.00 0.00 4686.13 1766.62 18122.13 00:28:20.595 =================================================================================================================== 00:28:20.595 Total : 27286.46 106.59 0.00 0.00 4686.13 1766.62 18122.13 00:28:20.595 0 00:28:20.595 20:33:52 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:28:20.595 20:33:52 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:28:20.595 20:33:52 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:28:20.595 | .driver_specific 00:28:20.595 | .nvme_error 00:28:20.595 | .status_code 00:28:20.595 | .command_transient_transport_error' 00:28:20.595 20:33:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:28:20.854 20:33:52 -- host/digest.sh@71 -- # (( 214 > 0 )) 00:28:20.854 20:33:52 -- host/digest.sh@73 -- # killprocess 3571215 00:28:20.854 20:33:52 -- common/autotest_common.sh@926 -- # '[' -z 3571215 ']' 00:28:20.854 20:33:52 -- common/autotest_common.sh@930 -- # kill -0 3571215 00:28:20.854 20:33:52 -- common/autotest_common.sh@931 -- # uname 00:28:20.854 20:33:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:20.854 20:33:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3571215 00:28:20.854 20:33:52 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:20.854 20:33:52 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:20.854 20:33:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3571215' 00:28:20.854 killing process with pid 3571215 00:28:20.854 20:33:52 -- common/autotest_common.sh@945 -- # kill 3571215 00:28:20.854 Received shutdown signal, test time was about 2.000000 seconds 00:28:20.854 00:28:20.854 Latency(us) 00:28:20.854 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:20.854 =================================================================================================================== 00:28:20.854 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:20.854 20:33:52 -- common/autotest_common.sh@950 -- # wait 3571215 00:28:21.113 20:33:52 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:28:21.113 20:33:52 -- host/digest.sh@54 -- # local rw bs qd 00:28:21.113 20:33:52 -- host/digest.sh@56 -- # rw=randread 00:28:21.113 20:33:52 -- host/digest.sh@56 -- # bs=131072 00:28:21.113 20:33:52 -- host/digest.sh@56 -- # qd=16 00:28:21.113 20:33:52 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:28:21.113 20:33:52 -- host/digest.sh@58 -- # bperfpid=3571924 00:28:21.113 20:33:52 -- host/digest.sh@60 -- # waitforlisten 3571924 /var/tmp/bperf.sock 00:28:21.113 20:33:52 -- common/autotest_common.sh@819 -- # '[' -z 3571924 ']' 00:28:21.113 20:33:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:21.113 20:33:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:21.113 20:33:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:21.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:21.113 20:33:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:21.113 20:33:52 -- common/autotest_common.sh@10 -- # set +x 00:28:21.113 [2024-07-22 20:33:52.920715] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:21.113 [2024-07-22 20:33:52.920759] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3571924 ] 00:28:21.113 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:21.113 Zero copy mechanism will not be used. 00:28:21.113 EAL: No free 2048 kB hugepages reported on node 1 00:28:21.113 [2024-07-22 20:33:52.972401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:21.113 [2024-07-22 20:33:53.049637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:22.048 20:33:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:22.048 20:33:53 -- common/autotest_common.sh@852 -- # return 0 00:28:22.048 20:33:53 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:28:22.048 20:33:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:28:22.048 20:33:53 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:28:22.048 20:33:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:22.048 20:33:53 -- common/autotest_common.sh@10 -- # set +x 00:28:22.048 20:33:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:22.048 20:33:53 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:22.048 20:33:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:22.306 nvme0n1 00:28:22.306 20:33:54 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:28:22.306 20:33:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:22.306 20:33:54 -- common/autotest_common.sh@10 -- # set +x 00:28:22.306 20:33:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:22.306 20:33:54 -- host/digest.sh@69 -- # bperf_py perform_tests 00:28:22.306 20:33:54 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:22.564 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:22.564 Zero copy mechanism will not be used. 00:28:22.564 Running I/O for 2 seconds... 00:28:22.564 [2024-07-22 20:33:54.279957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.279989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.280000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.294801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.294827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.294837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.305614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.305635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.305643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.315479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.315499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.315507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.325302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.325329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.325338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.335020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.335041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.335055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.344777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.344797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.344805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.354521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.354541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.354549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.364223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.364244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.364252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.374066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.374087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.374095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.383720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.383739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.383747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.393489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.393509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.393517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.564 [2024-07-22 20:33:54.404472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.564 [2024-07-22 20:33:54.404492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.564 [2024-07-22 20:33:54.404500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.417241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.417261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.417268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.427034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.427060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.427069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.436900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.436920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.436928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.446655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.446674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.446682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.456385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.456405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.456413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.466115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.466136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.466143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.475839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.475859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.475867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.485616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.485636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.485643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.565 [2024-07-22 20:33:54.495376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.565 [2024-07-22 20:33:54.495399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.565 [2024-07-22 20:33:54.495407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.823 [2024-07-22 20:33:54.505287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.823 [2024-07-22 20:33:54.505310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.823 [2024-07-22 20:33:54.505320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.823 [2024-07-22 20:33:54.515129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.823 [2024-07-22 20:33:54.515149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.823 [2024-07-22 20:33:54.515158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.823 [2024-07-22 20:33:54.524824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.524845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.524853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.534548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.534569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.534577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.544340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.544361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.544369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.554078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.554098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.554106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.563820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.563840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.563848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.573606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.573626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.573635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.583502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.583521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.583529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.593216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.593236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.593245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.602981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.603000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.603008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.612829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.612849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.612856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.622573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.622593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.622601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.632341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.632361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.632369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.642153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.642173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.642181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.651911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.651931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.651938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.662007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.662026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.662037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.671761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.671780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.671788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.681481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.681501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.681508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.691343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.691363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.691371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.701037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.701063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.824 [2024-07-22 20:33:54.701071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.824 [2024-07-22 20:33:54.710932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.824 [2024-07-22 20:33:54.710952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.825 [2024-07-22 20:33:54.710960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.825 [2024-07-22 20:33:54.720624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.825 [2024-07-22 20:33:54.720644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.825 [2024-07-22 20:33:54.720652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:22.825 [2024-07-22 20:33:54.730387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.825 [2024-07-22 20:33:54.730407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.825 [2024-07-22 20:33:54.730415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:22.825 [2024-07-22 20:33:54.740227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.825 [2024-07-22 20:33:54.740247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.825 [2024-07-22 20:33:54.740255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:22.825 [2024-07-22 20:33:54.750023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.825 [2024-07-22 20:33:54.750051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.825 [2024-07-22 20:33:54.750060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:22.825 [2024-07-22 20:33:54.759732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:22.825 [2024-07-22 20:33:54.759756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:22.825 [2024-07-22 20:33:54.759765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.083 [2024-07-22 20:33:54.769604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.083 [2024-07-22 20:33:54.769627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.083 [2024-07-22 20:33:54.769636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.083 [2024-07-22 20:33:54.779317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.083 [2024-07-22 20:33:54.779338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.083 [2024-07-22 20:33:54.779347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.083 [2024-07-22 20:33:54.789163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.083 [2024-07-22 20:33:54.789183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.083 [2024-07-22 20:33:54.789191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.083 [2024-07-22 20:33:54.798938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.083 [2024-07-22 20:33:54.798958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.798966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.808723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.808743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.808752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.818451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.818471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.818479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.828200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.828220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.828231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.837984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.838005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.838014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.847942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.847963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.847971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.857619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.857641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.857649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.867269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.867289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.867297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.877065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.877086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.877094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.886876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.886897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.886905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.896666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.896687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.896695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.907383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.907405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.907415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.922280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.922305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.922313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.932163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.932184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.932192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.942539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.942564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.942573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.952958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.952980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.952987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.963940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.963962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.963971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.975547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.975569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.975578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.986948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.986971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.986980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:54.997933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:54.997958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:54.997967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.084 [2024-07-22 20:33:55.009502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.084 [2024-07-22 20:33:55.009523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.084 [2024-07-22 20:33:55.009532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.022095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.022119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.022130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.034135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.034159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.034168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.046031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.046059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.046068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.057055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.057077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.057086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.068630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.068651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.068659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.079249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.079270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.079279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.090674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.090696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.090705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.101784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.101805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.101813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.111879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.111900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.343 [2024-07-22 20:33:55.111912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.343 [2024-07-22 20:33:55.122022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.343 [2024-07-22 20:33:55.122048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.122057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.131922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.131941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.131948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.141927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.141947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.141955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.152151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.152171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.152179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.162146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.162166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.162174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.171994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.172014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.172022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.181919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.181939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.181947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.192017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.192039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.192054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.202058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.202078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.202087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.212095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.212115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.212123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.222166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.222186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.222194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.232021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.232041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.232057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.242140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.242160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.242168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.252201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.252223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.252231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.262369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.262389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.262398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.344 [2024-07-22 20:33:55.272432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.344 [2024-07-22 20:33:55.272452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.344 [2024-07-22 20:33:55.272461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.282600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.282623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.282636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.292865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.292889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.292898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.302745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.302765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.302773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.312678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.312698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.312707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.322480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.322501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.322509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.332230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.332251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.332259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.342197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.342218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.342226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.352033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.352061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.352069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.361843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.361863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.361871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.371637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.371660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.371669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.381502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.381522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.381531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.391262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.391282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.391290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.401184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.401204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.401212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.410884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.410904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.410913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.420604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.420623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.420632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.433914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.433933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.433941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.449632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.603 [2024-07-22 20:33:55.449653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.603 [2024-07-22 20:33:55.449661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.603 [2024-07-22 20:33:55.461413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.604 [2024-07-22 20:33:55.461433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.604 [2024-07-22 20:33:55.461442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.604 [2024-07-22 20:33:55.471333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.604 [2024-07-22 20:33:55.471353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.604 [2024-07-22 20:33:55.471360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.604 [2024-07-22 20:33:55.485422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.604 [2024-07-22 20:33:55.485445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.604 [2024-07-22 20:33:55.485453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.604 [2024-07-22 20:33:55.500079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.604 [2024-07-22 20:33:55.500098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.604 [2024-07-22 20:33:55.500106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.604 [2024-07-22 20:33:55.511529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.604 [2024-07-22 20:33:55.511549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.604 [2024-07-22 20:33:55.511557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.604 [2024-07-22 20:33:55.521440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.604 [2024-07-22 20:33:55.521459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.604 [2024-07-22 20:33:55.521467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.604 [2024-07-22 20:33:55.531491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.604 [2024-07-22 20:33:55.531510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.604 [2024-07-22 20:33:55.531518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.862 [2024-07-22 20:33:55.541617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.862 [2024-07-22 20:33:55.541641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.862 [2024-07-22 20:33:55.541650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.862 [2024-07-22 20:33:55.551495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.862 [2024-07-22 20:33:55.551518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.862 [2024-07-22 20:33:55.551527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.862 [2024-07-22 20:33:55.561619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.862 [2024-07-22 20:33:55.561639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.862 [2024-07-22 20:33:55.561651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.862 [2024-07-22 20:33:55.571657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.862 [2024-07-22 20:33:55.571676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.862 [2024-07-22 20:33:55.571684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.862 [2024-07-22 20:33:55.581707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.862 [2024-07-22 20:33:55.581727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.862 [2024-07-22 20:33:55.581736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.862 [2024-07-22 20:33:55.591659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.862 [2024-07-22 20:33:55.591679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.591687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.601923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.601942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.601950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.611919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.611939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.611947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.621949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.621970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.621978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.631990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.632010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.632018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.642089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.642109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.642117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.651941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.651961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.651969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.661735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.661755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.661763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.671664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.671684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.671691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.681962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.681982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.681990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.695846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.695866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.695873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.705777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.705796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.705804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.715924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.715943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.715951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.726065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.726084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.726092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.735929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.735950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.735961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.745998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.746017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.746026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.756036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.756062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.756070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.766084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.766103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.766112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.776064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.776084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.776092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.786204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.786223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.786232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:23.863 [2024-07-22 20:33:55.796407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:23.863 [2024-07-22 20:33:55.796442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:23.863 [2024-07-22 20:33:55.796452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.122 [2024-07-22 20:33:55.806434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.122 [2024-07-22 20:33:55.806458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.122 [2024-07-22 20:33:55.806468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.122 [2024-07-22 20:33:55.816365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.122 [2024-07-22 20:33:55.816385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.122 [2024-07-22 20:33:55.816393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.122 [2024-07-22 20:33:55.826510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.122 [2024-07-22 20:33:55.826533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.122 [2024-07-22 20:33:55.826542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:24.122 [2024-07-22 20:33:55.841523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.122 [2024-07-22 20:33:55.841543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.122 [2024-07-22 20:33:55.841550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.122 [2024-07-22 20:33:55.856745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.122 [2024-07-22 20:33:55.856766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.122 [2024-07-22 20:33:55.856774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.122 [2024-07-22 20:33:55.868708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.122 [2024-07-22 20:33:55.868728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.122 [2024-07-22 20:33:55.868736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.122 [2024-07-22 20:33:55.879512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.879532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.879539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.889592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.889611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.889619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.900340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.900360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.900368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.911385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.911404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.911412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.928121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.928141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.928149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.940915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.940936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.940944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.952478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.952497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.952505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.971933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.971953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.971961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.986238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.986258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.986266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:55.997379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:55.997398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:55.997406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:56.012256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:56.012276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:56.012285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:56.029159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:56.029180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:56.029188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:56.043701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:56.043722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:56.043730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:24.123 [2024-07-22 20:33:56.054154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.123 [2024-07-22 20:33:56.054174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.123 [2024-07-22 20:33:56.054186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.071879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.071903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.071913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.084713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.084733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.084742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.094797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.094817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.094825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.104791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.104810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.104819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.124543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.124563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.124571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.141624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.141645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.141653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.154398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.154419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.154427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.164796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.164816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.164823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.176088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.176109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.176117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.195695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.195715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.195723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.212747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.212767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.212775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.229394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.229414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.229422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.240299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.240319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.240326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:24.382 [2024-07-22 20:33:56.250228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f20820) 00:28:24.382 [2024-07-22 20:33:56.250247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:24.382 [2024-07-22 20:33:56.250256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:24.382 00:28:24.382 Latency(us) 00:28:24.382 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:24.382 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:28:24.382 nvme0n1 : 2.00 2824.39 353.05 0.00 0.00 5663.09 4758.48 22453.20 00:28:24.382 =================================================================================================================== 00:28:24.382 Total : 2824.39 353.05 0.00 0.00 5663.09 4758.48 22453.20 00:28:24.382 0 00:28:24.382 20:33:56 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:28:24.382 20:33:56 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:28:24.382 20:33:56 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:28:24.382 | .driver_specific 00:28:24.382 | .nvme_error 00:28:24.382 | .status_code 00:28:24.382 | .command_transient_transport_error' 00:28:24.382 20:33:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:28:24.642 20:33:56 -- host/digest.sh@71 -- # (( 182 > 0 )) 00:28:24.642 20:33:56 -- host/digest.sh@73 -- # killprocess 3571924 00:28:24.642 20:33:56 -- common/autotest_common.sh@926 -- # '[' -z 3571924 ']' 00:28:24.642 20:33:56 -- common/autotest_common.sh@930 -- # kill -0 3571924 00:28:24.642 20:33:56 -- common/autotest_common.sh@931 -- # uname 00:28:24.642 20:33:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:24.642 20:33:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3571924 00:28:24.642 20:33:56 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:24.642 20:33:56 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:24.642 20:33:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3571924' 00:28:24.642 killing process with pid 3571924 00:28:24.642 20:33:56 -- common/autotest_common.sh@945 -- # kill 3571924 00:28:24.642 Received shutdown signal, test time was about 2.000000 seconds 00:28:24.642 00:28:24.642 Latency(us) 00:28:24.642 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:24.642 =================================================================================================================== 00:28:24.642 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:24.642 20:33:56 -- common/autotest_common.sh@950 -- # wait 3571924 00:28:24.901 20:33:56 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:28:24.901 20:33:56 -- host/digest.sh@54 -- # local rw bs qd 00:28:24.901 20:33:56 -- host/digest.sh@56 -- # rw=randwrite 00:28:24.901 20:33:56 -- host/digest.sh@56 -- # bs=4096 00:28:24.901 20:33:56 -- host/digest.sh@56 -- # qd=128 00:28:24.901 20:33:56 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:28:24.901 20:33:56 -- host/digest.sh@58 -- # bperfpid=3572632 00:28:24.901 20:33:56 -- host/digest.sh@60 -- # waitforlisten 3572632 /var/tmp/bperf.sock 00:28:24.901 20:33:56 -- common/autotest_common.sh@819 -- # '[' -z 3572632 ']' 00:28:24.901 20:33:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:24.901 20:33:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:24.901 20:33:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:24.901 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:24.901 20:33:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:24.901 20:33:56 -- common/autotest_common.sh@10 -- # set +x 00:28:24.901 [2024-07-22 20:33:56.732750] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:24.901 [2024-07-22 20:33:56.732797] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3572632 ] 00:28:24.901 EAL: No free 2048 kB hugepages reported on node 1 00:28:24.901 [2024-07-22 20:33:56.784914] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:25.159 [2024-07-22 20:33:56.863255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:25.724 20:33:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:25.724 20:33:57 -- common/autotest_common.sh@852 -- # return 0 00:28:25.724 20:33:57 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:28:25.724 20:33:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:28:25.983 20:33:57 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:28:25.983 20:33:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.983 20:33:57 -- common/autotest_common.sh@10 -- # set +x 00:28:25.983 20:33:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.983 20:33:57 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:25.983 20:33:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:26.241 nvme0n1 00:28:26.241 20:33:57 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:28:26.241 20:33:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:26.241 20:33:57 -- common/autotest_common.sh@10 -- # set +x 00:28:26.241 20:33:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:26.241 20:33:57 -- host/digest.sh@69 -- # bperf_py perform_tests 00:28:26.241 20:33:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:26.241 Running I/O for 2 seconds... 00:28:26.241 [2024-07-22 20:33:58.069786] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fdeb0 00:28:26.241 [2024-07-22 20:33:58.070545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.241 [2024-07-22 20:33:58.070574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:28:26.241 [2024-07-22 20:33:58.079304] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.241 [2024-07-22 20:33:58.079511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:24147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.241 [2024-07-22 20:33:58.079533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.241 [2024-07-22 20:33:58.088638] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.088832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:21636 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.088850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.097900] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.098114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:16502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.098133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.107204] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.107422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:13861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.107442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.116495] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.116712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:17207 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.116730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.125773] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.125989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:19732 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.126007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.135283] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.135496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:13613 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.135516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.144583] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.144889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:24526 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.144908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.153868] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.154068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:12506 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.154086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.163123] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.163309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:8403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.163326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.242 [2024-07-22 20:33:58.172376] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.242 [2024-07-22 20:33:58.172564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:8085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.242 [2024-07-22 20:33:58.172581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.181849] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.182228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:7445 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.182252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.191140] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.191445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:25481 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.191465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.200379] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.200560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:16746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.200578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.209624] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.209816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:24726 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.209834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.218832] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.219371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:1789 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.219395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.228149] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.228379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:6215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.228398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.237526] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.237827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:12983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.237846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.246860] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.247063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:10437 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.247083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.256141] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.256350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:22458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.256369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.265391] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.265606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:7873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.265625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.274656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.274866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.274884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.283903] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.284119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:7787 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.284138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.293147] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.293356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:8366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.293374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.302407] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.302724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:11097 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.302742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.311619] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.311820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:7630 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.311838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.320883] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.321076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:13183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.321094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.330313] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.330522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:111 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.330541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.339584] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.339792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:7452 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.501 [2024-07-22 20:33:58.339811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.501 [2024-07-22 20:33:58.348864] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.501 [2024-07-22 20:33:58.349272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:22590 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.349291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.358143] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.358365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.358384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.367513] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.367711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:2239 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.367729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.376815] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.377255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:24523 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.377274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.386081] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.386525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:10418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.386544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.395369] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.395571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:22081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.395590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.404750] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.405036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:4241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.405060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.413995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.414377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:6613 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.414397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.423250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.423510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:14324 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.423528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.502 [2024-07-22 20:33:58.432479] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.502 [2024-07-22 20:33:58.432868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:7246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.502 [2024-07-22 20:33:58.432886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.441982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.442466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:2569 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.442489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.451316] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.451862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:22106 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.451882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.460560] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.460824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:15616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.460847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.469814] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.469997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18053 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.470014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.479071] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.479686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:7291 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.479705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.488311] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.488681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:17193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.488700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.497600] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.497807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:6914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.497825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.506879] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.507235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:21331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.507254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.516151] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.516376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.516395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.525429] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.525647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:7873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.525666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.534692] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.534897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:16212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.534918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.544005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.544223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:12490 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.544242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.553322] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.553538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:1931 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.553557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.562590] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.562807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:5713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.562826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.571903] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.572123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:23426 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.572141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.581290] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.581512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:17076 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.581530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.590540] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.590756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:17087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.590774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.599819] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.600032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:9147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.600053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.609048] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.609258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:6985 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.761 [2024-07-22 20:33:58.609277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.761 [2024-07-22 20:33:58.618262] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.761 [2024-07-22 20:33:58.618483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:7306 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.618501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.762 [2024-07-22 20:33:58.627479] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.762 [2024-07-22 20:33:58.627691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:11292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.627709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.762 [2024-07-22 20:33:58.636677] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.762 [2024-07-22 20:33:58.636891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:18317 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.636910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.762 [2024-07-22 20:33:58.645911] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.762 [2024-07-22 20:33:58.646129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:4755 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.646147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.762 [2024-07-22 20:33:58.655184] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.762 [2024-07-22 20:33:58.655398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:7023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.655416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.762 [2024-07-22 20:33:58.664390] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.762 [2024-07-22 20:33:58.664603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:3810 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.664621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.762 [2024-07-22 20:33:58.673603] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.762 [2024-07-22 20:33:58.673813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.673831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.762 [2024-07-22 20:33:58.682804] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.762 [2024-07-22 20:33:58.683014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:9084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.683032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:26.762 [2024-07-22 20:33:58.692022] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:26.762 [2024-07-22 20:33:58.692238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:6208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:26.762 [2024-07-22 20:33:58.692257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.701509] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.701724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:15240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.701750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.710769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.710981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.711002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.719982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.720196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:2127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.720216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.729194] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.729408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:8576 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.729427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.738381] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.738593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:19888 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.738613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.747622] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.747842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:17757 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.747860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.756878] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.757097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:14729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.757115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.766089] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.766306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:11626 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.766324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.775314] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.775526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:17966 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.775545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.784503] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.784719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:5162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.784738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.793718] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.793935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:8147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.793953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.802928] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.803148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:2018 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.803166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.812144] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.812360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:17668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.812378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.821347] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.821562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:11901 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.821580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.830540] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.830757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:12812 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.830775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.839917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.840133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:21634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.840151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.849153] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.849378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:7016 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.849397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.858354] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.858569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.858587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.867558] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.867770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:16188 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.867788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.021 [2024-07-22 20:33:58.876748] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.021 [2024-07-22 20:33:58.876962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:22673 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.021 [2024-07-22 20:33:58.876980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.022 [2024-07-22 20:33:58.885971] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.022 [2024-07-22 20:33:58.886185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:14779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.022 [2024-07-22 20:33:58.886203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.022 [2024-07-22 20:33:58.895196] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.022 [2024-07-22 20:33:58.895410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:12576 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.022 [2024-07-22 20:33:58.895428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.022 [2024-07-22 20:33:58.904386] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.022 [2024-07-22 20:33:58.904600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:18592 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.022 [2024-07-22 20:33:58.904619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.022 [2024-07-22 20:33:58.913665] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.022 [2024-07-22 20:33:58.913878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:10502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.022 [2024-07-22 20:33:58.913896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.022 [2024-07-22 20:33:58.922873] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.022 [2024-07-22 20:33:58.923091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:11666 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.022 [2024-07-22 20:33:58.923109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.022 [2024-07-22 20:33:58.932062] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.022 [2024-07-22 20:33:58.932277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:3809 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.022 [2024-07-22 20:33:58.932295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.022 [2024-07-22 20:33:58.941311] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.022 [2024-07-22 20:33:58.941525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:7075 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.022 [2024-07-22 20:33:58.941546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.022 [2024-07-22 20:33:58.950515] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.022 [2024-07-22 20:33:58.950727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:13449 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.022 [2024-07-22 20:33:58.950746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:58.959952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:58.960175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:15281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:58.960199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:58.969284] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:58.969492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:6916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:58.969514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:58.978548] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:58.978756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:18401 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:58.978775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:58.987746] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:58.987957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:24945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:58.987976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:58.996934] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:58.997148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:17930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:58.997167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.006190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.006402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25339 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.006421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.015384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.015604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:1318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.015622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.024579] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.024791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:14278 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.024813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.033786] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.034007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:19906 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.034025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.043008] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.043224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:17636 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.043244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.052398] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.052617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:15725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.052636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.061605] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.061821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:17215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.061839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.070865] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.071090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:10538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.071107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.080109] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.080324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:4495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.080343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.089308] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.089525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:2784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.089542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.098656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.098870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:18756 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.098887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.107863] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.108082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:10696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.108101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.117071] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.117286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18045 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.117305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.281 [2024-07-22 20:33:59.126282] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.281 [2024-07-22 20:33:59.126498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:12766 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.281 [2024-07-22 20:33:59.126516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.135537] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.135745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:3822 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.135763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.144923] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.145134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:6735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.145152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.154153] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.154363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:5083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.154382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.163361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.163574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:9967 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.163594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.172615] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.172829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:20224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.172849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.181819] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.182031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:9378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.182058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.191019] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.191241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:23177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.191261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.200370] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.200588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:15568 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.200607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.282 [2024-07-22 20:33:59.209883] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.282 [2024-07-22 20:33:59.210096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:23541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.282 [2024-07-22 20:33:59.210114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.219425] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.219631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:13269 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.219654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.228733] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.228935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:25111 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.228957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.237958] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.238175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:23150 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.238195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.247178] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.247391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:11765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.247410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.256383] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.256596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:7723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.256615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.265607] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.265820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:3781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.265842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.275015] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.275243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:16609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.275263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.284536] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.284750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:3286 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.284769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.293950] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.294157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:19223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.294175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.303242] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.303451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:17282 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.303470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.312460] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.312676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:1399 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.312694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.321685] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.321899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:23072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.321918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.330893] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.331113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:17726 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.331132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.340135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.340350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:3053 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.340369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.349603] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.349823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:24491 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.349843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.359114] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.359332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:3849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.359351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.368864] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.369097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:13426 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.369115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.379089] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.379314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:25175 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.379333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.388985] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.389212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:15145 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.389231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.398951] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.399177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:9851 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.399204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.408671] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.408888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:10168 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.408908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.418231] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.418450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:11711 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.418469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.427865] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.428079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:25035 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.428097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.437144] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.541 [2024-07-22 20:33:59.437395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:19211 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.541 [2024-07-22 20:33:59.437415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.541 [2024-07-22 20:33:59.446359] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.542 [2024-07-22 20:33:59.446563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.542 [2024-07-22 20:33:59.446582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.542 [2024-07-22 20:33:59.455573] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.542 [2024-07-22 20:33:59.455781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:19410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.542 [2024-07-22 20:33:59.455800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.542 [2024-07-22 20:33:59.464795] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.542 [2024-07-22 20:33:59.465005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:7582 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.542 [2024-07-22 20:33:59.465023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.542 [2024-07-22 20:33:59.474035] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.542 [2024-07-22 20:33:59.474265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:7427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.542 [2024-07-22 20:33:59.474286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.800 [2024-07-22 20:33:59.483605] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.800 [2024-07-22 20:33:59.483814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:22132 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.483837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.492810] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.493032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:6900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.493057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.502035] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.502256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:6876 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.502275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.511256] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.511464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:17496 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.511487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.520493] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.520702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:18914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.520721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.529701] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.529907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:21552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.529925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.538983] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.539188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.539208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.548302] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.548507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:16053 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.548525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.557697] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.557904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:22864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.557923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.567173] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.567381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:329 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.567399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.576639] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.576855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:11644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.576874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.586133] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.586358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:14702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.586378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.595588] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.595811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:13743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.595829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.604985] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.605208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:23212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.605227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.614265] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.614482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:4163 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.614500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.623470] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.623683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:2955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.623701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.632697] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.632911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:8997 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.632930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.641896] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.642110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18810 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.642129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.651111] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.651318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:13125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.651337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.660285] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.660493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:9157 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.660511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.669489] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.669697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:16133 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.669715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.678698] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.678906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:20866 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.678924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.687898] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.688110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:10156 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.688127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.697127] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.697335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:19075 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.697354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.706348] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.706557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:10706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.706575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.715557] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.715767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.715786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.724703] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.724913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:7379 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.801 [2024-07-22 20:33:59.724932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:27.801 [2024-07-22 20:33:59.733923] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:27.801 [2024-07-22 20:33:59.734145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:5084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:27.802 [2024-07-22 20:33:59.734167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.743459] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.743674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:23871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.743697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.752694] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.752908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:23023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.752931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.761888] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.762104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:17992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.762123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.771129] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.771508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:5528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.771527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.780377] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.780789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:20017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.780808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.789646] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.789868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:19810 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.789886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.798927] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.799305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:14788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.799324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.808144] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.808420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:6446 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.808439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.817418] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.817650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:3770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.817669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.826649] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.827029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:14381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.827053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.835955] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.836175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:8500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.836193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.845174] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.845479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:20934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.845497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.854414] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.854947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23583 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.854966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.863790] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.864084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24976 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.864104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.873071] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.873275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:7346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.873294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.882310] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.882511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:12856 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.882529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.891550] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.892014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:19666 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.892032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.900818] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.901182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.901201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.909995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fc128 00:28:28.061 [2024-07-22 20:33:59.911131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:17546 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.911149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.920403] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fda78 00:28:28.061 [2024-07-22 20:33:59.921769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:5899 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.921788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:28:28.061 [2024-07-22 20:33:59.928999] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fda78 00:28:28.061 [2024-07-22 20:33:59.930000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:4728 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.061 [2024-07-22 20:33:59.930018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:28:28.062 [2024-07-22 20:33:59.938878] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fd208 00:28:28.062 [2024-07-22 20:33:59.939692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:21642 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.062 [2024-07-22 20:33:59.939711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:28:28.062 [2024-07-22 20:33:59.946725] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190f4298 00:28:28.062 [2024-07-22 20:33:59.947831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:825 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.062 [2024-07-22 20:33:59.947849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:28:28.062 [2024-07-22 20:33:59.955459] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190e7818 00:28:28.062 [2024-07-22 20:33:59.956138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.062 [2024-07-22 20:33:59.956156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:28:28.062 [2024-07-22 20:33:59.964230] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190e7c50 00:28:28.062 [2024-07-22 20:33:59.965812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:11235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.062 [2024-07-22 20:33:59.965830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:28:28.062 [2024-07-22 20:33:59.975343] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190eea00 00:28:28.062 [2024-07-22 20:33:59.976041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:2577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.062 [2024-07-22 20:33:59.976064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:28:28.062 [2024-07-22 20:33:59.984711] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190eb328 00:28:28.062 [2024-07-22 20:33:59.985815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:8042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.062 [2024-07-22 20:33:59.985834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:28:28.062 [2024-07-22 20:33:59.993601] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190e2c28 00:28:28.062 [2024-07-22 20:33:59.994978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:11359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.062 [2024-07-22 20:33:59.995001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:28:28.320 [2024-07-22 20:34:00.002970] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190e6b70 00:28:28.320 [2024-07-22 20:34:00.004144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.320 [2024-07-22 20:34:00.004167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:28:28.320 [2024-07-22 20:34:00.012993] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190f7100 00:28:28.320 [2024-07-22 20:34:00.014078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:6668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.320 [2024-07-22 20:34:00.014098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:28:28.320 [2024-07-22 20:34:00.020593] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190f2510 00:28:28.320 [2024-07-22 20:34:00.021468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:20983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.320 [2024-07-22 20:34:00.021488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:28:28.320 [2024-07-22 20:34:00.029952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190e9168 00:28:28.320 [2024-07-22 20:34:00.030502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.320 [2024-07-22 20:34:00.030522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:28:28.320 [2024-07-22 20:34:00.039583] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190fda78 00:28:28.321 [2024-07-22 20:34:00.040340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:11080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.321 [2024-07-22 20:34:00.040361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:28:28.321 [2024-07-22 20:34:00.049001] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f2a0) with pdu=0x2000190e99d8 00:28:28.321 [2024-07-22 20:34:00.049754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:7469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:28.321 [2024-07-22 20:34:00.049773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:28:28.321 00:28:28.321 Latency(us) 00:28:28.321 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:28.321 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:28:28.321 nvme0n1 : 2.00 27239.19 106.40 0.00 0.00 4693.40 1909.09 22567.18 00:28:28.321 =================================================================================================================== 00:28:28.321 Total : 27239.19 106.40 0.00 0.00 4693.40 1909.09 22567.18 00:28:28.321 0 00:28:28.321 20:34:00 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:28:28.321 20:34:00 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:28:28.321 20:34:00 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:28:28.321 | .driver_specific 00:28:28.321 | .nvme_error 00:28:28.321 | .status_code 00:28:28.321 | .command_transient_transport_error' 00:28:28.321 20:34:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:28:28.321 20:34:00 -- host/digest.sh@71 -- # (( 214 > 0 )) 00:28:28.321 20:34:00 -- host/digest.sh@73 -- # killprocess 3572632 00:28:28.321 20:34:00 -- common/autotest_common.sh@926 -- # '[' -z 3572632 ']' 00:28:28.321 20:34:00 -- common/autotest_common.sh@930 -- # kill -0 3572632 00:28:28.321 20:34:00 -- common/autotest_common.sh@931 -- # uname 00:28:28.321 20:34:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:28.321 20:34:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3572632 00:28:28.579 20:34:00 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:28.579 20:34:00 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:28.579 20:34:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3572632' 00:28:28.579 killing process with pid 3572632 00:28:28.579 20:34:00 -- common/autotest_common.sh@945 -- # kill 3572632 00:28:28.579 Received shutdown signal, test time was about 2.000000 seconds 00:28:28.579 00:28:28.579 Latency(us) 00:28:28.579 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:28.579 =================================================================================================================== 00:28:28.579 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:28.579 20:34:00 -- common/autotest_common.sh@950 -- # wait 3572632 00:28:28.579 20:34:00 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:28:28.579 20:34:00 -- host/digest.sh@54 -- # local rw bs qd 00:28:28.579 20:34:00 -- host/digest.sh@56 -- # rw=randwrite 00:28:28.579 20:34:00 -- host/digest.sh@56 -- # bs=131072 00:28:28.579 20:34:00 -- host/digest.sh@56 -- # qd=16 00:28:28.579 20:34:00 -- host/digest.sh@58 -- # bperfpid=3573122 00:28:28.579 20:34:00 -- host/digest.sh@60 -- # waitforlisten 3573122 /var/tmp/bperf.sock 00:28:28.579 20:34:00 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:28:28.579 20:34:00 -- common/autotest_common.sh@819 -- # '[' -z 3573122 ']' 00:28:28.579 20:34:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:28.579 20:34:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:28.579 20:34:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:28.579 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:28.579 20:34:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:28.579 20:34:00 -- common/autotest_common.sh@10 -- # set +x 00:28:28.839 [2024-07-22 20:34:00.526394] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:28.839 [2024-07-22 20:34:00.526438] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3573122 ] 00:28:28.839 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:28.839 Zero copy mechanism will not be used. 00:28:28.839 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.839 [2024-07-22 20:34:00.580471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:28.839 [2024-07-22 20:34:00.653433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:29.405 20:34:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:29.405 20:34:01 -- common/autotest_common.sh@852 -- # return 0 00:28:29.405 20:34:01 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:28:29.405 20:34:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:28:29.663 20:34:01 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:28:29.663 20:34:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:29.663 20:34:01 -- common/autotest_common.sh@10 -- # set +x 00:28:29.663 20:34:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:29.663 20:34:01 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:29.663 20:34:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:29.921 nvme0n1 00:28:29.921 20:34:01 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:28:29.921 20:34:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:29.921 20:34:01 -- common/autotest_common.sh@10 -- # set +x 00:28:29.921 20:34:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:29.921 20:34:01 -- host/digest.sh@69 -- # bperf_py perform_tests 00:28:29.921 20:34:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:30.190 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:30.190 Zero copy mechanism will not be used. 00:28:30.190 Running I/O for 2 seconds... 00:28:30.190 [2024-07-22 20:34:01.957701] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.190 [2024-07-22 20:34:01.958506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.190 [2024-07-22 20:34:01.958536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.190 [2024-07-22 20:34:01.971800] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.190 [2024-07-22 20:34:01.972203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.190 [2024-07-22 20:34:01.972225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.190 [2024-07-22 20:34:01.983496] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.190 [2024-07-22 20:34:01.983857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.190 [2024-07-22 20:34:01.983877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.190 [2024-07-22 20:34:01.996779] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.190 [2024-07-22 20:34:01.997145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.190 [2024-07-22 20:34:01.997167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.190 [2024-07-22 20:34:02.009762] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.190 [2024-07-22 20:34:02.010058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.190 [2024-07-22 20:34:02.010078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.190 [2024-07-22 20:34:02.024063] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.190 [2024-07-22 20:34:02.024223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.191 [2024-07-22 20:34:02.024242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.191 [2024-07-22 20:34:02.039274] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.191 [2024-07-22 20:34:02.039512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.191 [2024-07-22 20:34:02.039532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.191 [2024-07-22 20:34:02.053840] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.191 [2024-07-22 20:34:02.054577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.191 [2024-07-22 20:34:02.054598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.191 [2024-07-22 20:34:02.068547] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.191 [2024-07-22 20:34:02.068948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.191 [2024-07-22 20:34:02.068967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.191 [2024-07-22 20:34:02.082568] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.191 [2024-07-22 20:34:02.082985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.191 [2024-07-22 20:34:02.083004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.191 [2024-07-22 20:34:02.095463] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.191 [2024-07-22 20:34:02.095730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.191 [2024-07-22 20:34:02.095748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.191 [2024-07-22 20:34:02.107370] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.191 [2024-07-22 20:34:02.107750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.191 [2024-07-22 20:34:02.107769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.191 [2024-07-22 20:34:02.119849] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.191 [2024-07-22 20:34:02.120214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.191 [2024-07-22 20:34:02.120236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.464 [2024-07-22 20:34:02.133141] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.464 [2024-07-22 20:34:02.133692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.464 [2024-07-22 20:34:02.133715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.464 [2024-07-22 20:34:02.146410] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.464 [2024-07-22 20:34:02.146720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.464 [2024-07-22 20:34:02.146741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.464 [2024-07-22 20:34:02.160529] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.464 [2024-07-22 20:34:02.161018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.464 [2024-07-22 20:34:02.161047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.464 [2024-07-22 20:34:02.175070] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.464 [2024-07-22 20:34:02.175505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.464 [2024-07-22 20:34:02.175524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.464 [2024-07-22 20:34:02.190196] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.464 [2024-07-22 20:34:02.190593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.464 [2024-07-22 20:34:02.190611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.464 [2024-07-22 20:34:02.204077] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.464 [2024-07-22 20:34:02.204499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.464 [2024-07-22 20:34:02.204519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.464 [2024-07-22 20:34:02.218082] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.218365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.218384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.231483] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.231817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.231837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.246426] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.246806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.246825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.260889] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.261087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.261106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.274449] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.274833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.274852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.288349] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.288916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.288935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.302328] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.302630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.302649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.317490] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.317911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.317930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.332383] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.332724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.332743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.347893] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.348282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.348301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.362057] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.362564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.362582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.377352] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.377830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.377850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.465 [2024-07-22 20:34:02.392424] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.465 [2024-07-22 20:34:02.392848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.465 [2024-07-22 20:34:02.392866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.406036] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.406469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.406493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.419600] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.420221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.420241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.433932] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.434298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.434317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.448456] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.448813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.448832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.462537] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.462885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.462903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.477020] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.477436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.477454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.491652] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.491999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.492017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.505337] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.505897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.505916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.518141] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.518451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.518471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.532441] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.532790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.532812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.545528] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.545720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.545739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.559937] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.560309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.560328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.574015] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.574404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.574423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.587687] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.588056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.588074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.602005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.602529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.725 [2024-07-22 20:34:02.602548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.725 [2024-07-22 20:34:02.616894] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.725 [2024-07-22 20:34:02.617271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.726 [2024-07-22 20:34:02.617289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.726 [2024-07-22 20:34:02.631494] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.726 [2024-07-22 20:34:02.631921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.726 [2024-07-22 20:34:02.631941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.726 [2024-07-22 20:34:02.646562] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.726 [2024-07-22 20:34:02.646896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.726 [2024-07-22 20:34:02.646914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.726 [2024-07-22 20:34:02.661105] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.726 [2024-07-22 20:34:02.661435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.726 [2024-07-22 20:34:02.661457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.674642] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.674958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.674980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.689243] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.689456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.689476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.702960] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.703244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.703263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.716853] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.717219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.717239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.731879] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.732282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.732301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.745158] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.745564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.745584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.758384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.758693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.758712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.772058] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.772463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.772481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.786431] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.786779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.786798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.800670] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.801028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.801051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.813419] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.813777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.813795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.827521] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.827873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.827891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.841391] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.841877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.985 [2024-07-22 20:34:02.841896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.985 [2024-07-22 20:34:02.855378] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.985 [2024-07-22 20:34:02.855658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.986 [2024-07-22 20:34:02.855677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:30.986 [2024-07-22 20:34:02.869354] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.986 [2024-07-22 20:34:02.869670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.986 [2024-07-22 20:34:02.869688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:30.986 [2024-07-22 20:34:02.882919] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.986 [2024-07-22 20:34:02.883303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.986 [2024-07-22 20:34:02.883322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:30.986 [2024-07-22 20:34:02.896365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.986 [2024-07-22 20:34:02.896688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.986 [2024-07-22 20:34:02.896712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:30.986 [2024-07-22 20:34:02.911053] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:30.986 [2024-07-22 20:34:02.911514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:30.986 [2024-07-22 20:34:02.911533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:02.925278] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:02.925622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:02.925645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:02.939276] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:02.939650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:02.939671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:02.953397] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:02.953918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:02.953937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:02.967678] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:02.968145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:02.968163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:02.981999] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:02.982341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:02.982360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:02.995593] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:02.995976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:02.995995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.010538] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.010998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.011017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.024423] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.024750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.024769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.037699] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.038154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.038174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.050395] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.050707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.050727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.062786] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.063268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.063287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.077490] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.077955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.077975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.090717] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.090957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.090975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.104587] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.104835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.104854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.245 [2024-07-22 20:34:03.117763] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.245 [2024-07-22 20:34:03.118087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.245 [2024-07-22 20:34:03.118106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.246 [2024-07-22 20:34:03.130913] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.246 [2024-07-22 20:34:03.131376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.246 [2024-07-22 20:34:03.131395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.246 [2024-07-22 20:34:03.144029] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.246 [2024-07-22 20:34:03.144438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.246 [2024-07-22 20:34:03.144457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.246 [2024-07-22 20:34:03.157332] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.246 [2024-07-22 20:34:03.157732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.246 [2024-07-22 20:34:03.157751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.246 [2024-07-22 20:34:03.170906] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.246 [2024-07-22 20:34:03.171300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.246 [2024-07-22 20:34:03.171319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.184062] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.184409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.184431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.198182] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.198332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.198353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.212178] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.212470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.212489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.225874] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.226220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.226240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.239525] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.239954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.239973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.253564] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.253966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.253989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.267566] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.267900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.267919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.281528] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.282012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.282031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.295634] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.296088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.296107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.308753] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.309073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.309092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.322361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.322730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.322749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.336558] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.336849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.336869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.350618] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.505 [2024-07-22 20:34:03.351022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.505 [2024-07-22 20:34:03.351040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.505 [2024-07-22 20:34:03.364966] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.506 [2024-07-22 20:34:03.365332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.506 [2024-07-22 20:34:03.365350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.506 [2024-07-22 20:34:03.378375] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.506 [2024-07-22 20:34:03.378776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.506 [2024-07-22 20:34:03.378794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.506 [2024-07-22 20:34:03.392751] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.506 [2024-07-22 20:34:03.393302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.506 [2024-07-22 20:34:03.393320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.506 [2024-07-22 20:34:03.406410] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.506 [2024-07-22 20:34:03.406759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.506 [2024-07-22 20:34:03.406778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.506 [2024-07-22 20:34:03.418081] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.506 [2024-07-22 20:34:03.418508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.506 [2024-07-22 20:34:03.418527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.506 [2024-07-22 20:34:03.431101] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.506 [2024-07-22 20:34:03.431524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.506 [2024-07-22 20:34:03.431543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.775 [2024-07-22 20:34:03.444257] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.775 [2024-07-22 20:34:03.444829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.775 [2024-07-22 20:34:03.444852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.775 [2024-07-22 20:34:03.457493] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.775 [2024-07-22 20:34:03.457814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.775 [2024-07-22 20:34:03.457835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.775 [2024-07-22 20:34:03.470153] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.775 [2024-07-22 20:34:03.470601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.775 [2024-07-22 20:34:03.470622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.775 [2024-07-22 20:34:03.482721] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.483024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.483049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.495250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.495515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.495533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.509664] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.509971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.509991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.523601] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.523949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.523968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.537716] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.538155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.538174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.552519] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.552901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.552920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.568029] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.568487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.568506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.582244] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.582681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.582699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.596988] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.597468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.597486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.611227] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.611644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.611667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.625320] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.625706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.625725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.639580] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.639911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.639930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.654553] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.654804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.654825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.667522] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.667921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.667941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.682424] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.682726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.682744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.695598] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.695941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.695961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:31.776 [2024-07-22 20:34:03.708493] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:31.776 [2024-07-22 20:34:03.708738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:31.776 [2024-07-22 20:34:03.708757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.721875] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.722361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.722384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.735472] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.735918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.735938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.748093] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.748652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.748672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.762614] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.763037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.763062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.777252] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.777564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.777584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.791771] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.792195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.792214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.805629] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.805923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.805941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.819243] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.819608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.819627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.833303] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.833624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.035 [2024-07-22 20:34:03.833644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:32.035 [2024-07-22 20:34:03.847008] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.035 [2024-07-22 20:34:03.847348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.036 [2024-07-22 20:34:03.847367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:32.036 [2024-07-22 20:34:03.861337] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.036 [2024-07-22 20:34:03.861509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.036 [2024-07-22 20:34:03.861528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:32.036 [2024-07-22 20:34:03.874385] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.036 [2024-07-22 20:34:03.874895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.036 [2024-07-22 20:34:03.874914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:32.036 [2024-07-22 20:34:03.887920] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.036 [2024-07-22 20:34:03.888380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.036 [2024-07-22 20:34:03.888399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:28:32.036 [2024-07-22 20:34:03.902151] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.036 [2024-07-22 20:34:03.902554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.036 [2024-07-22 20:34:03.902572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:28:32.036 [2024-07-22 20:34:03.915117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.036 [2024-07-22 20:34:03.915518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.036 [2024-07-22 20:34:03.915536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:28:32.036 [2024-07-22 20:34:03.929422] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68f440) with pdu=0x2000190fef90 00:28:32.036 [2024-07-22 20:34:03.929782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:32.036 [2024-07-22 20:34:03.929800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:28:32.036 00:28:32.036 Latency(us) 00:28:32.036 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:32.036 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:28:32.036 nvme0n1 : 2.01 2215.84 276.98 0.00 0.00 7206.51 4473.54 21883.33 00:28:32.036 =================================================================================================================== 00:28:32.036 Total : 2215.84 276.98 0.00 0.00 7206.51 4473.54 21883.33 00:28:32.036 0 00:28:32.036 20:34:03 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:28:32.036 20:34:03 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:28:32.036 20:34:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:28:32.036 20:34:03 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:28:32.036 | .driver_specific 00:28:32.036 | .nvme_error 00:28:32.036 | .status_code 00:28:32.036 | .command_transient_transport_error' 00:28:32.295 20:34:04 -- host/digest.sh@71 -- # (( 143 > 0 )) 00:28:32.295 20:34:04 -- host/digest.sh@73 -- # killprocess 3573122 00:28:32.295 20:34:04 -- common/autotest_common.sh@926 -- # '[' -z 3573122 ']' 00:28:32.295 20:34:04 -- common/autotest_common.sh@930 -- # kill -0 3573122 00:28:32.295 20:34:04 -- common/autotest_common.sh@931 -- # uname 00:28:32.295 20:34:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:32.295 20:34:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3573122 00:28:32.295 20:34:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:32.295 20:34:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:32.295 20:34:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3573122' 00:28:32.295 killing process with pid 3573122 00:28:32.295 20:34:04 -- common/autotest_common.sh@945 -- # kill 3573122 00:28:32.295 Received shutdown signal, test time was about 2.000000 seconds 00:28:32.295 00:28:32.295 Latency(us) 00:28:32.295 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:32.295 =================================================================================================================== 00:28:32.295 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:32.295 20:34:04 -- common/autotest_common.sh@950 -- # wait 3573122 00:28:32.554 20:34:04 -- host/digest.sh@115 -- # killprocess 3571153 00:28:32.554 20:34:04 -- common/autotest_common.sh@926 -- # '[' -z 3571153 ']' 00:28:32.554 20:34:04 -- common/autotest_common.sh@930 -- # kill -0 3571153 00:28:32.554 20:34:04 -- common/autotest_common.sh@931 -- # uname 00:28:32.554 20:34:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:32.554 20:34:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3571153 00:28:32.554 20:34:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:32.554 20:34:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:32.554 20:34:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3571153' 00:28:32.554 killing process with pid 3571153 00:28:32.554 20:34:04 -- common/autotest_common.sh@945 -- # kill 3571153 00:28:32.554 20:34:04 -- common/autotest_common.sh@950 -- # wait 3571153 00:28:32.813 00:28:32.813 real 0m16.568s 00:28:32.813 user 0m32.302s 00:28:32.813 sys 0m3.675s 00:28:32.813 20:34:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:32.813 20:34:04 -- common/autotest_common.sh@10 -- # set +x 00:28:32.813 ************************************ 00:28:32.813 END TEST nvmf_digest_error 00:28:32.813 ************************************ 00:28:32.813 20:34:04 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:28:32.813 20:34:04 -- host/digest.sh@139 -- # nvmftestfini 00:28:32.813 20:34:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:32.813 20:34:04 -- nvmf/common.sh@116 -- # sync 00:28:32.813 20:34:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:32.813 20:34:04 -- nvmf/common.sh@119 -- # set +e 00:28:32.813 20:34:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:32.813 20:34:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:32.813 rmmod nvme_tcp 00:28:32.813 rmmod nvme_fabrics 00:28:32.813 rmmod nvme_keyring 00:28:32.813 20:34:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:32.813 20:34:04 -- nvmf/common.sh@123 -- # set -e 00:28:32.813 20:34:04 -- nvmf/common.sh@124 -- # return 0 00:28:32.813 20:34:04 -- nvmf/common.sh@477 -- # '[' -n 3571153 ']' 00:28:32.813 20:34:04 -- nvmf/common.sh@478 -- # killprocess 3571153 00:28:32.813 20:34:04 -- common/autotest_common.sh@926 -- # '[' -z 3571153 ']' 00:28:32.813 20:34:04 -- common/autotest_common.sh@930 -- # kill -0 3571153 00:28:32.813 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3571153) - No such process 00:28:32.813 20:34:04 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3571153 is not found' 00:28:32.813 Process with pid 3571153 is not found 00:28:32.813 20:34:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:32.813 20:34:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:32.813 20:34:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:32.813 20:34:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:32.813 20:34:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:32.813 20:34:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:32.813 20:34:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:32.813 20:34:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:35.348 20:34:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:35.348 00:28:35.348 real 0m41.210s 00:28:35.348 user 1m7.189s 00:28:35.348 sys 0m11.418s 00:28:35.348 20:34:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:35.348 20:34:06 -- common/autotest_common.sh@10 -- # set +x 00:28:35.348 ************************************ 00:28:35.348 END TEST nvmf_digest 00:28:35.348 ************************************ 00:28:35.348 20:34:06 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:28:35.348 20:34:06 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:28:35.348 20:34:06 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:28:35.348 20:34:06 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:28:35.348 20:34:06 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:35.348 20:34:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:35.348 20:34:06 -- common/autotest_common.sh@10 -- # set +x 00:28:35.348 ************************************ 00:28:35.348 START TEST nvmf_bdevperf 00:28:35.348 ************************************ 00:28:35.348 20:34:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:28:35.348 * Looking for test storage... 00:28:35.348 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:35.348 20:34:06 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:35.348 20:34:06 -- nvmf/common.sh@7 -- # uname -s 00:28:35.348 20:34:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:35.348 20:34:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:35.348 20:34:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:35.348 20:34:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:35.348 20:34:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:35.348 20:34:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:35.348 20:34:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:35.348 20:34:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:35.348 20:34:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:35.348 20:34:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:35.348 20:34:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:28:35.348 20:34:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:28:35.348 20:34:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:35.348 20:34:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:35.348 20:34:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:35.348 20:34:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:35.348 20:34:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:35.348 20:34:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:35.348 20:34:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:35.348 20:34:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:35.348 20:34:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:35.348 20:34:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:35.348 20:34:06 -- paths/export.sh@5 -- # export PATH 00:28:35.348 20:34:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:35.348 20:34:06 -- nvmf/common.sh@46 -- # : 0 00:28:35.348 20:34:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:35.348 20:34:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:35.348 20:34:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:35.348 20:34:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:35.348 20:34:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:35.348 20:34:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:35.348 20:34:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:35.348 20:34:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:35.348 20:34:06 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:35.348 20:34:06 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:35.348 20:34:06 -- host/bdevperf.sh@24 -- # nvmftestinit 00:28:35.348 20:34:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:35.348 20:34:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:35.348 20:34:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:35.348 20:34:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:35.348 20:34:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:35.348 20:34:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:35.348 20:34:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:35.348 20:34:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:35.348 20:34:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:35.348 20:34:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:35.348 20:34:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:35.348 20:34:06 -- common/autotest_common.sh@10 -- # set +x 00:28:40.615 20:34:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:40.615 20:34:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:40.615 20:34:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:40.615 20:34:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:40.615 20:34:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:40.615 20:34:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:40.615 20:34:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:40.615 20:34:11 -- nvmf/common.sh@294 -- # net_devs=() 00:28:40.615 20:34:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:40.615 20:34:11 -- nvmf/common.sh@295 -- # e810=() 00:28:40.615 20:34:11 -- nvmf/common.sh@295 -- # local -ga e810 00:28:40.615 20:34:11 -- nvmf/common.sh@296 -- # x722=() 00:28:40.615 20:34:11 -- nvmf/common.sh@296 -- # local -ga x722 00:28:40.615 20:34:11 -- nvmf/common.sh@297 -- # mlx=() 00:28:40.615 20:34:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:40.615 20:34:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:40.615 20:34:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:40.615 20:34:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:40.615 20:34:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:40.615 20:34:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:40.615 20:34:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:28:40.615 Found 0000:86:00.0 (0x8086 - 0x159b) 00:28:40.615 20:34:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:40.615 20:34:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:28:40.615 Found 0000:86:00.1 (0x8086 - 0x159b) 00:28:40.615 20:34:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:40.615 20:34:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:40.615 20:34:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:40.615 20:34:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:40.615 20:34:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:40.615 20:34:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:40.615 20:34:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:28:40.615 Found net devices under 0000:86:00.0: cvl_0_0 00:28:40.615 20:34:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:40.615 20:34:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:40.615 20:34:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:40.615 20:34:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:40.615 20:34:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:40.615 20:34:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:28:40.616 Found net devices under 0000:86:00.1: cvl_0_1 00:28:40.616 20:34:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:40.616 20:34:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:40.616 20:34:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:40.616 20:34:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:40.616 20:34:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:40.616 20:34:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:40.616 20:34:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:40.616 20:34:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:40.616 20:34:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:40.616 20:34:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:40.616 20:34:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:40.616 20:34:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:40.616 20:34:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:40.616 20:34:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:40.616 20:34:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:40.616 20:34:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:40.616 20:34:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:40.616 20:34:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:40.616 20:34:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:40.616 20:34:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:40.616 20:34:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:40.616 20:34:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:40.616 20:34:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:40.616 20:34:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:40.616 20:34:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:40.616 20:34:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:40.616 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:40.616 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:28:40.616 00:28:40.616 --- 10.0.0.2 ping statistics --- 00:28:40.616 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:40.616 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:28:40.616 20:34:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:40.616 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:40.616 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.231 ms 00:28:40.616 00:28:40.616 --- 10.0.0.1 ping statistics --- 00:28:40.616 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:40.616 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:28:40.616 20:34:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:40.616 20:34:12 -- nvmf/common.sh@410 -- # return 0 00:28:40.616 20:34:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:40.616 20:34:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:40.616 20:34:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:40.616 20:34:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:40.616 20:34:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:40.616 20:34:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:40.616 20:34:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:40.616 20:34:12 -- host/bdevperf.sh@25 -- # tgt_init 00:28:40.616 20:34:12 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:28:40.616 20:34:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:40.616 20:34:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:40.616 20:34:12 -- common/autotest_common.sh@10 -- # set +x 00:28:40.616 20:34:12 -- nvmf/common.sh@469 -- # nvmfpid=3577152 00:28:40.616 20:34:12 -- nvmf/common.sh@470 -- # waitforlisten 3577152 00:28:40.616 20:34:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:40.616 20:34:12 -- common/autotest_common.sh@819 -- # '[' -z 3577152 ']' 00:28:40.616 20:34:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:40.616 20:34:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:40.616 20:34:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:40.616 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:40.616 20:34:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:40.616 20:34:12 -- common/autotest_common.sh@10 -- # set +x 00:28:40.616 [2024-07-22 20:34:12.139521] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:40.616 [2024-07-22 20:34:12.139561] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:40.616 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.616 [2024-07-22 20:34:12.197163] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:40.616 [2024-07-22 20:34:12.273278] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:40.616 [2024-07-22 20:34:12.273400] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:40.616 [2024-07-22 20:34:12.273409] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:40.616 [2024-07-22 20:34:12.273415] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:40.616 [2024-07-22 20:34:12.273516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:40.616 [2024-07-22 20:34:12.273604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:40.616 [2024-07-22 20:34:12.273605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:41.182 20:34:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:41.182 20:34:12 -- common/autotest_common.sh@852 -- # return 0 00:28:41.182 20:34:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:41.182 20:34:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:41.182 20:34:12 -- common/autotest_common.sh@10 -- # set +x 00:28:41.182 20:34:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:41.182 20:34:12 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:41.182 20:34:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:41.182 20:34:12 -- common/autotest_common.sh@10 -- # set +x 00:28:41.182 [2024-07-22 20:34:12.982495] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:41.182 20:34:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:41.182 20:34:12 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:41.182 20:34:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:41.182 20:34:12 -- common/autotest_common.sh@10 -- # set +x 00:28:41.182 Malloc0 00:28:41.182 20:34:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:41.182 20:34:13 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:41.182 20:34:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:41.182 20:34:13 -- common/autotest_common.sh@10 -- # set +x 00:28:41.182 20:34:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:41.182 20:34:13 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:41.182 20:34:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:41.182 20:34:13 -- common/autotest_common.sh@10 -- # set +x 00:28:41.182 20:34:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:41.182 20:34:13 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:41.182 20:34:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:41.182 20:34:13 -- common/autotest_common.sh@10 -- # set +x 00:28:41.182 [2024-07-22 20:34:13.055385] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:41.182 20:34:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:41.182 20:34:13 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:28:41.182 20:34:13 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:28:41.182 20:34:13 -- nvmf/common.sh@520 -- # config=() 00:28:41.182 20:34:13 -- nvmf/common.sh@520 -- # local subsystem config 00:28:41.182 20:34:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:41.182 20:34:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:41.182 { 00:28:41.182 "params": { 00:28:41.182 "name": "Nvme$subsystem", 00:28:41.182 "trtype": "$TEST_TRANSPORT", 00:28:41.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:41.182 "adrfam": "ipv4", 00:28:41.182 "trsvcid": "$NVMF_PORT", 00:28:41.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:41.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:41.182 "hdgst": ${hdgst:-false}, 00:28:41.182 "ddgst": ${ddgst:-false} 00:28:41.182 }, 00:28:41.182 "method": "bdev_nvme_attach_controller" 00:28:41.182 } 00:28:41.182 EOF 00:28:41.182 )") 00:28:41.182 20:34:13 -- nvmf/common.sh@542 -- # cat 00:28:41.182 20:34:13 -- nvmf/common.sh@544 -- # jq . 00:28:41.182 20:34:13 -- nvmf/common.sh@545 -- # IFS=, 00:28:41.182 20:34:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:41.182 "params": { 00:28:41.182 "name": "Nvme1", 00:28:41.182 "trtype": "tcp", 00:28:41.182 "traddr": "10.0.0.2", 00:28:41.182 "adrfam": "ipv4", 00:28:41.182 "trsvcid": "4420", 00:28:41.182 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:41.182 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:41.182 "hdgst": false, 00:28:41.182 "ddgst": false 00:28:41.182 }, 00:28:41.182 "method": "bdev_nvme_attach_controller" 00:28:41.182 }' 00:28:41.182 [2024-07-22 20:34:13.102082] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:41.182 [2024-07-22 20:34:13.102126] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3577402 ] 00:28:41.440 EAL: No free 2048 kB hugepages reported on node 1 00:28:41.440 [2024-07-22 20:34:13.155884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:41.440 [2024-07-22 20:34:13.226936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:41.698 Running I/O for 1 seconds... 00:28:42.633 00:28:42.633 Latency(us) 00:28:42.633 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:42.633 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:42.633 Verification LBA range: start 0x0 length 0x4000 00:28:42.633 Nvme1n1 : 1.01 16798.90 65.62 0.00 0.00 7589.32 1097.02 18578.03 00:28:42.633 =================================================================================================================== 00:28:42.633 Total : 16798.90 65.62 0.00 0.00 7589.32 1097.02 18578.03 00:28:42.891 20:34:14 -- host/bdevperf.sh@30 -- # bdevperfpid=3577647 00:28:42.891 20:34:14 -- host/bdevperf.sh@32 -- # sleep 3 00:28:42.891 20:34:14 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:28:42.891 20:34:14 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:28:42.891 20:34:14 -- nvmf/common.sh@520 -- # config=() 00:28:42.891 20:34:14 -- nvmf/common.sh@520 -- # local subsystem config 00:28:42.891 20:34:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:42.891 20:34:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:42.891 { 00:28:42.891 "params": { 00:28:42.891 "name": "Nvme$subsystem", 00:28:42.891 "trtype": "$TEST_TRANSPORT", 00:28:42.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:42.891 "adrfam": "ipv4", 00:28:42.891 "trsvcid": "$NVMF_PORT", 00:28:42.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:42.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:42.891 "hdgst": ${hdgst:-false}, 00:28:42.891 "ddgst": ${ddgst:-false} 00:28:42.891 }, 00:28:42.891 "method": "bdev_nvme_attach_controller" 00:28:42.891 } 00:28:42.891 EOF 00:28:42.891 )") 00:28:42.891 20:34:14 -- nvmf/common.sh@542 -- # cat 00:28:42.891 20:34:14 -- nvmf/common.sh@544 -- # jq . 00:28:42.891 20:34:14 -- nvmf/common.sh@545 -- # IFS=, 00:28:42.891 20:34:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:42.891 "params": { 00:28:42.891 "name": "Nvme1", 00:28:42.891 "trtype": "tcp", 00:28:42.891 "traddr": "10.0.0.2", 00:28:42.891 "adrfam": "ipv4", 00:28:42.891 "trsvcid": "4420", 00:28:42.891 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:42.891 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:42.891 "hdgst": false, 00:28:42.891 "ddgst": false 00:28:42.891 }, 00:28:42.891 "method": "bdev_nvme_attach_controller" 00:28:42.891 }' 00:28:42.891 [2024-07-22 20:34:14.766548] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:42.891 [2024-07-22 20:34:14.766596] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3577647 ] 00:28:42.891 EAL: No free 2048 kB hugepages reported on node 1 00:28:42.891 [2024-07-22 20:34:14.822149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:43.150 [2024-07-22 20:34:14.890154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:43.150 Running I/O for 15 seconds... 00:28:46.440 20:34:17 -- host/bdevperf.sh@33 -- # kill -9 3577152 00:28:46.440 20:34:17 -- host/bdevperf.sh@35 -- # sleep 3 00:28:46.440 [2024-07-22 20:34:17.738229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:99680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:99688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:99696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:99704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:99712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:99728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:99736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:99000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:99008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:99024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:99040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:99096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:99112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:99160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:99168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.440 [2024-07-22 20:34:17.738527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:99752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.440 [2024-07-22 20:34:17.738535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:99176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:99184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:99200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:99216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:99256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:99272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:99288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:99296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:99808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:99816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:99832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:99856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:99880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:99888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.738767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:99896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.738781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:99904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:99912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.738813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:99920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.738828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:99928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.738843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:99936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.738857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:99328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:99336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:99344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:99360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:99368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:99376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:99384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:99400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.441 [2024-07-22 20:34:17.738973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:99944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.738991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.738999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:99952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.739006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.739014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:99960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.739021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.739029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:99968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.739035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.739048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:99976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.441 [2024-07-22 20:34:17.739055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.441 [2024-07-22 20:34:17.739065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:99984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:99992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:100000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:100008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:100016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:100024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:100032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:100040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:100048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:100056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:100064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:100072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:100080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:100088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:99416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:99424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:99432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:99440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:99488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:99512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:99520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:99528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:100096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:100104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:100112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:100120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:100128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:100136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:100144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:100152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:100160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:100168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:100176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.442 [2024-07-22 20:34:17.739549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:99552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.442 [2024-07-22 20:34:17.739563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.442 [2024-07-22 20:34:17.739571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:99560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:99568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:99576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:99600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:99624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:99632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:99648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:100184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.443 [2024-07-22 20:34:17.739680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:100192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:100200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:100208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:100216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:100224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:100232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:100240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:100248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:100256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.443 [2024-07-22 20:34:17.739815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:100264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.443 [2024-07-22 20:34:17.739829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:100272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:100280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.443 [2024-07-22 20:34:17.739858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:100288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:100296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:100304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.443 [2024-07-22 20:34:17.739900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:100312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.443 [2024-07-22 20:34:17.739915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:99656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:99664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:99672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:99720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:99744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.739991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.739999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:99760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.740005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.740013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:99768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.740021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.740028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:99776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.443 [2024-07-22 20:34:17.740035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.740047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:100320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.443 [2024-07-22 20:34:17.740053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.740061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:100328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.443 [2024-07-22 20:34:17.740067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.443 [2024-07-22 20:34:17.740075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:100336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.444 [2024-07-22 20:34:17.740082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:100344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.444 [2024-07-22 20:34:17.740097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:100352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:46.444 [2024-07-22 20:34:17.740112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:99784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.444 [2024-07-22 20:34:17.740126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:99792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.444 [2024-07-22 20:34:17.740141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:99800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.444 [2024-07-22 20:34:17.740156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:99824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.444 [2024-07-22 20:34:17.740171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:99840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.444 [2024-07-22 20:34:17.740186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:99848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.444 [2024-07-22 20:34:17.740201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:99864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:46.444 [2024-07-22 20:34:17.740215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe6bb80 is same with the state(5) to be set 00:28:46.444 [2024-07-22 20:34:17.740230] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:46.444 [2024-07-22 20:34:17.740236] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:46.444 [2024-07-22 20:34:17.740241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:99872 len:8 PRP1 0x0 PRP2 0x0 00:28:46.444 [2024-07-22 20:34:17.740250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:46.444 [2024-07-22 20:34:17.740294] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe6bb80 was disconnected and freed. reset controller. 00:28:46.444 [2024-07-22 20:34:17.742497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.444 [2024-07-22 20:34:17.742552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.444 [2024-07-22 20:34:17.743231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.743568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.743598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.444 [2024-07-22 20:34:17.743621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.444 [2024-07-22 20:34:17.743912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.444 [2024-07-22 20:34:17.744172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.444 [2024-07-22 20:34:17.744181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.444 [2024-07-22 20:34:17.744189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.444 [2024-07-22 20:34:17.746106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.444 [2024-07-22 20:34:17.754626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.444 [2024-07-22 20:34:17.755147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.755540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.755572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.444 [2024-07-22 20:34:17.755594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.444 [2024-07-22 20:34:17.755826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.444 [2024-07-22 20:34:17.756144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.444 [2024-07-22 20:34:17.756154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.444 [2024-07-22 20:34:17.756162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.444 [2024-07-22 20:34:17.758081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.444 [2024-07-22 20:34:17.766558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.444 [2024-07-22 20:34:17.767064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.767386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.767419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.444 [2024-07-22 20:34:17.767441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.444 [2024-07-22 20:34:17.767821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.444 [2024-07-22 20:34:17.768175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.444 [2024-07-22 20:34:17.768184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.444 [2024-07-22 20:34:17.768190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.444 [2024-07-22 20:34:17.769743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.444 [2024-07-22 20:34:17.778343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.444 [2024-07-22 20:34:17.778877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.779286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.779311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.444 [2024-07-22 20:34:17.779318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.444 [2024-07-22 20:34:17.779398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.444 [2024-07-22 20:34:17.779527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.444 [2024-07-22 20:34:17.779535] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.444 [2024-07-22 20:34:17.779541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.444 [2024-07-22 20:34:17.781099] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.444 [2024-07-22 20:34:17.790244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.444 [2024-07-22 20:34:17.790740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.791071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.444 [2024-07-22 20:34:17.791104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.444 [2024-07-22 20:34:17.791126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.444 [2024-07-22 20:34:17.791449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.444 [2024-07-22 20:34:17.791595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.444 [2024-07-22 20:34:17.791604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.444 [2024-07-22 20:34:17.791610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.444 [2024-07-22 20:34:17.793301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.444 [2024-07-22 20:34:17.802134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.445 [2024-07-22 20:34:17.802685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.803107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.803140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.445 [2024-07-22 20:34:17.803162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.445 [2024-07-22 20:34:17.803370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.445 [2024-07-22 20:34:17.803470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.445 [2024-07-22 20:34:17.803480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.445 [2024-07-22 20:34:17.803487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.445 [2024-07-22 20:34:17.805184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.445 [2024-07-22 20:34:17.814078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.445 [2024-07-22 20:34:17.814543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.814938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.814969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.445 [2024-07-22 20:34:17.814990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.445 [2024-07-22 20:34:17.815237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.445 [2024-07-22 20:34:17.815396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.445 [2024-07-22 20:34:17.815409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.445 [2024-07-22 20:34:17.815415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.445 [2024-07-22 20:34:17.817062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.445 [2024-07-22 20:34:17.825973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.445 [2024-07-22 20:34:17.826455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.826895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.826930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.445 [2024-07-22 20:34:17.826952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.445 [2024-07-22 20:34:17.827450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.445 [2024-07-22 20:34:17.827612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.445 [2024-07-22 20:34:17.827622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.445 [2024-07-22 20:34:17.827628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.445 [2024-07-22 20:34:17.829277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.445 [2024-07-22 20:34:17.837632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.445 [2024-07-22 20:34:17.838148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.838589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.838620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.445 [2024-07-22 20:34:17.838641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.445 [2024-07-22 20:34:17.839022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.445 [2024-07-22 20:34:17.839311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.445 [2024-07-22 20:34:17.839321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.445 [2024-07-22 20:34:17.839328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.445 [2024-07-22 20:34:17.841157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.445 [2024-07-22 20:34:17.849480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.445 [2024-07-22 20:34:17.849957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.850361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.850395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.445 [2024-07-22 20:34:17.850417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.445 [2024-07-22 20:34:17.850898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.445 [2024-07-22 20:34:17.851139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.445 [2024-07-22 20:34:17.851153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.445 [2024-07-22 20:34:17.851166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.445 [2024-07-22 20:34:17.853749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.445 [2024-07-22 20:34:17.862062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.445 [2024-07-22 20:34:17.862571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.862998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.445 [2024-07-22 20:34:17.863029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.445 [2024-07-22 20:34:17.863065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.445 [2024-07-22 20:34:17.863547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.445 [2024-07-22 20:34:17.863780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.445 [2024-07-22 20:34:17.863790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.863796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.865580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.446 [2024-07-22 20:34:17.874006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.446 [2024-07-22 20:34:17.874552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.874997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.875028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.446 [2024-07-22 20:34:17.875064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.446 [2024-07-22 20:34:17.875450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.446 [2024-07-22 20:34:17.875565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.446 [2024-07-22 20:34:17.875575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.875581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.877310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.446 [2024-07-22 20:34:17.885816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.446 [2024-07-22 20:34:17.886307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.886742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.886773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.446 [2024-07-22 20:34:17.886796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.446 [2024-07-22 20:34:17.887193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.446 [2024-07-22 20:34:17.887476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.446 [2024-07-22 20:34:17.887500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.887521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.889532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.446 [2024-07-22 20:34:17.897640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.446 [2024-07-22 20:34:17.898122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.898496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.898527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.446 [2024-07-22 20:34:17.898549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.446 [2024-07-22 20:34:17.898874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.446 [2024-07-22 20:34:17.899011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.446 [2024-07-22 20:34:17.899020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.899026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.900657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.446 [2024-07-22 20:34:17.909557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.446 [2024-07-22 20:34:17.909976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.910389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.910423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.446 [2024-07-22 20:34:17.910445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.446 [2024-07-22 20:34:17.910878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.446 [2024-07-22 20:34:17.911024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.446 [2024-07-22 20:34:17.911033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.911039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.912779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.446 [2024-07-22 20:34:17.921347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.446 [2024-07-22 20:34:17.921736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.922208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.922241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.446 [2024-07-22 20:34:17.922263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.446 [2024-07-22 20:34:17.922593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.446 [2024-07-22 20:34:17.922879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.446 [2024-07-22 20:34:17.922889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.922895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.924590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.446 [2024-07-22 20:34:17.933225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.446 [2024-07-22 20:34:17.933713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.934006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.934038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.446 [2024-07-22 20:34:17.934076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.446 [2024-07-22 20:34:17.934543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.446 [2024-07-22 20:34:17.934644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.446 [2024-07-22 20:34:17.934654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.934660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.936299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.446 [2024-07-22 20:34:17.945076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.446 [2024-07-22 20:34:17.945592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.945965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.945996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.446 [2024-07-22 20:34:17.946018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.446 [2024-07-22 20:34:17.946510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.446 [2024-07-22 20:34:17.946772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.446 [2024-07-22 20:34:17.946781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.946788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.948513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.446 [2024-07-22 20:34:17.956972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.446 [2024-07-22 20:34:17.957421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.957751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.446 [2024-07-22 20:34:17.957782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.446 [2024-07-22 20:34:17.957804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.446 [2024-07-22 20:34:17.958149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.446 [2024-07-22 20:34:17.958631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.446 [2024-07-22 20:34:17.958657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.446 [2024-07-22 20:34:17.958677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.446 [2024-07-22 20:34:17.960599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.447 [2024-07-22 20:34:17.968935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.447 [2024-07-22 20:34:17.969444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:17.969917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:17.969948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.447 [2024-07-22 20:34:17.969970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.447 [2024-07-22 20:34:17.970413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.447 [2024-07-22 20:34:17.970678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.447 [2024-07-22 20:34:17.970688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.447 [2024-07-22 20:34:17.970694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.447 [2024-07-22 20:34:17.972489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.447 [2024-07-22 20:34:17.980806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.447 [2024-07-22 20:34:17.981325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:17.981692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:17.981724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.447 [2024-07-22 20:34:17.981746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.447 [2024-07-22 20:34:17.982086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.447 [2024-07-22 20:34:17.982420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.447 [2024-07-22 20:34:17.982445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.447 [2024-07-22 20:34:17.982466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.447 [2024-07-22 20:34:17.985208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.447 [2024-07-22 20:34:17.993500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.447 [2024-07-22 20:34:17.994031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:17.995361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:17.995399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.447 [2024-07-22 20:34:17.995408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.447 [2024-07-22 20:34:17.995534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.447 [2024-07-22 20:34:17.995653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.447 [2024-07-22 20:34:17.995662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.447 [2024-07-22 20:34:17.995668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.447 [2024-07-22 20:34:17.997513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.447 [2024-07-22 20:34:18.005477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.447 [2024-07-22 20:34:18.006008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.006406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.006441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.447 [2024-07-22 20:34:18.006471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.447 [2024-07-22 20:34:18.006805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.447 [2024-07-22 20:34:18.007033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.447 [2024-07-22 20:34:18.007049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.447 [2024-07-22 20:34:18.007056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.447 [2024-07-22 20:34:18.008956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.447 [2024-07-22 20:34:18.017470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.447 [2024-07-22 20:34:18.017970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.018434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.018468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.447 [2024-07-22 20:34:18.018490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.447 [2024-07-22 20:34:18.018857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.447 [2024-07-22 20:34:18.018961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.447 [2024-07-22 20:34:18.018971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.447 [2024-07-22 20:34:18.018977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.447 [2024-07-22 20:34:18.020826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.447 [2024-07-22 20:34:18.029483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.447 [2024-07-22 20:34:18.029957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.030370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.030404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.447 [2024-07-22 20:34:18.030426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.447 [2024-07-22 20:34:18.030758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.447 [2024-07-22 20:34:18.030899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.447 [2024-07-22 20:34:18.030909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.447 [2024-07-22 20:34:18.030915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.447 [2024-07-22 20:34:18.032731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.447 [2024-07-22 20:34:18.041406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.447 [2024-07-22 20:34:18.041982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.042406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.042439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.447 [2024-07-22 20:34:18.042462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.447 [2024-07-22 20:34:18.042752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.447 [2024-07-22 20:34:18.043192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.447 [2024-07-22 20:34:18.043206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.447 [2024-07-22 20:34:18.043216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.447 [2024-07-22 20:34:18.045888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.447 [2024-07-22 20:34:18.053762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.447 [2024-07-22 20:34:18.054202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.054531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.447 [2024-07-22 20:34:18.054564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.447 [2024-07-22 20:34:18.054587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.447 [2024-07-22 20:34:18.054929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.447 [2024-07-22 20:34:18.055064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.447 [2024-07-22 20:34:18.055074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.447 [2024-07-22 20:34:18.055082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.056673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.448 [2024-07-22 20:34:18.065624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.448 [2024-07-22 20:34:18.066175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.066547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.066579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.448 [2024-07-22 20:34:18.066601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.448 [2024-07-22 20:34:18.066944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.448 [2024-07-22 20:34:18.067102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.448 [2024-07-22 20:34:18.067112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.448 [2024-07-22 20:34:18.067119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.068808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.448 [2024-07-22 20:34:18.077760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.448 [2024-07-22 20:34:18.078276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.078603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.078635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.448 [2024-07-22 20:34:18.078656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.448 [2024-07-22 20:34:18.078988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.448 [2024-07-22 20:34:18.079213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.448 [2024-07-22 20:34:18.079224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.448 [2024-07-22 20:34:18.079230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.080969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.448 [2024-07-22 20:34:18.089579] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.448 [2024-07-22 20:34:18.090095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.090409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.090421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.448 [2024-07-22 20:34:18.090428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.448 [2024-07-22 20:34:18.090521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.448 [2024-07-22 20:34:18.090588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.448 [2024-07-22 20:34:18.090596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.448 [2024-07-22 20:34:18.090603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.092247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.448 [2024-07-22 20:34:18.101535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.448 [2024-07-22 20:34:18.102030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.102373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.102404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.448 [2024-07-22 20:34:18.102426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.448 [2024-07-22 20:34:18.102908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.448 [2024-07-22 20:34:18.103168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.448 [2024-07-22 20:34:18.103178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.448 [2024-07-22 20:34:18.103185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.104943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.448 [2024-07-22 20:34:18.113585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.448 [2024-07-22 20:34:18.114084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.114430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.114461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.448 [2024-07-22 20:34:18.114483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.448 [2024-07-22 20:34:18.114913] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.448 [2024-07-22 20:34:18.115305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.448 [2024-07-22 20:34:18.115340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.448 [2024-07-22 20:34:18.115361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.117001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.448 [2024-07-22 20:34:18.125490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.448 [2024-07-22 20:34:18.126039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.126366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.126397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.448 [2024-07-22 20:34:18.126418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.448 [2024-07-22 20:34:18.126749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.448 [2024-07-22 20:34:18.127141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.448 [2024-07-22 20:34:18.127152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.448 [2024-07-22 20:34:18.127159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.128928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.448 [2024-07-22 20:34:18.137280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.448 [2024-07-22 20:34:18.137745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.138142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.138175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.448 [2024-07-22 20:34:18.138198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.448 [2024-07-22 20:34:18.138339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.448 [2024-07-22 20:34:18.138448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.448 [2024-07-22 20:34:18.138458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.448 [2024-07-22 20:34:18.138464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.140134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.448 [2024-07-22 20:34:18.149088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.448 [2024-07-22 20:34:18.149476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.149857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.448 [2024-07-22 20:34:18.149888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.448 [2024-07-22 20:34:18.149910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.448 [2024-07-22 20:34:18.150303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.448 [2024-07-22 20:34:18.150540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.448 [2024-07-22 20:34:18.150550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.448 [2024-07-22 20:34:18.150560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.448 [2024-07-22 20:34:18.152284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.161093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.161631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.162077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.162111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.449 [2024-07-22 20:34:18.162134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.449 [2024-07-22 20:34:18.162465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.449 [2024-07-22 20:34:18.162898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.449 [2024-07-22 20:34:18.162923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.449 [2024-07-22 20:34:18.162943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.449 [2024-07-22 20:34:18.165080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.173103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.173607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.174027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.174089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.449 [2024-07-22 20:34:18.174112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.449 [2024-07-22 20:34:18.174315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.449 [2024-07-22 20:34:18.174386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.449 [2024-07-22 20:34:18.174395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.449 [2024-07-22 20:34:18.174403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.449 [2024-07-22 20:34:18.176845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.185571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.186097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.186412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.186453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.449 [2024-07-22 20:34:18.186460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.449 [2024-07-22 20:34:18.186557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.449 [2024-07-22 20:34:18.186655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.449 [2024-07-22 20:34:18.186663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.449 [2024-07-22 20:34:18.186669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.449 [2024-07-22 20:34:18.188483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.197583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.198019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.198364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.198397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.449 [2024-07-22 20:34:18.198419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.449 [2024-07-22 20:34:18.198851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.449 [2024-07-22 20:34:18.199296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.449 [2024-07-22 20:34:18.199323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.449 [2024-07-22 20:34:18.199344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.449 [2024-07-22 20:34:18.201204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.209506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.210005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.210397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.210430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.449 [2024-07-22 20:34:18.210452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.449 [2024-07-22 20:34:18.210626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.449 [2024-07-22 20:34:18.210749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.449 [2024-07-22 20:34:18.210759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.449 [2024-07-22 20:34:18.210765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.449 [2024-07-22 20:34:18.212375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.221435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.221938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.222357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.222391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.449 [2024-07-22 20:34:18.222413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.449 [2024-07-22 20:34:18.222845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.449 [2024-07-22 20:34:18.223138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.449 [2024-07-22 20:34:18.223164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.449 [2024-07-22 20:34:18.223185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.449 [2024-07-22 20:34:18.225298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.233136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.233593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.233966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.233996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.449 [2024-07-22 20:34:18.234018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.449 [2024-07-22 20:34:18.234436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.449 [2024-07-22 20:34:18.234546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.449 [2024-07-22 20:34:18.234555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.449 [2024-07-22 20:34:18.234561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.449 [2024-07-22 20:34:18.236315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.244954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.245442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.245760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.449 [2024-07-22 20:34:18.245791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.449 [2024-07-22 20:34:18.245813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.449 [2024-07-22 20:34:18.246256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.449 [2024-07-22 20:34:18.246418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.449 [2024-07-22 20:34:18.246428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.449 [2024-07-22 20:34:18.246434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.449 [2024-07-22 20:34:18.248208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.449 [2024-07-22 20:34:18.257014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.449 [2024-07-22 20:34:18.257464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.257865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.257876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.450 [2024-07-22 20:34:18.257883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.450 [2024-07-22 20:34:18.258001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.450 [2024-07-22 20:34:18.258153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.450 [2024-07-22 20:34:18.258164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.450 [2024-07-22 20:34:18.258170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.450 [2024-07-22 20:34:18.260065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.450 [2024-07-22 20:34:18.268998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.450 [2024-07-22 20:34:18.269489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.269889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.269901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.450 [2024-07-22 20:34:18.269908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.450 [2024-07-22 20:34:18.270026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.450 [2024-07-22 20:34:18.270183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.450 [2024-07-22 20:34:18.270194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.450 [2024-07-22 20:34:18.270200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.450 [2024-07-22 20:34:18.272170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.450 [2024-07-22 20:34:18.281265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.450 [2024-07-22 20:34:18.281762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.282095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.282109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.450 [2024-07-22 20:34:18.282117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.450 [2024-07-22 20:34:18.282246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.450 [2024-07-22 20:34:18.282375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.450 [2024-07-22 20:34:18.282385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.450 [2024-07-22 20:34:18.282392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.450 [2024-07-22 20:34:18.284413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.450 [2024-07-22 20:34:18.293542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.450 [2024-07-22 20:34:18.294034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.294466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.294478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.450 [2024-07-22 20:34:18.294485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.450 [2024-07-22 20:34:18.294591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.450 [2024-07-22 20:34:18.294681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.450 [2024-07-22 20:34:18.294690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.450 [2024-07-22 20:34:18.294697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.450 [2024-07-22 20:34:18.296762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.450 [2024-07-22 20:34:18.305705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.450 [2024-07-22 20:34:18.306232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.306649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.306665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.450 [2024-07-22 20:34:18.306674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.450 [2024-07-22 20:34:18.306754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.450 [2024-07-22 20:34:18.306917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.450 [2024-07-22 20:34:18.306928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.450 [2024-07-22 20:34:18.306935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.450 [2024-07-22 20:34:18.308823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.450 [2024-07-22 20:34:18.317933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.450 [2024-07-22 20:34:18.318452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.318899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.318931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.450 [2024-07-22 20:34:18.318953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.450 [2024-07-22 20:34:18.319346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.450 [2024-07-22 20:34:18.319730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.450 [2024-07-22 20:34:18.319756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.450 [2024-07-22 20:34:18.319777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.450 [2024-07-22 20:34:18.321895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.450 [2024-07-22 20:34:18.329941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.450 [2024-07-22 20:34:18.330441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.330845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.330877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.450 [2024-07-22 20:34:18.330898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.450 [2024-07-22 20:34:18.331290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.450 [2024-07-22 20:34:18.331624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.450 [2024-07-22 20:34:18.331634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.450 [2024-07-22 20:34:18.331641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.450 [2024-07-22 20:34:18.333507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.450 [2024-07-22 20:34:18.342048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.450 [2024-07-22 20:34:18.342532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.342854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.342885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.450 [2024-07-22 20:34:18.342915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.450 [2024-07-22 20:34:18.343060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.450 [2024-07-22 20:34:18.343193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.450 [2024-07-22 20:34:18.343203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.450 [2024-07-22 20:34:18.343209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.450 [2024-07-22 20:34:18.345010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.450 [2024-07-22 20:34:18.353907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.450 [2024-07-22 20:34:18.354414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.354760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.450 [2024-07-22 20:34:18.354791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.451 [2024-07-22 20:34:18.354814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.451 [2024-07-22 20:34:18.355154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.451 [2024-07-22 20:34:18.355439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.451 [2024-07-22 20:34:18.355464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.451 [2024-07-22 20:34:18.355485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.451 [2024-07-22 20:34:18.357602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.451 [2024-07-22 20:34:18.365818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.451 [2024-07-22 20:34:18.366363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.451 [2024-07-22 20:34:18.366831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.451 [2024-07-22 20:34:18.366863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.451 [2024-07-22 20:34:18.366890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.451 [2024-07-22 20:34:18.367031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.451 [2024-07-22 20:34:18.367164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.451 [2024-07-22 20:34:18.367174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.451 [2024-07-22 20:34:18.367181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.451 [2024-07-22 20:34:18.369591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.711 [2024-07-22 20:34:18.378434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.711 [2024-07-22 20:34:18.378889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.711 [2024-07-22 20:34:18.379305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.711 [2024-07-22 20:34:18.379339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.711 [2024-07-22 20:34:18.379362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.711 [2024-07-22 20:34:18.379752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.711 [2024-07-22 20:34:18.379920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.711 [2024-07-22 20:34:18.379929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.711 [2024-07-22 20:34:18.379935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.711 [2024-07-22 20:34:18.381707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.711 [2024-07-22 20:34:18.390265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.711 [2024-07-22 20:34:18.390793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.711 [2024-07-22 20:34:18.390994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.711 [2024-07-22 20:34:18.391005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.711 [2024-07-22 20:34:18.391013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.711 [2024-07-22 20:34:18.391138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.711 [2024-07-22 20:34:18.391303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.711 [2024-07-22 20:34:18.391312] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.711 [2024-07-22 20:34:18.391319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.711 [2024-07-22 20:34:18.393102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.711 [2024-07-22 20:34:18.401868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.711 [2024-07-22 20:34:18.402294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.711 [2024-07-22 20:34:18.402675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.711 [2024-07-22 20:34:18.402707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.711 [2024-07-22 20:34:18.402729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.711 [2024-07-22 20:34:18.403056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.711 [2024-07-22 20:34:18.403202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.711 [2024-07-22 20:34:18.403211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.711 [2024-07-22 20:34:18.403217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.711 [2024-07-22 20:34:18.404967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.711 [2024-07-22 20:34:18.413699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.711 [2024-07-22 20:34:18.414265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.711 [2024-07-22 20:34:18.414708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.711 [2024-07-22 20:34:18.414739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.711 [2024-07-22 20:34:18.414762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.711 [2024-07-22 20:34:18.415107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.711 [2024-07-22 20:34:18.415267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.711 [2024-07-22 20:34:18.415277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.711 [2024-07-22 20:34:18.415283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.711 [2024-07-22 20:34:18.416958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.711 [2024-07-22 20:34:18.425572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.426091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.426513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.426545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.426567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.426843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.426938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.426947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.426953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.428709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.437287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.437800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.438167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.438201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.438223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.438555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.438943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.438952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.438958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.440586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.449073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.449592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.450010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.450057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.450081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.450263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.450394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.450406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.450412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.452075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.460881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.461422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.461750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.461781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.461803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.462124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.462226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.462235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.462242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.464090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.472808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.473347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.473790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.473821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.473842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.473989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.474083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.474093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.474117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.475766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.484617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.485150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.485588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.485619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.485641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.485923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.486215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.486225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.486234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.487999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.496500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.496971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.497405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.497439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.497462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.497796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.498221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.498231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.498238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.500099] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.508308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.508824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.509244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.509277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.509299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.509679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.510074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.510101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.510122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.512914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.520445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.520948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.521350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.521382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.712 [2024-07-22 20:34:18.521404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.712 [2024-07-22 20:34:18.521686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.712 [2024-07-22 20:34:18.522070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.712 [2024-07-22 20:34:18.522080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.712 [2024-07-22 20:34:18.522086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.712 [2024-07-22 20:34:18.523874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.712 [2024-07-22 20:34:18.532347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.712 [2024-07-22 20:34:18.532873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.533314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.712 [2024-07-22 20:34:18.533352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.533360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.533482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.533604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.533613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.533619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.535261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.544371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.544870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.545224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.545258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.545280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.545540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.545678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.545687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.545692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.547522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.556124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.556673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.557113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.557146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.557153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.557249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.557371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.557381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.557387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.558940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.567958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.568488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.568902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.568934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.568956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.569353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.569517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.569527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.569533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.571294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.579709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.580235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.580600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.580631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.580652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.581098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.581482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.581508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.581528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.583362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.591473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.592006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.592400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.592432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.592454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.592835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.593180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.593215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.593221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.594888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.603186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.603678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.603988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.604019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.604041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.604310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.604454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.604463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.604470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.606226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.615146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.615644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.616017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.616063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.616086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.616368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.616710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.616719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.616725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.618494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.627167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.627593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.627912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.627943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.627965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.628411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.628710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.628719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.713 [2024-07-22 20:34:18.628725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.713 [2024-07-22 20:34:18.630613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.713 [2024-07-22 20:34:18.639072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.713 [2024-07-22 20:34:18.639457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.639761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.713 [2024-07-22 20:34:18.639792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.713 [2024-07-22 20:34:18.639821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.713 [2024-07-22 20:34:18.640067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.713 [2024-07-22 20:34:18.640350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.713 [2024-07-22 20:34:18.640360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.714 [2024-07-22 20:34:18.640366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.714 [2024-07-22 20:34:18.642299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.974 [2024-07-22 20:34:18.651362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.974 [2024-07-22 20:34:18.651744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.652122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.652155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.974 [2024-07-22 20:34:18.652177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.974 [2024-07-22 20:34:18.652508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.974 [2024-07-22 20:34:18.652678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.974 [2024-07-22 20:34:18.652688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.974 [2024-07-22 20:34:18.652695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.974 [2024-07-22 20:34:18.654533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.974 [2024-07-22 20:34:18.663220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.974 [2024-07-22 20:34:18.663671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.664093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.664126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.974 [2024-07-22 20:34:18.664149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.974 [2024-07-22 20:34:18.664504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.974 [2024-07-22 20:34:18.664613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.974 [2024-07-22 20:34:18.664622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.974 [2024-07-22 20:34:18.664628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.974 [2024-07-22 20:34:18.666338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.974 [2024-07-22 20:34:18.674875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.974 [2024-07-22 20:34:18.675388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.675823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.675854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.974 [2024-07-22 20:34:18.675876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.974 [2024-07-22 20:34:18.676177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.974 [2024-07-22 20:34:18.676416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.974 [2024-07-22 20:34:18.676425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.974 [2024-07-22 20:34:18.676433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.974 [2024-07-22 20:34:18.678148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.974 [2024-07-22 20:34:18.686814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.974 [2024-07-22 20:34:18.687195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.687521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.687552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.974 [2024-07-22 20:34:18.687574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.974 [2024-07-22 20:34:18.687954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.974 [2024-07-22 20:34:18.688302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.974 [2024-07-22 20:34:18.688328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.974 [2024-07-22 20:34:18.688349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.974 [2024-07-22 20:34:18.690348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.974 [2024-07-22 20:34:18.698622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.974 [2024-07-22 20:34:18.699174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.699536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.699567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.974 [2024-07-22 20:34:18.699589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.974 [2024-07-22 20:34:18.699841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.974 [2024-07-22 20:34:18.699964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.974 [2024-07-22 20:34:18.699974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.974 [2024-07-22 20:34:18.699980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.974 [2024-07-22 20:34:18.701748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.974 [2024-07-22 20:34:18.710641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.974 [2024-07-22 20:34:18.711144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.711586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.711617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.974 [2024-07-22 20:34:18.711639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.974 [2024-07-22 20:34:18.711941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.974 [2024-07-22 20:34:18.712053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.974 [2024-07-22 20:34:18.712066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.974 [2024-07-22 20:34:18.712075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.974 [2024-07-22 20:34:18.714745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.974 [2024-07-22 20:34:18.723123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.974 [2024-07-22 20:34:18.723576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.724014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.724059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.974 [2024-07-22 20:34:18.724084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.974 [2024-07-22 20:34:18.724366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.974 [2024-07-22 20:34:18.724575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.974 [2024-07-22 20:34:18.724585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.974 [2024-07-22 20:34:18.724591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.974 [2024-07-22 20:34:18.726387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.974 [2024-07-22 20:34:18.735050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.974 [2024-07-22 20:34:18.735580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.736016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.974 [2024-07-22 20:34:18.736060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.974 [2024-07-22 20:34:18.736083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.974 [2024-07-22 20:34:18.736463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.974 [2024-07-22 20:34:18.736636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.736646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.736652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.738381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.746984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.747545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.747872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.747903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.747925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.748217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.748650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.748682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.748703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.750533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.759012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.759539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.759945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.759976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.759999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.760393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.760597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.760606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.760612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.762274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.770796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.771149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.771554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.771585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.771607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.771989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.772163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.772176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.772186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.774802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.783083] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.783622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.783987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.784018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.784040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.784437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.784720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.784730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.784740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.786458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.794872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.795375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.795767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.795778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.795785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.795880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.796003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.796012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.796019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.797732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.806842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.807329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.807697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.807709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.807716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.807810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.807918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.807927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.807933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.809782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.818487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.819010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.819437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.819469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.819492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.819922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.820145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.820155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.820163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.821987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.830387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.830886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.831290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.831323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.831344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.831726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.832103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.832113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.832119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.833768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.842350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.975 [2024-07-22 20:34:18.842863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.843191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.975 [2024-07-22 20:34:18.843224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.975 [2024-07-22 20:34:18.843246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.975 [2024-07-22 20:34:18.843576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.975 [2024-07-22 20:34:18.843931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.975 [2024-07-22 20:34:18.843940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.975 [2024-07-22 20:34:18.843946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.975 [2024-07-22 20:34:18.845671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.975 [2024-07-22 20:34:18.854262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.976 [2024-07-22 20:34:18.854794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.855248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.855260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.976 [2024-07-22 20:34:18.855267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.976 [2024-07-22 20:34:18.855362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.976 [2024-07-22 20:34:18.855485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.976 [2024-07-22 20:34:18.855494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.976 [2024-07-22 20:34:18.855501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.976 [2024-07-22 20:34:18.857166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.976 [2024-07-22 20:34:18.866245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.976 [2024-07-22 20:34:18.866678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.867094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.867127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.976 [2024-07-22 20:34:18.867149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.976 [2024-07-22 20:34:18.867289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.976 [2024-07-22 20:34:18.867383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.976 [2024-07-22 20:34:18.867392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.976 [2024-07-22 20:34:18.867398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.976 [2024-07-22 20:34:18.869096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.976 [2024-07-22 20:34:18.878116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.976 [2024-07-22 20:34:18.878622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.878996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.879027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.976 [2024-07-22 20:34:18.879064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.976 [2024-07-22 20:34:18.879347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.976 [2024-07-22 20:34:18.879448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.976 [2024-07-22 20:34:18.879457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.976 [2024-07-22 20:34:18.879464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.976 [2024-07-22 20:34:18.881146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.976 [2024-07-22 20:34:18.889831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.976 [2024-07-22 20:34:18.890344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.890765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.890796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.976 [2024-07-22 20:34:18.890817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.976 [2024-07-22 20:34:18.891016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.976 [2024-07-22 20:34:18.891150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.976 [2024-07-22 20:34:18.891160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.976 [2024-07-22 20:34:18.891167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.976 [2024-07-22 20:34:18.893000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:46.976 [2024-07-22 20:34:18.901619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:46.976 [2024-07-22 20:34:18.902160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.902545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:46.976 [2024-07-22 20:34:18.902575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:46.976 [2024-07-22 20:34:18.902596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:46.976 [2024-07-22 20:34:18.902976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:46.976 [2024-07-22 20:34:18.903114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:46.976 [2024-07-22 20:34:18.903124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:46.976 [2024-07-22 20:34:18.903130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:46.976 [2024-07-22 20:34:18.904899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.236 [2024-07-22 20:34:18.913475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.236 [2024-07-22 20:34:18.914039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.236 [2024-07-22 20:34:18.914464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.236 [2024-07-22 20:34:18.914495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.236 [2024-07-22 20:34:18.914517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.236 [2024-07-22 20:34:18.914898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.236 [2024-07-22 20:34:18.915137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.236 [2024-07-22 20:34:18.915147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.236 [2024-07-22 20:34:18.915154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.236 [2024-07-22 20:34:18.916938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.236 [2024-07-22 20:34:18.925312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.236 [2024-07-22 20:34:18.925846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.236 [2024-07-22 20:34:18.926283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.236 [2024-07-22 20:34:18.926316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.236 [2024-07-22 20:34:18.926337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.236 [2024-07-22 20:34:18.926767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.236 [2024-07-22 20:34:18.927076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.236 [2024-07-22 20:34:18.927086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.236 [2024-07-22 20:34:18.927093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.236 [2024-07-22 20:34:18.928753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.236 [2024-07-22 20:34:18.937124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.236 [2024-07-22 20:34:18.937598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.236 [2024-07-22 20:34:18.937919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.236 [2024-07-22 20:34:18.937957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.236 [2024-07-22 20:34:18.937979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.236 [2024-07-22 20:34:18.938273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.236 [2024-07-22 20:34:18.938418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.236 [2024-07-22 20:34:18.938428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.236 [2024-07-22 20:34:18.938434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.236 [2024-07-22 20:34:18.940122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.236 [2024-07-22 20:34:18.948851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.236 [2024-07-22 20:34:18.949398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.236 [2024-07-22 20:34:18.949718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.236 [2024-07-22 20:34:18.949729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.236 [2024-07-22 20:34:18.949735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.236 [2024-07-22 20:34:18.949857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.236 [2024-07-22 20:34:18.949952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.236 [2024-07-22 20:34:18.949961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.236 [2024-07-22 20:34:18.949967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.236 [2024-07-22 20:34:18.951704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:18.960636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:18.961150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:18.961587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:18.961618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:18.961639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:18.961969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:18.962210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.237 [2024-07-22 20:34:18.962220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.237 [2024-07-22 20:34:18.962226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.237 [2024-07-22 20:34:18.963829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:18.972441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:18.972972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:18.973307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:18.973342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:18.973371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:18.973853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:18.974132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.237 [2024-07-22 20:34:18.974142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.237 [2024-07-22 20:34:18.974148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.237 [2024-07-22 20:34:18.976476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:18.985173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:18.985727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:18.986098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:18.986131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:18.986153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:18.986550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:18.986651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.237 [2024-07-22 20:34:18.986660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.237 [2024-07-22 20:34:18.986667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.237 [2024-07-22 20:34:18.988403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:18.996985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:18.997509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:18.997970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:18.998001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:18.998023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:18.998451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:18.998581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.237 [2024-07-22 20:34:18.998591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.237 [2024-07-22 20:34:18.998597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.237 [2024-07-22 20:34:19.000382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:19.009078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:19.009618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.010064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.010096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:19.010118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:19.010505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:19.010750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.237 [2024-07-22 20:34:19.010759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.237 [2024-07-22 20:34:19.010766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.237 [2024-07-22 20:34:19.012503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:19.020996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:19.021528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.021963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.021994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:19.022016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:19.022467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:19.022582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.237 [2024-07-22 20:34:19.022592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.237 [2024-07-22 20:34:19.022599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.237 [2024-07-22 20:34:19.024220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:19.032971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:19.033425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.033821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.033852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:19.033874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:19.034228] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:19.034330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.237 [2024-07-22 20:34:19.034339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.237 [2024-07-22 20:34:19.034345] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.237 [2024-07-22 20:34:19.036125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:19.044618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:19.045087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.045430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.045461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:19.045483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:19.045814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:19.046218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.237 [2024-07-22 20:34:19.046246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.237 [2024-07-22 20:34:19.046268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.237 [2024-07-22 20:34:19.048483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.237 [2024-07-22 20:34:19.056344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.237 [2024-07-22 20:34:19.056864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.057262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.237 [2024-07-22 20:34:19.057274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.237 [2024-07-22 20:34:19.057281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.237 [2024-07-22 20:34:19.057405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.237 [2024-07-22 20:34:19.057513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.057523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.057529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.059199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.068050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.068569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.068905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.068936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.068958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.069275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.238 [2024-07-22 20:34:19.069406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.069416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.069422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.071110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.080008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.080550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.080990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.081022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.081057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.081390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.238 [2024-07-22 20:34:19.081720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.081734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.081741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.083463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.091735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.092183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.092624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.092656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.092677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.092774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.238 [2024-07-22 20:34:19.092868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.092877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.092883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.094578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.103694] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.104219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.104524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.104555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.104577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.104905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.238 [2024-07-22 20:34:19.105000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.105010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.105016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.106698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.115716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.116226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.116638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.116670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.116691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.117135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.238 [2024-07-22 20:34:19.117469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.117494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.117521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.119370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.127467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.127979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.128344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.128378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.128400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.128832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.238 [2024-07-22 20:34:19.128972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.128982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.128988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.130733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.139339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.139879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.140294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.140328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.140350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.140566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.238 [2024-07-22 20:34:19.140697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.140706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.140712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.142379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.151231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.151749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.152184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.152217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.152239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.152673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.238 [2024-07-22 20:34:19.152902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.238 [2024-07-22 20:34:19.152911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.238 [2024-07-22 20:34:19.152917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.238 [2024-07-22 20:34:19.154698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.238 [2024-07-22 20:34:19.163093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.238 [2024-07-22 20:34:19.163584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.164023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.238 [2024-07-22 20:34:19.164070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.238 [2024-07-22 20:34:19.164094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.238 [2024-07-22 20:34:19.164475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.239 [2024-07-22 20:34:19.164906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.239 [2024-07-22 20:34:19.164931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.239 [2024-07-22 20:34:19.164952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.239 [2024-07-22 20:34:19.166704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.498 [2024-07-22 20:34:19.175079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.498 [2024-07-22 20:34:19.175545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.498 [2024-07-22 20:34:19.175728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.498 [2024-07-22 20:34:19.175739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.498 [2024-07-22 20:34:19.175745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.498 [2024-07-22 20:34:19.175839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.498 [2024-07-22 20:34:19.175947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.175955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.175961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.177751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.186811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.187327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.187700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.187732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.187754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.188099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.188483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.188507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.188528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.190535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.198522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.199032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.199441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.199474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.199496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.199937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.200033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.200048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.200055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.201981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.210295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.210846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.211244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.211277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.211299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.211680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.211963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.211988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.212008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.213741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.222094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.222601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.223002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.223033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.223070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.223450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.223683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.223708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.223729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.225620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.234195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.234674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.234995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.235007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.235014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.235076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.235178] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.235187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.235193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.236980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.245981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.246528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.246945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.246976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.246998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.247129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.247229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.247239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.247246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.248835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.257958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.258461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.258785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.258796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.258803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.258924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.259019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.259027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.259033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.260755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.269780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.270303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.270745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.270776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.270805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.270950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.271031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.271040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.271051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.272892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.281497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.499 [2024-07-22 20:34:19.282002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.282385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.499 [2024-07-22 20:34:19.282419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.499 [2024-07-22 20:34:19.282441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.499 [2024-07-22 20:34:19.282823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.499 [2024-07-22 20:34:19.283277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.499 [2024-07-22 20:34:19.283299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.499 [2024-07-22 20:34:19.283305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.499 [2024-07-22 20:34:19.284927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.499 [2024-07-22 20:34:19.293420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.293929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.294285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.294323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.294331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.294446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.294546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.294555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.294561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.296288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.305229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.305561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.305893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.305924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.305946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.306327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.306443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.306452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.306458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.308196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.317003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.317495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.317936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.317967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.317999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.318123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.318287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.318297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.318304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.320138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.328994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.329517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.329832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.329844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.329851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.329969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.330026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.330034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.330041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.331876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.340974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.341495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.341761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.341773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.341781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.341899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.341975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.341985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.341991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.343813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.352994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.353456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.353848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.353860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.353867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.353985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.354107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.354118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.354125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.355866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.364979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.365494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.365840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.365852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.365859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.365961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.366084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.366093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.366100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.367869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.377105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.377602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.377995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.378038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.378052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.378156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.378273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.378286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.378293] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.380111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.389116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.389628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.389966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.389978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.389986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.500 [2024-07-22 20:34:19.390140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.500 [2024-07-22 20:34:19.390245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.500 [2024-07-22 20:34:19.390254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.500 [2024-07-22 20:34:19.390261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.500 [2024-07-22 20:34:19.392202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.500 [2024-07-22 20:34:19.401099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.500 [2024-07-22 20:34:19.401551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.401874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.500 [2024-07-22 20:34:19.401885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.500 [2024-07-22 20:34:19.401893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.501 [2024-07-22 20:34:19.402025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.501 [2024-07-22 20:34:19.402149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.501 [2024-07-22 20:34:19.402160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.501 [2024-07-22 20:34:19.402167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.501 [2024-07-22 20:34:19.404079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.501 [2024-07-22 20:34:19.413271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.501 [2024-07-22 20:34:19.413774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.501 [2024-07-22 20:34:19.414147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.501 [2024-07-22 20:34:19.414159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.501 [2024-07-22 20:34:19.414167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.501 [2024-07-22 20:34:19.414285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.501 [2024-07-22 20:34:19.414389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.501 [2024-07-22 20:34:19.414398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.501 [2024-07-22 20:34:19.414409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.501 [2024-07-22 20:34:19.416245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.501 [2024-07-22 20:34:19.425497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.501 [2024-07-22 20:34:19.426047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.501 [2024-07-22 20:34:19.426461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.501 [2024-07-22 20:34:19.426472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.501 [2024-07-22 20:34:19.426480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.501 [2024-07-22 20:34:19.426598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.501 [2024-07-22 20:34:19.426730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.501 [2024-07-22 20:34:19.426740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.501 [2024-07-22 20:34:19.426746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.501 [2024-07-22 20:34:19.428590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.761 [2024-07-22 20:34:19.437397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.761 [2024-07-22 20:34:19.437897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.761 [2024-07-22 20:34:19.438297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.761 [2024-07-22 20:34:19.438309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.761 [2024-07-22 20:34:19.438317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.761 [2024-07-22 20:34:19.438464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.761 [2024-07-22 20:34:19.438582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.761 [2024-07-22 20:34:19.438592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.761 [2024-07-22 20:34:19.438598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.761 [2024-07-22 20:34:19.440407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.761 [2024-07-22 20:34:19.449515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.761 [2024-07-22 20:34:19.450029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.761 [2024-07-22 20:34:19.450463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.761 [2024-07-22 20:34:19.450475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.761 [2024-07-22 20:34:19.450483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.761 [2024-07-22 20:34:19.450616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.761 [2024-07-22 20:34:19.450764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.761 [2024-07-22 20:34:19.450775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.761 [2024-07-22 20:34:19.450781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.761 [2024-07-22 20:34:19.452636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.761 [2024-07-22 20:34:19.461373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.761 [2024-07-22 20:34:19.461872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.761 [2024-07-22 20:34:19.462282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.761 [2024-07-22 20:34:19.462294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.761 [2024-07-22 20:34:19.462303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.761 [2024-07-22 20:34:19.462465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.762 [2024-07-22 20:34:19.462567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.762 [2024-07-22 20:34:19.462577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.762 [2024-07-22 20:34:19.462584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.762 [2024-07-22 20:34:19.464376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.762 [2024-07-22 20:34:19.473505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.762 [2024-07-22 20:34:19.474020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.474433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.474444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.762 [2024-07-22 20:34:19.474452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.762 [2024-07-22 20:34:19.474614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.762 [2024-07-22 20:34:19.474732] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.762 [2024-07-22 20:34:19.474742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.762 [2024-07-22 20:34:19.474748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.762 [2024-07-22 20:34:19.476440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.762 [2024-07-22 20:34:19.485583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.762 [2024-07-22 20:34:19.486098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.486446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.486458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.762 [2024-07-22 20:34:19.486466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.762 [2024-07-22 20:34:19.486583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.762 [2024-07-22 20:34:19.486701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.762 [2024-07-22 20:34:19.486710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.762 [2024-07-22 20:34:19.486717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.762 [2024-07-22 20:34:19.488660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.762 [2024-07-22 20:34:19.497432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.762 [2024-07-22 20:34:19.497945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.498323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.498336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.762 [2024-07-22 20:34:19.498342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.762 [2024-07-22 20:34:19.498414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.762 [2024-07-22 20:34:19.498502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.762 [2024-07-22 20:34:19.498511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.762 [2024-07-22 20:34:19.498517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.762 [2024-07-22 20:34:19.500201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.762 [2024-07-22 20:34:19.509368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.762 [2024-07-22 20:34:19.509866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.510241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.510254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.762 [2024-07-22 20:34:19.510261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.762 [2024-07-22 20:34:19.510379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.762 [2024-07-22 20:34:19.510497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.762 [2024-07-22 20:34:19.510508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.762 [2024-07-22 20:34:19.510515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.762 [2024-07-22 20:34:19.512327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.762 [2024-07-22 20:34:19.521255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.762 [2024-07-22 20:34:19.521754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.522033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.522050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.762 [2024-07-22 20:34:19.522059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.762 [2024-07-22 20:34:19.522162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.762 [2024-07-22 20:34:19.522265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.762 [2024-07-22 20:34:19.522274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.762 [2024-07-22 20:34:19.522281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.762 [2024-07-22 20:34:19.524101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.762 [2024-07-22 20:34:19.533420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.762 [2024-07-22 20:34:19.533886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.534280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.534293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.762 [2024-07-22 20:34:19.534300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.762 [2024-07-22 20:34:19.534419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.762 [2024-07-22 20:34:19.534552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.762 [2024-07-22 20:34:19.534562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.762 [2024-07-22 20:34:19.534568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.762 [2024-07-22 20:34:19.536480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.762 [2024-07-22 20:34:19.545380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.762 [2024-07-22 20:34:19.545917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.546366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.762 [2024-07-22 20:34:19.546400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.763 [2024-07-22 20:34:19.546422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.763 [2024-07-22 20:34:19.546595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.763 [2024-07-22 20:34:19.546713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.763 [2024-07-22 20:34:19.546723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.763 [2024-07-22 20:34:19.546730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.763 [2024-07-22 20:34:19.548330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.763 [2024-07-22 20:34:19.557445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.763 [2024-07-22 20:34:19.557993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.558382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.558414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.763 [2024-07-22 20:34:19.558436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.763 [2024-07-22 20:34:19.558578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.763 [2024-07-22 20:34:19.558681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.763 [2024-07-22 20:34:19.558690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.763 [2024-07-22 20:34:19.558696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.763 [2024-07-22 20:34:19.560655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.763 [2024-07-22 20:34:19.569368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.763 [2024-07-22 20:34:19.569831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.570210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.570251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.763 [2024-07-22 20:34:19.570274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.763 [2024-07-22 20:34:19.570506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.763 [2024-07-22 20:34:19.570803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.763 [2024-07-22 20:34:19.570813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.763 [2024-07-22 20:34:19.570819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.763 [2024-07-22 20:34:19.572651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.763 [2024-07-22 20:34:19.581542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.763 [2024-07-22 20:34:19.582120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.582562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.582594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.763 [2024-07-22 20:34:19.582616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.763 [2024-07-22 20:34:19.582997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.763 [2024-07-22 20:34:19.583193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.763 [2024-07-22 20:34:19.583206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.763 [2024-07-22 20:34:19.583216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.763 [2024-07-22 20:34:19.585591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.763 [2024-07-22 20:34:19.593888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.763 [2024-07-22 20:34:19.594392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.594772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.594802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.763 [2024-07-22 20:34:19.594824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.763 [2024-07-22 20:34:19.595216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.763 [2024-07-22 20:34:19.595701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.763 [2024-07-22 20:34:19.595726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.763 [2024-07-22 20:34:19.595748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.763 [2024-07-22 20:34:19.597620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.763 [2024-07-22 20:34:19.605716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.763 [2024-07-22 20:34:19.606219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.606599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.606631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.763 [2024-07-22 20:34:19.606660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.763 [2024-07-22 20:34:19.606936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.763 [2024-07-22 20:34:19.607052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.763 [2024-07-22 20:34:19.607061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.763 [2024-07-22 20:34:19.607084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.763 [2024-07-22 20:34:19.608816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.763 [2024-07-22 20:34:19.617657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.763 [2024-07-22 20:34:19.618169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.618631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.763 [2024-07-22 20:34:19.618663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.763 [2024-07-22 20:34:19.618684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.763 [2024-07-22 20:34:19.619027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.763 [2024-07-22 20:34:19.619141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.763 [2024-07-22 20:34:19.619151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.763 [2024-07-22 20:34:19.619157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.763 [2024-07-22 20:34:19.620871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.763 [2024-07-22 20:34:19.629598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.763 [2024-07-22 20:34:19.630078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.630931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.630948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.764 [2024-07-22 20:34:19.630955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.764 [2024-07-22 20:34:19.631048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.764 [2024-07-22 20:34:19.631164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.764 [2024-07-22 20:34:19.631172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.764 [2024-07-22 20:34:19.631179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.764 [2024-07-22 20:34:19.632991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.764 [2024-07-22 20:34:19.641555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.764 [2024-07-22 20:34:19.642014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.642442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.642454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.764 [2024-07-22 20:34:19.642461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.764 [2024-07-22 20:34:19.642566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.764 [2024-07-22 20:34:19.642680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.764 [2024-07-22 20:34:19.642690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.764 [2024-07-22 20:34:19.642696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.764 [2024-07-22 20:34:19.644631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.764 [2024-07-22 20:34:19.653546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.764 [2024-07-22 20:34:19.653994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.654331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.654343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.764 [2024-07-22 20:34:19.654352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.764 [2024-07-22 20:34:19.654460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.764 [2024-07-22 20:34:19.654568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.764 [2024-07-22 20:34:19.654576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.764 [2024-07-22 20:34:19.654582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.764 [2024-07-22 20:34:19.656351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.764 [2024-07-22 20:34:19.665401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.764 [2024-07-22 20:34:19.665857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.666252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.666285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.764 [2024-07-22 20:34:19.666307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.764 [2024-07-22 20:34:19.666637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.764 [2024-07-22 20:34:19.666970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.764 [2024-07-22 20:34:19.666994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.764 [2024-07-22 20:34:19.667015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.764 [2024-07-22 20:34:19.668797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.764 [2024-07-22 20:34:19.677231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.764 [2024-07-22 20:34:19.677649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.678134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.678168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.764 [2024-07-22 20:34:19.678196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.764 [2024-07-22 20:34:19.678281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.764 [2024-07-22 20:34:19.678401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.764 [2024-07-22 20:34:19.678410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.764 [2024-07-22 20:34:19.678416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.764 [2024-07-22 20:34:19.680113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:47.764 [2024-07-22 20:34:19.689119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.764 [2024-07-22 20:34:19.689533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.689841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.764 [2024-07-22 20:34:19.689873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:47.764 [2024-07-22 20:34:19.689894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:47.764 [2024-07-22 20:34:19.690131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:47.764 [2024-07-22 20:34:19.690268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:47.764 [2024-07-22 20:34:19.690277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:47.764 [2024-07-22 20:34:19.690283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.764 [2024-07-22 20:34:19.692138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.701080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.701515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.701836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.701868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.701890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.702055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.702185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.702194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.702201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.703970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.713080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.713534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.713956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.713987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.714009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.714255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.714351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.714363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.714369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.715914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.724865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.725352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.725722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.725753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.725775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.726167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.726404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.726414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.726421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.728083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.736870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.737332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.737692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.737724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.737746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.738028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.738251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.738261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.738268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.740032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.748724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.749273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.749661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.749693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.749714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.750105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.750292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.750302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.750311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.751934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.760706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.761252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.761619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.761651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.761673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.762073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.762192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.762202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.762209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.764049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.772669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.773188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.773530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.773563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.773586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.773867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.774143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.774156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.774165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.776694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.785160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.785645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.786066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.786098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.786120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.786398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.786468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.786478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.786484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.788301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.796878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.797356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.797688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.025 [2024-07-22 20:34:19.797720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.025 [2024-07-22 20:34:19.797742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.025 [2024-07-22 20:34:19.798134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.025 [2024-07-22 20:34:19.798468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.025 [2024-07-22 20:34:19.798493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.025 [2024-07-22 20:34:19.798524] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.025 [2024-07-22 20:34:19.800238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.025 [2024-07-22 20:34:19.808825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.025 [2024-07-22 20:34:19.809306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.809744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.809774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.809796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.810139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.810540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.810549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.810556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.026 [2024-07-22 20:34:19.812263] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.026 [2024-07-22 20:34:19.820556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.026 [2024-07-22 20:34:19.821072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.821519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.821550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.821571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.821901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.822247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.822275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.822296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.026 [2024-07-22 20:34:19.824169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.026 [2024-07-22 20:34:19.832368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.026 [2024-07-22 20:34:19.832896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.833257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.833291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.833313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.833573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.833668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.833677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.833683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.026 [2024-07-22 20:34:19.835383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.026 [2024-07-22 20:34:19.844193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.026 [2024-07-22 20:34:19.844694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.845146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.845179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.845201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.845311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.845411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.845420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.845427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.026 [2024-07-22 20:34:19.847155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.026 [2024-07-22 20:34:19.855999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.026 [2024-07-22 20:34:19.856523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.856972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.857005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.857028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.857322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.857666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.857677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.857684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.026 [2024-07-22 20:34:19.859414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.026 [2024-07-22 20:34:19.867884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.026 [2024-07-22 20:34:19.868389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.868759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.868790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.868813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.869054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.869334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.869343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.869349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.026 [2024-07-22 20:34:19.871014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.026 [2024-07-22 20:34:19.879765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.026 [2024-07-22 20:34:19.880225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.880669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.880701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.880723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.881117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.881358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.881367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.881373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.026 [2024-07-22 20:34:19.882930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.026 [2024-07-22 20:34:19.891717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.026 [2024-07-22 20:34:19.892229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.892607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.892639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.892662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.892943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.893387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.893414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.893435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.026 [2024-07-22 20:34:19.895163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.026 [2024-07-22 20:34:19.903555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.026 [2024-07-22 20:34:19.903995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.904396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.026 [2024-07-22 20:34:19.904430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.026 [2024-07-22 20:34:19.904459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.026 [2024-07-22 20:34:19.904866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.026 [2024-07-22 20:34:19.904996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.026 [2024-07-22 20:34:19.905006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.026 [2024-07-22 20:34:19.905012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.027 [2024-07-22 20:34:19.906666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.027 [2024-07-22 20:34:19.915544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.027 [2024-07-22 20:34:19.916052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.027 [2024-07-22 20:34:19.916475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.027 [2024-07-22 20:34:19.916506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.027 [2024-07-22 20:34:19.916529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.027 [2024-07-22 20:34:19.916909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.027 [2024-07-22 20:34:19.917257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.027 [2024-07-22 20:34:19.917284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.027 [2024-07-22 20:34:19.917304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.027 [2024-07-22 20:34:19.919128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.027 [2024-07-22 20:34:19.927493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.027 [2024-07-22 20:34:19.928029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.027 [2024-07-22 20:34:19.928443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.027 [2024-07-22 20:34:19.928479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.027 [2024-07-22 20:34:19.928502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.027 [2024-07-22 20:34:19.928908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.027 [2024-07-22 20:34:19.929031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.027 [2024-07-22 20:34:19.929040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.027 [2024-07-22 20:34:19.929051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.027 [2024-07-22 20:34:19.930883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.027 [2024-07-22 20:34:19.939346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.027 [2024-07-22 20:34:19.939785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.027 [2024-07-22 20:34:19.940218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.027 [2024-07-22 20:34:19.940250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.027 [2024-07-22 20:34:19.940272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.027 [2024-07-22 20:34:19.940670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.027 [2024-07-22 20:34:19.940880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.027 [2024-07-22 20:34:19.940889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.027 [2024-07-22 20:34:19.940897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.027 [2024-07-22 20:34:19.942657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.027 [2024-07-22 20:34:19.951452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.027 [2024-07-22 20:34:19.951886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.027 [2024-07-22 20:34:19.952246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.027 [2024-07-22 20:34:19.952279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.027 [2024-07-22 20:34:19.952301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.027 [2024-07-22 20:34:19.952682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.027 [2024-07-22 20:34:19.952871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.027 [2024-07-22 20:34:19.952880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.027 [2024-07-22 20:34:19.952886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.027 [2024-07-22 20:34:19.954603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.287 [2024-07-22 20:34:19.963370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.287 [2024-07-22 20:34:19.963778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.287 [2024-07-22 20:34:19.964193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.287 [2024-07-22 20:34:19.964226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.287 [2024-07-22 20:34:19.964248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.287 [2024-07-22 20:34:19.964627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.287 [2024-07-22 20:34:19.964899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:19.964908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:19.964914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:19.966753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:19.975143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:19.975655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:19.976073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:19.976106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:19.976128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:19.976468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:19.976645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:19.976654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:19.976661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:19.978335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:19.987050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:19.987583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:19.988027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:19.988072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:19.988095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:19.988476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:19.989007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:19.989032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:19.989065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:19.990817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:19.998956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:19.999474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:19.999913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:19.999944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:19.999966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:20.000413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:20.000747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:20.000772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:20.000801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:20.002695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:20.011115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:20.011682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.012080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.012093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:20.012102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:20.012236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:20.012324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:20.012335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:20.012342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:20.014243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:20.023220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:20.023662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.024063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.024075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:20.024084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:20.024188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:20.024336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:20.024346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:20.024352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:20.026192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:20.036504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:20.036980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.037303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.037316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:20.037324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:20.037472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:20.037590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:20.037600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:20.037608] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:20.039311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:20.048657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:20.049163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.049513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.049523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:20.049531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:20.049646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:20.049775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:20.049784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:20.049793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:20.051418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:20.060620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:20.061132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.061568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.061579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:20.061586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:20.061730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:20.061814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:20.061824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:20.061830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:20.063581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.288 [2024-07-22 20:34:20.072593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.288 [2024-07-22 20:34:20.073134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.073537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.288 [2024-07-22 20:34:20.073548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.288 [2024-07-22 20:34:20.073555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.288 [2024-07-22 20:34:20.073663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.288 [2024-07-22 20:34:20.073813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.288 [2024-07-22 20:34:20.073822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.288 [2024-07-22 20:34:20.073828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.288 [2024-07-22 20:34:20.075653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.084481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.084996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.085410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.085422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.085429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.085531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.085645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.085653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.085660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.087431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.096412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.096906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.097345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.097378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.097402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.097783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.098024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.098033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.098039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.099681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.108180] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.108670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.109115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.109148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.109171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.109312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.109426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.109436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.109442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.111157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.120100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.120580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.120903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.120934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.120956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.121250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.121347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.121356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.121363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.123147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.131866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.132378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.132758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.132789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.132811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.132968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.133114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.133124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.133131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.134720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.143834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.144275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.144673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.144704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.144727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.145168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.145284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.145294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.145300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.147002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.155686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.156134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.156475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.156506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.156527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.156858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.157204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.157230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.157252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.159743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.168239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.168709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.169150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.169183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.169209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.169293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.169452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.169462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.169468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.171192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.180014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.180579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.180996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.181028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.289 [2024-07-22 20:34:20.181065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.289 [2024-07-22 20:34:20.181180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.289 [2024-07-22 20:34:20.181264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.289 [2024-07-22 20:34:20.181272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.289 [2024-07-22 20:34:20.181279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.289 [2024-07-22 20:34:20.183168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.289 [2024-07-22 20:34:20.191801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.289 [2024-07-22 20:34:20.192306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.192703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.289 [2024-07-22 20:34:20.192735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.290 [2024-07-22 20:34:20.192757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.290 [2024-07-22 20:34:20.193033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.290 [2024-07-22 20:34:20.193138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.290 [2024-07-22 20:34:20.193148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.290 [2024-07-22 20:34:20.193155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.290 [2024-07-22 20:34:20.194837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.290 [2024-07-22 20:34:20.203517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.290 [2024-07-22 20:34:20.204025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.290 [2024-07-22 20:34:20.204478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.290 [2024-07-22 20:34:20.204517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.290 [2024-07-22 20:34:20.204539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.290 [2024-07-22 20:34:20.204871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.290 [2024-07-22 20:34:20.205230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.290 [2024-07-22 20:34:20.205240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.290 [2024-07-22 20:34:20.205246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.290 [2024-07-22 20:34:20.206857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.290 [2024-07-22 20:34:20.215446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.290 [2024-07-22 20:34:20.215951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.290 [2024-07-22 20:34:20.216370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.290 [2024-07-22 20:34:20.216408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.290 [2024-07-22 20:34:20.216431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.290 [2024-07-22 20:34:20.216764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.290 [2024-07-22 20:34:20.217161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.290 [2024-07-22 20:34:20.217188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.290 [2024-07-22 20:34:20.217208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.290 [2024-07-22 20:34:20.219202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.550 [2024-07-22 20:34:20.227368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.550 [2024-07-22 20:34:20.227865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.550 [2024-07-22 20:34:20.228261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.550 [2024-07-22 20:34:20.228285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.550 [2024-07-22 20:34:20.228292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.550 [2024-07-22 20:34:20.228414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.550 [2024-07-22 20:34:20.228527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.550 [2024-07-22 20:34:20.228537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.550 [2024-07-22 20:34:20.228543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.550 [2024-07-22 20:34:20.230367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.550 [2024-07-22 20:34:20.239116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.550 [2024-07-22 20:34:20.239643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.550 [2024-07-22 20:34:20.240088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.550 [2024-07-22 20:34:20.240122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.550 [2024-07-22 20:34:20.240151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.550 [2024-07-22 20:34:20.240381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.550 [2024-07-22 20:34:20.240497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.550 [2024-07-22 20:34:20.240506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.550 [2024-07-22 20:34:20.240513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.550 [2024-07-22 20:34:20.242326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.550 [2024-07-22 20:34:20.251103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.550 [2024-07-22 20:34:20.251566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.550 [2024-07-22 20:34:20.252014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.550 [2024-07-22 20:34:20.252062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.550 [2024-07-22 20:34:20.252085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.550 [2024-07-22 20:34:20.252417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.550 [2024-07-22 20:34:20.252588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.550 [2024-07-22 20:34:20.252597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.550 [2024-07-22 20:34:20.252604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.550 [2024-07-22 20:34:20.254417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.550 [2024-07-22 20:34:20.263080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.550 [2024-07-22 20:34:20.263602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.550 [2024-07-22 20:34:20.264055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.550 [2024-07-22 20:34:20.264087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.550 [2024-07-22 20:34:20.264109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.550 [2024-07-22 20:34:20.264481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.550 [2024-07-22 20:34:20.264567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.550 [2024-07-22 20:34:20.264576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.264583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.266369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.274999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.275435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.275760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.275792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.275814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.276214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.551 [2024-07-22 20:34:20.276408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.551 [2024-07-22 20:34:20.276418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.276424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.278015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.286927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.287435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.287871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.287902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.287924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.288319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.551 [2024-07-22 20:34:20.288439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.551 [2024-07-22 20:34:20.288449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.288456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.290399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.298768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.299301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.299707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.299718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.299725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.299828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.551 [2024-07-22 20:34:20.299946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.551 [2024-07-22 20:34:20.299954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.299961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.302004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.310658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.311131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.311604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.311634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.311657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.311939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.551 [2024-07-22 20:34:20.312244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.551 [2024-07-22 20:34:20.312270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.312292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.314360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.322689] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.323169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.323617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.323648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.323670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.323999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.551 [2024-07-22 20:34:20.324395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.551 [2024-07-22 20:34:20.324421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.324443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.326484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.334677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.335244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.335685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.335716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.335738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.335872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.551 [2024-07-22 20:34:20.335956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.551 [2024-07-22 20:34:20.335966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.335972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.337729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.346506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.347032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.347477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.347508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.347529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.347910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.551 [2024-07-22 20:34:20.348255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.551 [2024-07-22 20:34:20.348289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.348311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.350197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.358420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.358943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.359333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.359367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.359389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.359785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.551 [2024-07-22 20:34:20.359935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.551 [2024-07-22 20:34:20.359944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.551 [2024-07-22 20:34:20.359950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.551 [2024-07-22 20:34:20.361566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.551 [2024-07-22 20:34:20.370145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.551 [2024-07-22 20:34:20.370658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.371095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.551 [2024-07-22 20:34:20.371127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.551 [2024-07-22 20:34:20.371149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.551 [2024-07-22 20:34:20.371628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.371860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.371869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.371876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.373622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.381976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.382468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.382908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.382939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.382960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.383357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.383741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.383766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.383795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.385587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.393766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.394274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.394723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.394754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.394775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.394931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.395040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.395055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.395061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.396719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.405536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.406073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.406515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.406546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.406568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.406898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.407039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.407054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.407061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.408820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.417462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.417929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.418306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.418339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.418360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.418792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.418989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.418998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.419005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.420747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.429416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.429904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.430365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.430398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.430421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.430752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.431048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.431058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.431064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.433503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.442082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.442602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.443006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.443038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.443073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.443404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.443687] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.443713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.443733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.445478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.453837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.454333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.454685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.454716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.454739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.455179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.455613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.455638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.455658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.457726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.465767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.466290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.466642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.466674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.466695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.467039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.467146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.467155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.552 [2024-07-22 20:34:20.467163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.552 [2024-07-22 20:34:20.468856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.552 [2024-07-22 20:34:20.477526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.552 [2024-07-22 20:34:20.478033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.478371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.552 [2024-07-22 20:34:20.478403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.552 [2024-07-22 20:34:20.478425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.552 [2024-07-22 20:34:20.478856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.552 [2024-07-22 20:34:20.479003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.552 [2024-07-22 20:34:20.479012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.553 [2024-07-22 20:34:20.479018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.553 [2024-07-22 20:34:20.480648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.812 [2024-07-22 20:34:20.489319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.812 [2024-07-22 20:34:20.489893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.812 [2024-07-22 20:34:20.490258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.812 [2024-07-22 20:34:20.490292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.812 [2024-07-22 20:34:20.490313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.812 [2024-07-22 20:34:20.490794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.812 [2024-07-22 20:34:20.491145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.812 [2024-07-22 20:34:20.491155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.812 [2024-07-22 20:34:20.491161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.812 [2024-07-22 20:34:20.492899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.812 [2024-07-22 20:34:20.501278] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.812 [2024-07-22 20:34:20.501737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.812 [2024-07-22 20:34:20.502141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.812 [2024-07-22 20:34:20.502153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.812 [2024-07-22 20:34:20.502160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.812 [2024-07-22 20:34:20.502282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.812 [2024-07-22 20:34:20.502391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.812 [2024-07-22 20:34:20.502399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.812 [2024-07-22 20:34:20.502406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.812 [2024-07-22 20:34:20.504225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.812 [2024-07-22 20:34:20.513306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.812 [2024-07-22 20:34:20.513814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.812 [2024-07-22 20:34:20.514251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.812 [2024-07-22 20:34:20.514284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.812 [2024-07-22 20:34:20.514306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.812 [2024-07-22 20:34:20.514737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.812 [2024-07-22 20:34:20.515020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.812 [2024-07-22 20:34:20.515056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.812 [2024-07-22 20:34:20.515077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.812 [2024-07-22 20:34:20.517050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.812 [2024-07-22 20:34:20.525155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.812 [2024-07-22 20:34:20.525672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.812 [2024-07-22 20:34:20.525937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.812 [2024-07-22 20:34:20.525969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.812 [2024-07-22 20:34:20.525990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.812 [2024-07-22 20:34:20.526236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.526368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.526377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.526383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.528204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.537059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.537607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.538007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.538060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.538084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.538663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.539104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.539132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.539152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.540836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.548960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.549480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.549846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.549877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.549898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.550057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.550187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.550197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.550203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.552039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.560857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.561410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.561851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.561882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.561905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.562054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.562153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.562163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.562169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.563934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.572722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.573146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.573585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.573617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.573646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.574003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.574150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.574160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.574167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.575938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.584491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.585005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.585381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.585414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.585437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.585584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.585706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.585716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.585722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.587406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.596327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.596828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.597220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.597254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.597284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.597400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.597499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.597509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.597515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.599268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.608312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.608830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.609171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.609183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.609191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.609309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.609429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.609438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.609444] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.611282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.620168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.620611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.621011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.621055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.621079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.621445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.621546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.621555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.621561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.813 [2024-07-22 20:34:20.623271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.813 [2024-07-22 20:34:20.632092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.813 [2024-07-22 20:34:20.632601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.632975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.813 [2024-07-22 20:34:20.633006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.813 [2024-07-22 20:34:20.633028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.813 [2024-07-22 20:34:20.633473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.813 [2024-07-22 20:34:20.633644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.813 [2024-07-22 20:34:20.633657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.813 [2024-07-22 20:34:20.633666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.636171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 [2024-07-22 20:34:20.644182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.644670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.645099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.645112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.645119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.645203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.645331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.645340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.645346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.646960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 [2024-07-22 20:34:20.656062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.656595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.657061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.657093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.657115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.657448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.657635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.657644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.657651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.659486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 [2024-07-22 20:34:20.668074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.668596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.668826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.668856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.668878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.669321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.669704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.669730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.669737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.671514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 [2024-07-22 20:34:20.679953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.680403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.680710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.680742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.680763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.681208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.681376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.681386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.681396] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.683238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 [2024-07-22 20:34:20.691907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.692430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.692795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.692826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.692848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.693243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.693596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.693605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.693612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.695597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 [2024-07-22 20:34:20.703691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.704215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.704579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.704611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.704634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.704755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.704891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.704900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.704906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.706628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 [2024-07-22 20:34:20.715465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.715979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.716406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.716438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.716460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.716830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.716916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.716926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.716932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.718488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 [2024-07-22 20:34:20.727390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.727878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.728324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.728358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.728380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.728525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.728634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.728643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.728649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.814 [2024-07-22 20:34:20.730213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.814 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3577152 Killed "${NVMF_APP[@]}" "$@" 00:28:48.814 20:34:20 -- host/bdevperf.sh@36 -- # tgt_init 00:28:48.814 20:34:20 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:28:48.814 20:34:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:48.814 20:34:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:48.814 20:34:20 -- common/autotest_common.sh@10 -- # set +x 00:28:48.814 [2024-07-22 20:34:20.739290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:48.814 [2024-07-22 20:34:20.739787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.740102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.814 [2024-07-22 20:34:20.740114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:48.814 [2024-07-22 20:34:20.740122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:48.814 [2024-07-22 20:34:20.740239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:48.814 [2024-07-22 20:34:20.740327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:48.814 [2024-07-22 20:34:20.740336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:48.814 [2024-07-22 20:34:20.740343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:48.815 20:34:20 -- nvmf/common.sh@469 -- # nvmfpid=3578590 00:28:48.815 20:34:20 -- nvmf/common.sh@470 -- # waitforlisten 3578590 00:28:48.815 20:34:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:48.815 20:34:20 -- common/autotest_common.sh@819 -- # '[' -z 3578590 ']' 00:28:48.815 20:34:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:48.815 20:34:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:48.815 [2024-07-22 20:34:20.742258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:48.815 20:34:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:48.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:48.815 20:34:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:48.815 20:34:20 -- common/autotest_common.sh@10 -- # set +x 00:28:49.075 [2024-07-22 20:34:20.751361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.075 [2024-07-22 20:34:20.751778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.075 [2024-07-22 20:34:20.752173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.075 [2024-07-22 20:34:20.752185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.075 [2024-07-22 20:34:20.752193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.075 [2024-07-22 20:34:20.752342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.075 [2024-07-22 20:34:20.752490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.075 [2024-07-22 20:34:20.752499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.075 [2024-07-22 20:34:20.752506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.075 [2024-07-22 20:34:20.754314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.075 [2024-07-22 20:34:20.763438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.075 [2024-07-22 20:34:20.763877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.075 [2024-07-22 20:34:20.764255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.075 [2024-07-22 20:34:20.764267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.075 [2024-07-22 20:34:20.764275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.075 [2024-07-22 20:34:20.764438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.075 [2024-07-22 20:34:20.764557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.075 [2024-07-22 20:34:20.764567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.075 [2024-07-22 20:34:20.764574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.075 [2024-07-22 20:34:20.766439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.075 [2024-07-22 20:34:20.775485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.075 [2024-07-22 20:34:20.776097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.075 [2024-07-22 20:34:20.776472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.075 [2024-07-22 20:34:20.776485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.075 [2024-07-22 20:34:20.776493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.075 [2024-07-22 20:34:20.776627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.075 [2024-07-22 20:34:20.776789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.075 [2024-07-22 20:34:20.776800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.075 [2024-07-22 20:34:20.776806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.778630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.784485] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:28:49.076 [2024-07-22 20:34:20.784523] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:49.076 [2024-07-22 20:34:20.787400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.787780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.788104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.788116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.788124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 [2024-07-22 20:34:20.788254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.788383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.076 [2024-07-22 20:34:20.788392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.076 [2024-07-22 20:34:20.788399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.790132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.799235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.799623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.799994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.800005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.800012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 [2024-07-22 20:34:20.800131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.800246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.076 [2024-07-22 20:34:20.800255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.076 [2024-07-22 20:34:20.800262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.802149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.811118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.811585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.811892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.811903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.811911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 EAL: No free 2048 kB hugepages reported on node 1 00:28:49.076 [2024-07-22 20:34:20.812064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.812197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.076 [2024-07-22 20:34:20.812207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.076 [2024-07-22 20:34:20.812213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.814051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.823137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.823594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.823896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.823907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.823914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 [2024-07-22 20:34:20.824051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.824170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.076 [2024-07-22 20:34:20.824180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.076 [2024-07-22 20:34:20.824186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.825965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.835291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.835726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.836056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.836068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.836076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 [2024-07-22 20:34:20.836150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.836267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.076 [2024-07-22 20:34:20.836276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.076 [2024-07-22 20:34:20.836282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.838269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.842503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:49.076 [2024-07-22 20:34:20.847136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.847585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.847924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.847936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.847943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 [2024-07-22 20:34:20.848093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.848194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.076 [2024-07-22 20:34:20.848203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.076 [2024-07-22 20:34:20.848210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.850006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.859265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.859686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.859969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.859980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.859988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 [2024-07-22 20:34:20.860136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.860222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.076 [2024-07-22 20:34:20.860230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.076 [2024-07-22 20:34:20.860237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.862090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.871012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.871426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.871689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.871700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.871709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 [2024-07-22 20:34:20.871809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.871968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.076 [2024-07-22 20:34:20.871977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.076 [2024-07-22 20:34:20.871983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.076 [2024-07-22 20:34:20.873869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.076 [2024-07-22 20:34:20.882807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.076 [2024-07-22 20:34:20.883244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.883571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.076 [2024-07-22 20:34:20.883583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.076 [2024-07-22 20:34:20.883591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.076 [2024-07-22 20:34:20.883721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.076 [2024-07-22 20:34:20.883851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.077 [2024-07-22 20:34:20.883861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.077 [2024-07-22 20:34:20.883867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.077 [2024-07-22 20:34:20.885580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.077 [2024-07-22 20:34:20.894756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.077 [2024-07-22 20:34:20.895100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.895430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.895441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.077 [2024-07-22 20:34:20.895448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.077 [2024-07-22 20:34:20.895549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.077 [2024-07-22 20:34:20.895665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.077 [2024-07-22 20:34:20.895675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.077 [2024-07-22 20:34:20.895682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.077 [2024-07-22 20:34:20.897524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.077 [2024-07-22 20:34:20.906977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.077 [2024-07-22 20:34:20.907489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.907845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.907856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.077 [2024-07-22 20:34:20.907864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.077 [2024-07-22 20:34:20.907998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.077 [2024-07-22 20:34:20.908138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.077 [2024-07-22 20:34:20.908148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.077 [2024-07-22 20:34:20.908155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.077 [2024-07-22 20:34:20.909974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.077 [2024-07-22 20:34:20.919060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.077 [2024-07-22 20:34:20.919426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.919697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.919708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.077 [2024-07-22 20:34:20.919715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.077 [2024-07-22 20:34:20.919788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.077 [2024-07-22 20:34:20.919937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.077 [2024-07-22 20:34:20.919946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.077 [2024-07-22 20:34:20.919953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.077 [2024-07-22 20:34:20.920710] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:49.077 [2024-07-22 20:34:20.920808] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:49.077 [2024-07-22 20:34:20.920818] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:49.077 [2024-07-22 20:34:20.920825] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:49.077 [2024-07-22 20:34:20.920866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:49.077 [2024-07-22 20:34:20.920951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:49.077 [2024-07-22 20:34:20.920952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:49.077 [2024-07-22 20:34:20.921702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.077 [2024-07-22 20:34:20.931052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.077 [2024-07-22 20:34:20.931614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.931897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.931909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.077 [2024-07-22 20:34:20.931918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.077 [2024-07-22 20:34:20.932075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.077 [2024-07-22 20:34:20.932195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.077 [2024-07-22 20:34:20.932205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.077 [2024-07-22 20:34:20.932212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.077 [2024-07-22 20:34:20.933866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.077 [2024-07-22 20:34:20.943346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.077 [2024-07-22 20:34:20.943769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.944067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.944080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.077 [2024-07-22 20:34:20.944090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.077 [2024-07-22 20:34:20.944227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.077 [2024-07-22 20:34:20.944346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.077 [2024-07-22 20:34:20.944356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.077 [2024-07-22 20:34:20.944365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.077 [2024-07-22 20:34:20.946202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.077 [2024-07-22 20:34:20.955337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.077 [2024-07-22 20:34:20.955755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.956064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.956077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.077 [2024-07-22 20:34:20.956085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.077 [2024-07-22 20:34:20.956206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.077 [2024-07-22 20:34:20.956296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.077 [2024-07-22 20:34:20.956305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.077 [2024-07-22 20:34:20.956319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.077 [2024-07-22 20:34:20.958112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.077 [2024-07-22 20:34:20.967216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.077 [2024-07-22 20:34:20.967760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.968093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.077 [2024-07-22 20:34:20.968105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.077 [2024-07-22 20:34:20.968115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.077 [2024-07-22 20:34:20.968220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.078 [2024-07-22 20:34:20.968353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.078 [2024-07-22 20:34:20.968363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.078 [2024-07-22 20:34:20.968370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.078 [2024-07-22 20:34:20.970267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.078 [2024-07-22 20:34:20.979257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.078 [2024-07-22 20:34:20.979709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.078 [2024-07-22 20:34:20.980041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.078 [2024-07-22 20:34:20.980059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.078 [2024-07-22 20:34:20.980067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.078 [2024-07-22 20:34:20.980171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.078 [2024-07-22 20:34:20.980290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.078 [2024-07-22 20:34:20.980300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.078 [2024-07-22 20:34:20.980307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.078 [2024-07-22 20:34:20.982056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.078 [2024-07-22 20:34:20.991358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.078 [2024-07-22 20:34:20.991842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.078 [2024-07-22 20:34:20.992165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.078 [2024-07-22 20:34:20.992178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.078 [2024-07-22 20:34:20.992186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.078 [2024-07-22 20:34:20.992304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.078 [2024-07-22 20:34:20.992437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.078 [2024-07-22 20:34:20.992447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.078 [2024-07-22 20:34:20.992454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.078 [2024-07-22 20:34:20.994100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.078 [2024-07-22 20:34:21.003178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.078 [2024-07-22 20:34:21.003604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.078 [2024-07-22 20:34:21.003927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.078 [2024-07-22 20:34:21.003938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.078 [2024-07-22 20:34:21.003946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.078 [2024-07-22 20:34:21.004017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.078 [2024-07-22 20:34:21.004155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.078 [2024-07-22 20:34:21.004165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.078 [2024-07-22 20:34:21.004173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.078 [2024-07-22 20:34:21.005944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.338 [2024-07-22 20:34:21.015285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.338 [2024-07-22 20:34:21.015686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.015886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.015899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.338 [2024-07-22 20:34:21.015906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.338 [2024-07-22 20:34:21.016040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.338 [2024-07-22 20:34:21.016148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.338 [2024-07-22 20:34:21.016159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.338 [2024-07-22 20:34:21.016166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.338 [2024-07-22 20:34:21.017894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.338 [2024-07-22 20:34:21.027234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.338 [2024-07-22 20:34:21.027669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.027998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.028010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.338 [2024-07-22 20:34:21.028017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.338 [2024-07-22 20:34:21.028141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.338 [2024-07-22 20:34:21.028260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.338 [2024-07-22 20:34:21.028269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.338 [2024-07-22 20:34:21.028276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.338 [2024-07-22 20:34:21.030134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.338 [2024-07-22 20:34:21.039299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.338 [2024-07-22 20:34:21.039758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.040087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.040099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.338 [2024-07-22 20:34:21.040108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.338 [2024-07-22 20:34:21.040257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.338 [2024-07-22 20:34:21.040374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.338 [2024-07-22 20:34:21.040384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.338 [2024-07-22 20:34:21.040392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.338 [2024-07-22 20:34:21.042166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.338 [2024-07-22 20:34:21.051466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.338 [2024-07-22 20:34:21.051867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.052190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.052203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.338 [2024-07-22 20:34:21.052211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.338 [2024-07-22 20:34:21.052374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.338 [2024-07-22 20:34:21.052524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.338 [2024-07-22 20:34:21.052533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.338 [2024-07-22 20:34:21.052540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.338 [2024-07-22 20:34:21.054151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.338 [2024-07-22 20:34:21.063562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.338 [2024-07-22 20:34:21.063973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.064306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.064319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.338 [2024-07-22 20:34:21.064327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.338 [2024-07-22 20:34:21.064429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.338 [2024-07-22 20:34:21.064577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.338 [2024-07-22 20:34:21.064587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.338 [2024-07-22 20:34:21.064593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.338 [2024-07-22 20:34:21.066359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.338 [2024-07-22 20:34:21.075665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.338 [2024-07-22 20:34:21.076097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.076446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.076457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.338 [2024-07-22 20:34:21.076464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.338 [2024-07-22 20:34:21.076597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.338 [2024-07-22 20:34:21.076685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.338 [2024-07-22 20:34:21.076695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.338 [2024-07-22 20:34:21.076702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.338 [2024-07-22 20:34:21.078554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.338 [2024-07-22 20:34:21.087752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.338 [2024-07-22 20:34:21.088253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.338 [2024-07-22 20:34:21.088580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.088592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.088599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.088748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.088836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.088845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.088852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.090661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.099714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.100209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.100536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.100548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.100555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.100718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.100851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.100861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.100867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.102614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.111739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.112207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.112474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.112489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.112496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.112629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.112762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.112772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.112779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.114642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.123786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.124220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.124499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.124511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.124518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.124621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.124739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.124748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.124755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.126545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.135784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.136179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.136458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.136469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.136477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.136611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.136744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.136753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.136760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.138569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.147873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.148292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.148613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.148625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.148639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.148726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.148845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.148853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.148859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.150651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.160036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.160534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.160845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.160857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.160864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.160966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.161073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.161083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.161090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.162803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.172074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.172447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.172841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.172852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.172860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.172993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.173102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.173112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.173119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.174876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.184086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.184555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.184875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.184887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.184894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.339 [2024-07-22 20:34:21.185000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.339 [2024-07-22 20:34:21.185154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.339 [2024-07-22 20:34:21.185164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.339 [2024-07-22 20:34:21.185170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.339 [2024-07-22 20:34:21.187016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.339 [2024-07-22 20:34:21.195881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.339 [2024-07-22 20:34:21.196318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.196712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.339 [2024-07-22 20:34:21.196724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.339 [2024-07-22 20:34:21.196732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.340 [2024-07-22 20:34:21.196850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.340 [2024-07-22 20:34:21.197013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.340 [2024-07-22 20:34:21.197023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.340 [2024-07-22 20:34:21.197029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.340 [2024-07-22 20:34:21.198816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.340 [2024-07-22 20:34:21.207741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.340 [2024-07-22 20:34:21.208083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.208429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.208441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.340 [2024-07-22 20:34:21.208448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.340 [2024-07-22 20:34:21.208550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.340 [2024-07-22 20:34:21.208623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.340 [2024-07-22 20:34:21.208631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.340 [2024-07-22 20:34:21.208638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.340 [2024-07-22 20:34:21.210551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.340 [2024-07-22 20:34:21.219888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.340 [2024-07-22 20:34:21.220443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.220831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.220843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.340 [2024-07-22 20:34:21.220850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.340 [2024-07-22 20:34:21.220998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.340 [2024-07-22 20:34:21.221138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.340 [2024-07-22 20:34:21.221148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.340 [2024-07-22 20:34:21.221154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.340 [2024-07-22 20:34:21.222960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.340 [2024-07-22 20:34:21.231922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.340 [2024-07-22 20:34:21.232453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.232851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.232863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.340 [2024-07-22 20:34:21.232870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.340 [2024-07-22 20:34:21.232988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.340 [2024-07-22 20:34:21.233095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.340 [2024-07-22 20:34:21.233104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.340 [2024-07-22 20:34:21.233111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.340 [2024-07-22 20:34:21.234853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.340 [2024-07-22 20:34:21.244064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.340 [2024-07-22 20:34:21.244571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.244883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.244894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.340 [2024-07-22 20:34:21.244902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.340 [2024-07-22 20:34:21.245034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.340 [2024-07-22 20:34:21.245142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.340 [2024-07-22 20:34:21.245152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.340 [2024-07-22 20:34:21.245159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.340 [2024-07-22 20:34:21.246981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.340 [2024-07-22 20:34:21.256045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.340 [2024-07-22 20:34:21.256571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.256941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.256953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.340 [2024-07-22 20:34:21.256960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.340 [2024-07-22 20:34:21.257107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.340 [2024-07-22 20:34:21.257181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.340 [2024-07-22 20:34:21.257194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.340 [2024-07-22 20:34:21.257200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.340 [2024-07-22 20:34:21.259019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.340 [2024-07-22 20:34:21.268035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.340 [2024-07-22 20:34:21.268552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.268872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.340 [2024-07-22 20:34:21.268884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.340 [2024-07-22 20:34:21.268892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.340 [2024-07-22 20:34:21.269010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.340 [2024-07-22 20:34:21.269133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.340 [2024-07-22 20:34:21.269142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.340 [2024-07-22 20:34:21.269150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.340 [2024-07-22 20:34:21.271184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.600 [2024-07-22 20:34:21.279984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.600 [2024-07-22 20:34:21.280444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.280841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.280853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.600 [2024-07-22 20:34:21.280860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.600 [2024-07-22 20:34:21.280963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.600 [2024-07-22 20:34:21.281100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.600 [2024-07-22 20:34:21.281110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.600 [2024-07-22 20:34:21.281116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.600 [2024-07-22 20:34:21.282916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.600 [2024-07-22 20:34:21.291782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.600 [2024-07-22 20:34:21.292281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.292675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.292687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.600 [2024-07-22 20:34:21.292694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.600 [2024-07-22 20:34:21.292828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.600 [2024-07-22 20:34:21.292962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.600 [2024-07-22 20:34:21.292971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.600 [2024-07-22 20:34:21.292981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.600 [2024-07-22 20:34:21.294667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.600 [2024-07-22 20:34:21.303688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.600 [2024-07-22 20:34:21.304209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.304530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.304542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.600 [2024-07-22 20:34:21.304549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.600 [2024-07-22 20:34:21.304713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.600 [2024-07-22 20:34:21.304846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.600 [2024-07-22 20:34:21.304856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.600 [2024-07-22 20:34:21.304862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.600 [2024-07-22 20:34:21.306696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.600 [2024-07-22 20:34:21.315416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.600 [2024-07-22 20:34:21.315956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.316348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.316360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.600 [2024-07-22 20:34:21.316368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.600 [2024-07-22 20:34:21.316484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.600 [2024-07-22 20:34:21.316587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.600 [2024-07-22 20:34:21.316597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.600 [2024-07-22 20:34:21.316603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.600 [2024-07-22 20:34:21.318363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.600 [2024-07-22 20:34:21.327444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.600 [2024-07-22 20:34:21.327947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.328276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.328289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.600 [2024-07-22 20:34:21.328296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.600 [2024-07-22 20:34:21.328398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.600 [2024-07-22 20:34:21.328531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.600 [2024-07-22 20:34:21.328540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.600 [2024-07-22 20:34:21.328547] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.600 [2024-07-22 20:34:21.330404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.600 [2024-07-22 20:34:21.339581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.600 [2024-07-22 20:34:21.340091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.340440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.600 [2024-07-22 20:34:21.340452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.600 [2024-07-22 20:34:21.340460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.600 [2024-07-22 20:34:21.340608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.600 [2024-07-22 20:34:21.340726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.600 [2024-07-22 20:34:21.340736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.600 [2024-07-22 20:34:21.340742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.600 [2024-07-22 20:34:21.342667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.600 [2024-07-22 20:34:21.351617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.352153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.352546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.352558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.352566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.352699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.352817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.352826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.352833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.354652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.363438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.363961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.364334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.364346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.364355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.364488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.364606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.364615] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.364622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.366474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.375329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.375853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.376186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.376199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.376206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.376340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.376443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.376453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.376459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.378228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.387276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.387807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.388178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.388190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.388197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.388346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.388463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.388473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.388480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.390271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.399415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.399963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.400284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.400296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.400304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.400407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.400524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.400533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.400539] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.402344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.411354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.411822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.412216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.412228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.412237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.412372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.412490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.412499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.412505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.414237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.423409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.423866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.424255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.424276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.424284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.424403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.424506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.424516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.424522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.426329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.435413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.435888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.436285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.436297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.436304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.436468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.436571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.436581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.436589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.438514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.447624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.448125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.448448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.601 [2024-07-22 20:34:21.448464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.601 [2024-07-22 20:34:21.448472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.601 [2024-07-22 20:34:21.448576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.601 [2024-07-22 20:34:21.448648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.601 [2024-07-22 20:34:21.448657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.601 [2024-07-22 20:34:21.448664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.601 [2024-07-22 20:34:21.450587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.601 [2024-07-22 20:34:21.459757] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.601 [2024-07-22 20:34:21.460239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.460635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.460647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.602 [2024-07-22 20:34:21.460654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.602 [2024-07-22 20:34:21.460773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.602 [2024-07-22 20:34:21.460846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.602 [2024-07-22 20:34:21.460855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.602 [2024-07-22 20:34:21.460862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.602 [2024-07-22 20:34:21.462754] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.602 [2024-07-22 20:34:21.471791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.602 [2024-07-22 20:34:21.472299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.472699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.472711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.602 [2024-07-22 20:34:21.472718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.602 [2024-07-22 20:34:21.472836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.602 [2024-07-22 20:34:21.472969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.602 [2024-07-22 20:34:21.472979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.602 [2024-07-22 20:34:21.472985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.602 [2024-07-22 20:34:21.474778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.602 [2024-07-22 20:34:21.483728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.602 [2024-07-22 20:34:21.484251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.484525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.484537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.602 [2024-07-22 20:34:21.484548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.602 [2024-07-22 20:34:21.484651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.602 [2024-07-22 20:34:21.484769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.602 [2024-07-22 20:34:21.484778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.602 [2024-07-22 20:34:21.484785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.602 [2024-07-22 20:34:21.486562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.602 [2024-07-22 20:34:21.495744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.602 [2024-07-22 20:34:21.496290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.496633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.496645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.602 [2024-07-22 20:34:21.496652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.602 [2024-07-22 20:34:21.496755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.602 [2024-07-22 20:34:21.496873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.602 [2024-07-22 20:34:21.496882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.602 [2024-07-22 20:34:21.496890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.602 [2024-07-22 20:34:21.498723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.602 [2024-07-22 20:34:21.507759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.602 [2024-07-22 20:34:21.508229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.508580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.508592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.602 [2024-07-22 20:34:21.508599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.602 [2024-07-22 20:34:21.508701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.602 [2024-07-22 20:34:21.508819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.602 [2024-07-22 20:34:21.508827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.602 [2024-07-22 20:34:21.508834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.602 [2024-07-22 20:34:21.510776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.602 [2024-07-22 20:34:21.519738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.602 [2024-07-22 20:34:21.520188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.520444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.520456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.602 [2024-07-22 20:34:21.520464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.602 [2024-07-22 20:34:21.520601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.602 [2024-07-22 20:34:21.520703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.602 [2024-07-22 20:34:21.520713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.602 [2024-07-22 20:34:21.520720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.602 [2024-07-22 20:34:21.522417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.602 [2024-07-22 20:34:21.531786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.602 [2024-07-22 20:34:21.532201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.532521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.602 [2024-07-22 20:34:21.532533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.602 [2024-07-22 20:34:21.532540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.602 [2024-07-22 20:34:21.532674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.602 [2024-07-22 20:34:21.532746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.602 [2024-07-22 20:34:21.532755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.602 [2024-07-22 20:34:21.532761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.602 [2024-07-22 20:34:21.534628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.862 [2024-07-22 20:34:21.543851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.862 [2024-07-22 20:34:21.544366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.544559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.544570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.862 [2024-07-22 20:34:21.544578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.862 [2024-07-22 20:34:21.544695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.862 [2024-07-22 20:34:21.544797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.862 [2024-07-22 20:34:21.544807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.862 [2024-07-22 20:34:21.544814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.862 [2024-07-22 20:34:21.546620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.862 [2024-07-22 20:34:21.555935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.862 [2024-07-22 20:34:21.556439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.556855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.556867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.862 [2024-07-22 20:34:21.556875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.862 [2024-07-22 20:34:21.557007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.862 [2024-07-22 20:34:21.557130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.862 [2024-07-22 20:34:21.557144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.862 [2024-07-22 20:34:21.557151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.862 [2024-07-22 20:34:21.558893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.862 [2024-07-22 20:34:21.567976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.862 [2024-07-22 20:34:21.568520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.568913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.568925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.862 [2024-07-22 20:34:21.568932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.862 [2024-07-22 20:34:21.569055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.862 [2024-07-22 20:34:21.569174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.862 [2024-07-22 20:34:21.569183] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.862 [2024-07-22 20:34:21.569189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.862 [2024-07-22 20:34:21.571069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.862 [2024-07-22 20:34:21.580008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.862 [2024-07-22 20:34:21.580516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.580837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.580848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.862 [2024-07-22 20:34:21.580855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.862 [2024-07-22 20:34:21.580988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.862 [2024-07-22 20:34:21.581079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.862 [2024-07-22 20:34:21.581088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.862 [2024-07-22 20:34:21.581095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.862 [2024-07-22 20:34:21.582941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.862 [2024-07-22 20:34:21.592051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.862 [2024-07-22 20:34:21.592566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.592931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.592943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.862 [2024-07-22 20:34:21.592950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.862 [2024-07-22 20:34:21.593058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.862 [2024-07-22 20:34:21.593130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.862 [2024-07-22 20:34:21.593138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.862 [2024-07-22 20:34:21.593149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.862 [2024-07-22 20:34:21.595070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.862 20:34:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:49.862 20:34:21 -- common/autotest_common.sh@852 -- # return 0 00:28:49.862 20:34:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:49.862 20:34:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:49.862 20:34:21 -- common/autotest_common.sh@10 -- # set +x 00:28:49.862 [2024-07-22 20:34:21.603923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.862 [2024-07-22 20:34:21.604448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.604776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.604788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.862 [2024-07-22 20:34:21.604795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.862 [2024-07-22 20:34:21.604912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.862 [2024-07-22 20:34:21.605029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.862 [2024-07-22 20:34:21.605038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.862 [2024-07-22 20:34:21.605050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.862 [2024-07-22 20:34:21.606807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.862 [2024-07-22 20:34:21.615928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.862 [2024-07-22 20:34:21.616458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.616783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.616795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.862 [2024-07-22 20:34:21.616803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.862 [2024-07-22 20:34:21.616876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.862 [2024-07-22 20:34:21.617025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.862 [2024-07-22 20:34:21.617033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.862 [2024-07-22 20:34:21.617039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.862 [2024-07-22 20:34:21.618905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.862 [2024-07-22 20:34:21.627807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.862 [2024-07-22 20:34:21.628306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.628524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.862 [2024-07-22 20:34:21.628536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.863 [2024-07-22 20:34:21.628543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.863 [2024-07-22 20:34:21.628677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.863 [2024-07-22 20:34:21.628764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.863 [2024-07-22 20:34:21.628775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.863 [2024-07-22 20:34:21.628782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.863 [2024-07-22 20:34:21.630621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.863 20:34:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:49.863 20:34:21 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:49.863 20:34:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:49.863 20:34:21 -- common/autotest_common.sh@10 -- # set +x 00:28:49.863 [2024-07-22 20:34:21.636752] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:49.863 [2024-07-22 20:34:21.639721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.863 [2024-07-22 20:34:21.640219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.640544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.640555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.863 [2024-07-22 20:34:21.640562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.863 [2024-07-22 20:34:21.640695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.863 [2024-07-22 20:34:21.640842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.863 [2024-07-22 20:34:21.640851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.863 [2024-07-22 20:34:21.640858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.863 20:34:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:49.863 20:34:21 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:49.863 20:34:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:49.863 20:34:21 -- common/autotest_common.sh@10 -- # set +x 00:28:49.863 [2024-07-22 20:34:21.642692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.863 [2024-07-22 20:34:21.651745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.863 [2024-07-22 20:34:21.652233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.652631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.652643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.863 [2024-07-22 20:34:21.652650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.863 [2024-07-22 20:34:21.652783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.863 [2024-07-22 20:34:21.652931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.863 [2024-07-22 20:34:21.652941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.863 [2024-07-22 20:34:21.652947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.863 [2024-07-22 20:34:21.654990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.863 [2024-07-22 20:34:21.663781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.863 [2024-07-22 20:34:21.664402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.664777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.664792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.863 [2024-07-22 20:34:21.664800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.863 [2024-07-22 20:34:21.664949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.863 [2024-07-22 20:34:21.665056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.863 [2024-07-22 20:34:21.665067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.863 [2024-07-22 20:34:21.665076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.863 [2024-07-22 20:34:21.666775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.863 Malloc0 00:28:49.863 20:34:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:49.863 [2024-07-22 20:34:21.675708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.863 20:34:21 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:49.863 20:34:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:49.863 [2024-07-22 20:34:21.676226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 20:34:21 -- common/autotest_common.sh@10 -- # set +x 00:28:49.863 [2024-07-22 20:34:21.676559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.676572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.863 [2024-07-22 20:34:21.676579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.863 [2024-07-22 20:34:21.676699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.863 [2024-07-22 20:34:21.676816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.863 [2024-07-22 20:34:21.676826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.863 [2024-07-22 20:34:21.676833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.863 [2024-07-22 20:34:21.678634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.863 20:34:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:49.863 20:34:21 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:49.863 20:34:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:49.863 [2024-07-22 20:34:21.687869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.863 20:34:21 -- common/autotest_common.sh@10 -- # set +x 00:28:49.863 [2024-07-22 20:34:21.688443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.688857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:49.863 [2024-07-22 20:34:21.688868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4c900 with addr=10.0.0.2, port=4420 00:28:49.863 [2024-07-22 20:34:21.688876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4c900 is same with the state(5) to be set 00:28:49.863 [2024-07-22 20:34:21.688947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4c900 (9): Bad file descriptor 00:28:49.863 [2024-07-22 20:34:21.689035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:28:49.863 [2024-07-22 20:34:21.689048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:28:49.863 [2024-07-22 20:34:21.689055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.863 [2024-07-22 20:34:21.690920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:49.863 20:34:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:49.863 20:34:21 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:49.863 20:34:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:49.863 20:34:21 -- common/autotest_common.sh@10 -- # set +x 00:28:49.863 [2024-07-22 20:34:21.698664] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:49.863 [2024-07-22 20:34:21.700006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.863 20:34:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:49.863 20:34:21 -- host/bdevperf.sh@38 -- # wait 3577647 00:28:50.122 [2024-07-22 20:34:21.858655] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:58.254 00:28:58.254 Latency(us) 00:28:58.254 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:58.254 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:58.254 Verification LBA range: start 0x0 length 0x4000 00:28:58.254 Nvme1n1 : 15.01 12277.59 47.96 19089.64 0.00 4068.79 1175.37 15956.59 00:28:58.254 =================================================================================================================== 00:28:58.254 Total : 12277.59 47.96 19089.64 0.00 4068.79 1175.37 15956.59 00:28:58.528 20:34:30 -- host/bdevperf.sh@39 -- # sync 00:28:58.528 20:34:30 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:58.528 20:34:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:58.528 20:34:30 -- common/autotest_common.sh@10 -- # set +x 00:28:58.528 20:34:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:58.528 20:34:30 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:28:58.528 20:34:30 -- host/bdevperf.sh@44 -- # nvmftestfini 00:28:58.528 20:34:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:58.528 20:34:30 -- nvmf/common.sh@116 -- # sync 00:28:58.528 20:34:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:58.528 20:34:30 -- nvmf/common.sh@119 -- # set +e 00:28:58.528 20:34:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:58.528 20:34:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:58.528 rmmod nvme_tcp 00:28:58.528 rmmod nvme_fabrics 00:28:58.528 rmmod nvme_keyring 00:28:58.528 20:34:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:58.528 20:34:30 -- nvmf/common.sh@123 -- # set -e 00:28:58.528 20:34:30 -- nvmf/common.sh@124 -- # return 0 00:28:58.528 20:34:30 -- nvmf/common.sh@477 -- # '[' -n 3578590 ']' 00:28:58.528 20:34:30 -- nvmf/common.sh@478 -- # killprocess 3578590 00:28:58.528 20:34:30 -- common/autotest_common.sh@926 -- # '[' -z 3578590 ']' 00:28:58.528 20:34:30 -- common/autotest_common.sh@930 -- # kill -0 3578590 00:28:58.528 20:34:30 -- common/autotest_common.sh@931 -- # uname 00:28:58.528 20:34:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:58.528 20:34:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3578590 00:28:58.528 20:34:30 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:58.528 20:34:30 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:58.528 20:34:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3578590' 00:28:58.528 killing process with pid 3578590 00:28:58.528 20:34:30 -- common/autotest_common.sh@945 -- # kill 3578590 00:28:58.528 20:34:30 -- common/autotest_common.sh@950 -- # wait 3578590 00:28:58.787 20:34:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:58.787 20:34:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:58.787 20:34:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:58.787 20:34:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:58.787 20:34:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:58.787 20:34:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:58.787 20:34:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:58.787 20:34:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:01.320 20:34:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:01.320 00:29:01.320 real 0m25.898s 00:29:01.320 user 1m2.627s 00:29:01.320 sys 0m6.071s 00:29:01.320 20:34:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:01.320 20:34:32 -- common/autotest_common.sh@10 -- # set +x 00:29:01.320 ************************************ 00:29:01.320 END TEST nvmf_bdevperf 00:29:01.320 ************************************ 00:29:01.320 20:34:32 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:29:01.320 20:34:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:01.320 20:34:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:01.320 20:34:32 -- common/autotest_common.sh@10 -- # set +x 00:29:01.320 ************************************ 00:29:01.320 START TEST nvmf_target_disconnect 00:29:01.320 ************************************ 00:29:01.320 20:34:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:29:01.320 * Looking for test storage... 00:29:01.320 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:01.320 20:34:32 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:01.320 20:34:32 -- nvmf/common.sh@7 -- # uname -s 00:29:01.320 20:34:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:01.320 20:34:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:01.320 20:34:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:01.320 20:34:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:01.320 20:34:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:01.320 20:34:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:01.320 20:34:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:01.320 20:34:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:01.320 20:34:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:01.320 20:34:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:01.320 20:34:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:29:01.320 20:34:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:29:01.320 20:34:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:01.320 20:34:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:01.320 20:34:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:01.320 20:34:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:01.320 20:34:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:01.320 20:34:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:01.320 20:34:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:01.320 20:34:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.320 20:34:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.320 20:34:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.320 20:34:32 -- paths/export.sh@5 -- # export PATH 00:29:01.320 20:34:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.320 20:34:32 -- nvmf/common.sh@46 -- # : 0 00:29:01.320 20:34:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:01.320 20:34:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:01.320 20:34:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:01.320 20:34:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:01.320 20:34:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:01.320 20:34:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:01.320 20:34:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:01.320 20:34:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:01.320 20:34:32 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:29:01.320 20:34:32 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:29:01.320 20:34:32 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:29:01.320 20:34:32 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:29:01.320 20:34:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:01.320 20:34:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:01.320 20:34:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:01.320 20:34:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:01.320 20:34:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:01.320 20:34:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:01.320 20:34:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:01.320 20:34:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:01.320 20:34:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:01.320 20:34:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:01.320 20:34:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:01.320 20:34:32 -- common/autotest_common.sh@10 -- # set +x 00:29:06.591 20:34:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:06.591 20:34:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:06.591 20:34:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:06.591 20:34:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:06.591 20:34:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:06.591 20:34:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:06.591 20:34:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:06.591 20:34:38 -- nvmf/common.sh@294 -- # net_devs=() 00:29:06.591 20:34:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:06.591 20:34:38 -- nvmf/common.sh@295 -- # e810=() 00:29:06.591 20:34:38 -- nvmf/common.sh@295 -- # local -ga e810 00:29:06.591 20:34:38 -- nvmf/common.sh@296 -- # x722=() 00:29:06.591 20:34:38 -- nvmf/common.sh@296 -- # local -ga x722 00:29:06.591 20:34:38 -- nvmf/common.sh@297 -- # mlx=() 00:29:06.591 20:34:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:06.591 20:34:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:06.591 20:34:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:06.592 20:34:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:06.592 20:34:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:06.592 20:34:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:06.592 20:34:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:06.592 20:34:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:06.592 20:34:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:29:06.592 Found 0000:86:00.0 (0x8086 - 0x159b) 00:29:06.592 20:34:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:06.592 20:34:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:29:06.592 Found 0000:86:00.1 (0x8086 - 0x159b) 00:29:06.592 20:34:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:06.592 20:34:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:06.592 20:34:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:06.592 20:34:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:06.592 20:34:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:06.592 20:34:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:29:06.592 Found net devices under 0000:86:00.0: cvl_0_0 00:29:06.592 20:34:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:06.592 20:34:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:06.592 20:34:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:06.592 20:34:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:06.592 20:34:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:06.592 20:34:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:29:06.592 Found net devices under 0000:86:00.1: cvl_0_1 00:29:06.592 20:34:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:06.592 20:34:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:06.592 20:34:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:06.592 20:34:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:06.592 20:34:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:06.592 20:34:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:06.592 20:34:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:06.592 20:34:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:06.592 20:34:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:06.592 20:34:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:06.592 20:34:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:06.592 20:34:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:06.592 20:34:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:06.592 20:34:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:06.592 20:34:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:06.592 20:34:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:06.592 20:34:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:06.592 20:34:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:06.592 20:34:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:06.592 20:34:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:06.592 20:34:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:06.592 20:34:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:06.592 20:34:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:06.592 20:34:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:06.592 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:06.592 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:29:06.592 00:29:06.592 --- 10.0.0.2 ping statistics --- 00:29:06.592 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:06.592 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:29:06.592 20:34:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:06.592 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:06.592 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:29:06.592 00:29:06.592 --- 10.0.0.1 ping statistics --- 00:29:06.592 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:06.592 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:29:06.592 20:34:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:06.592 20:34:38 -- nvmf/common.sh@410 -- # return 0 00:29:06.592 20:34:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:06.592 20:34:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:06.592 20:34:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:06.592 20:34:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:06.592 20:34:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:06.592 20:34:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:06.592 20:34:38 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:29:06.592 20:34:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:06.592 20:34:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:06.592 20:34:38 -- common/autotest_common.sh@10 -- # set +x 00:29:06.592 ************************************ 00:29:06.592 START TEST nvmf_target_disconnect_tc1 00:29:06.592 ************************************ 00:29:06.592 20:34:38 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:29:06.592 20:34:38 -- host/target_disconnect.sh@32 -- # set +e 00:29:06.592 20:34:38 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:06.592 EAL: No free 2048 kB hugepages reported on node 1 00:29:06.592 [2024-07-22 20:34:38.452899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.592 [2024-07-22 20:34:38.453246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.592 [2024-07-22 20:34:38.453289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x131d610 with addr=10.0.0.2, port=4420 00:29:06.592 [2024-07-22 20:34:38.453345] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:06.592 [2024-07-22 20:34:38.453379] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:06.592 [2024-07-22 20:34:38.453398] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:29:06.592 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:29:06.592 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:29:06.592 Initializing NVMe Controllers 00:29:06.592 20:34:38 -- host/target_disconnect.sh@33 -- # trap - ERR 00:29:06.592 20:34:38 -- host/target_disconnect.sh@33 -- # print_backtrace 00:29:06.592 20:34:38 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:29:06.592 20:34:38 -- common/autotest_common.sh@1132 -- # return 0 00:29:06.592 20:34:38 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:29:06.592 20:34:38 -- host/target_disconnect.sh@41 -- # set -e 00:29:06.592 00:29:06.592 real 0m0.078s 00:29:06.592 user 0m0.029s 00:29:06.592 sys 0m0.048s 00:29:06.592 20:34:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:06.592 20:34:38 -- common/autotest_common.sh@10 -- # set +x 00:29:06.592 ************************************ 00:29:06.592 END TEST nvmf_target_disconnect_tc1 00:29:06.592 ************************************ 00:29:06.592 20:34:38 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:29:06.592 20:34:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:06.592 20:34:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:06.592 20:34:38 -- common/autotest_common.sh@10 -- # set +x 00:29:06.592 ************************************ 00:29:06.592 START TEST nvmf_target_disconnect_tc2 00:29:06.592 ************************************ 00:29:06.592 20:34:38 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:29:06.592 20:34:38 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:29:06.592 20:34:38 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:29:06.592 20:34:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:06.592 20:34:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:06.592 20:34:38 -- common/autotest_common.sh@10 -- # set +x 00:29:06.592 20:34:38 -- nvmf/common.sh@469 -- # nvmfpid=3583785 00:29:06.593 20:34:38 -- nvmf/common.sh@470 -- # waitforlisten 3583785 00:29:06.593 20:34:38 -- common/autotest_common.sh@819 -- # '[' -z 3583785 ']' 00:29:06.593 20:34:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:06.593 20:34:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:06.593 20:34:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:06.593 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:06.593 20:34:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:29:06.593 20:34:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:06.593 20:34:38 -- common/autotest_common.sh@10 -- # set +x 00:29:06.851 [2024-07-22 20:34:38.547969] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:29:06.851 [2024-07-22 20:34:38.548008] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:06.851 EAL: No free 2048 kB hugepages reported on node 1 00:29:06.851 [2024-07-22 20:34:38.600172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:06.851 [2024-07-22 20:34:38.676919] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:06.851 [2024-07-22 20:34:38.677023] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:06.851 [2024-07-22 20:34:38.677030] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:06.851 [2024-07-22 20:34:38.677037] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:06.851 [2024-07-22 20:34:38.677150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:29:06.851 [2024-07-22 20:34:38.677255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:29:06.851 [2024-07-22 20:34:38.677361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:29:06.851 [2024-07-22 20:34:38.677362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:29:07.416 20:34:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:07.416 20:34:39 -- common/autotest_common.sh@852 -- # return 0 00:29:07.416 20:34:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:07.416 20:34:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:07.416 20:34:39 -- common/autotest_common.sh@10 -- # set +x 00:29:07.674 20:34:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:07.674 20:34:39 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:07.674 20:34:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.674 20:34:39 -- common/autotest_common.sh@10 -- # set +x 00:29:07.674 Malloc0 00:29:07.674 20:34:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.674 20:34:39 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:29:07.674 20:34:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.674 20:34:39 -- common/autotest_common.sh@10 -- # set +x 00:29:07.674 [2024-07-22 20:34:39.393116] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:07.674 20:34:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.674 20:34:39 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:07.674 20:34:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.674 20:34:39 -- common/autotest_common.sh@10 -- # set +x 00:29:07.674 20:34:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.674 20:34:39 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:07.674 20:34:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.674 20:34:39 -- common/autotest_common.sh@10 -- # set +x 00:29:07.674 20:34:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.674 20:34:39 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:07.674 20:34:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.674 20:34:39 -- common/autotest_common.sh@10 -- # set +x 00:29:07.674 [2024-07-22 20:34:39.421345] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:07.674 20:34:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.674 20:34:39 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:29:07.674 20:34:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.674 20:34:39 -- common/autotest_common.sh@10 -- # set +x 00:29:07.674 20:34:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.674 20:34:39 -- host/target_disconnect.sh@50 -- # reconnectpid=3583855 00:29:07.674 20:34:39 -- host/target_disconnect.sh@52 -- # sleep 2 00:29:07.674 20:34:39 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:07.674 EAL: No free 2048 kB hugepages reported on node 1 00:29:09.575 20:34:41 -- host/target_disconnect.sh@53 -- # kill -9 3583785 00:29:09.575 20:34:41 -- host/target_disconnect.sh@55 -- # sleep 2 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 [2024-07-22 20:34:41.448245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Read completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.575 Write completed with error (sct=0, sc=8) 00:29:09.575 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 [2024-07-22 20:34:41.448450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 [2024-07-22 20:34:41.448642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Read completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 Write completed with error (sct=0, sc=8) 00:29:09.576 starting I/O failed 00:29:09.576 [2024-07-22 20:34:41.448835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:29:09.576 [2024-07-22 20:34:41.449270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.449585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.449598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.576 qpair failed and we were unable to recover it. 00:29:09.576 [2024-07-22 20:34:41.450020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.450402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.450433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.576 qpair failed and we were unable to recover it. 00:29:09.576 [2024-07-22 20:34:41.450759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.451146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.451178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.576 qpair failed and we were unable to recover it. 00:29:09.576 [2024-07-22 20:34:41.451524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.451977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.452007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.576 qpair failed and we were unable to recover it. 00:29:09.576 [2024-07-22 20:34:41.452424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.452770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.452799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.576 qpair failed and we were unable to recover it. 00:29:09.576 [2024-07-22 20:34:41.453115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.453463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.453492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.576 qpair failed and we were unable to recover it. 00:29:09.576 [2024-07-22 20:34:41.453834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.454150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.454165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.576 qpair failed and we were unable to recover it. 00:29:09.576 [2024-07-22 20:34:41.454544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.454938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.454968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.576 qpair failed and we were unable to recover it. 00:29:09.576 [2024-07-22 20:34:41.455381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.455796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.576 [2024-07-22 20:34:41.455811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.456186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.456506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.456536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.456874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.457222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.457254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.457602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.457949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.457979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.458390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.458816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.458846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.459299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.459666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.459696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.460128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.460573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.460602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.461023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.461466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.461496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.461909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.462271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.462302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.462669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.463025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.463085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.463452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.463794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.463809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.464203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.464519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.464533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.464858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.465229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.465244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.465558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.465960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.465974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.466364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.466734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.466749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.467151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.467475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.467489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.467813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.468260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.468291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.468641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.469016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.469055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.469486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.469941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.469970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.470332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.470757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.470792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.471162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.471515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.471544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.471976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.472456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.472487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.472867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.473291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.473321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.473793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.474217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.474247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.474716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.475141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.475172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.475644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.475992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.476022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.476473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.476897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.476927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.477232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.477651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.477680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.577 [2024-07-22 20:34:41.478118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.478533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.577 [2024-07-22 20:34:41.478563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.577 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.478917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.479328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.479365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.479795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.480213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.480244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.480675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.481136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.481167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.481516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.481936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.481965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.482323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.482763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.482792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.483165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.483512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.483542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.483890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.484312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.484344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.484721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.485125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.485156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.485586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.486031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.486072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.486504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.486935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.486965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.487387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.487821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.487856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.488209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.488552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.488581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.489007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.489456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.489486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.489915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.490362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.490392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.490707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.491157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.491187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.491591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.492016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.492063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.492535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.492962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.492992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.493464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.493894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.493924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.494282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.494718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.494748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.495181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.495627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.495657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.496088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.496499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.496530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.496892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.497316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.497346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.497773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.498095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.498109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.498520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.498894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.498924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.499355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.499776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.499806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.500177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.500520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.500551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.500849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.501250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.501281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.578 [2024-07-22 20:34:41.501660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.502086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.578 [2024-07-22 20:34:41.502118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.578 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.502493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.502930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.502959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.503396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.503815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.503845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.504274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.504706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.504735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.505208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.505628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.505643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.505978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.506375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.506391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.506785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.507213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.507244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.507716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.508142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.508174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.508538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.508909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.508923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.509323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.509769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.579 [2024-07-22 20:34:41.509799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.579 qpair failed and we were unable to recover it. 00:29:09.579 [2024-07-22 20:34:41.510229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.510570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.510585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.510910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.511232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.511263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.511623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.511975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.512005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.512449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.512895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.512925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.513300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.513744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.513773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.514174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.514519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.514547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.514844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.515207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.515222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.515648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.516017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.516086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.516523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.516935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.516965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.517402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.517787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.517817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.518173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.518586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.518602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.518950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.519273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.519289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.519560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.519922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.519937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.520327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.520691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.520722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.521165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.521603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.521632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.522058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.522363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.522393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.522758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.523164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.523196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.523546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.523847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.523877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.524284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.524578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.524609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.525068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.525447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.525477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.525923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.526334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.526365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.526727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.527155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-07-22 20:34:41.527190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.845 qpair failed and we were unable to recover it. 00:29:09.845 [2024-07-22 20:34:41.527597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.527946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.527975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.528410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.528779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.528809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.529253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.529560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.529590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.529906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.530336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.530368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.530801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.531243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.531274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.531657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.532084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.532116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.532484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.532845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.532876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.533290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.533746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.533777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.534209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.534561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.534592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.534973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.535539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.535586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.536022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.536210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.536228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.536645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.537074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.537106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.537479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.537924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.537954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.538417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.538721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.538751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.539186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.539755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.539785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.540252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.540644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.540675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.541077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.541511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.541541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.541909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.542262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.542292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.542645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.543005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.543035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.543402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.543794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.543824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.544212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.544647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.544677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.545153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.545636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.545666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.546151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.546566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.546597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.547003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.547407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.547438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.547854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.548267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.548299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.548628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.549066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.549098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.549558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.549843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.549874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.846 [2024-07-22 20:34:41.550265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.550698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.846 [2024-07-22 20:34:41.550730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.846 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.551166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.551613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.551651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.551993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.552425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.552470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.552851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.553204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.553236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.553662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.554116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.554148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.554529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.554918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.554949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.555387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.555821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.555852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.556115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.556501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.556532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.556956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.557224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.557257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.557632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.557997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.558027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.558400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.558584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.558600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.558925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.559250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.559266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.559603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.560014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.560053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.560443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.560874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.560904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.561184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.561546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.561578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.561881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.562248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.562280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.562641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.563056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.563087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.563442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.563805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.563836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.564209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.564572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.564603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.564965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.565327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.565359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.565732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.566136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.566152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.566502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.566787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.566817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.567269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.567695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.567725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.568093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.568465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.568495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.568865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.569298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.569330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.569702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.570062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.570094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.570268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.570618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.570649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.571012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.571400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.571432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.571771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.572157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.572189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.847 qpair failed and we were unable to recover it. 00:29:09.847 [2024-07-22 20:34:41.572546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.847 [2024-07-22 20:34:41.572903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.572933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.573107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.573539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.573570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.574002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.574443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.574474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.574837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.575251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.575283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.575698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.576010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.576040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.576373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.576730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.576760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.577089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.577520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.577550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.577996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.578440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.578472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.578840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.579244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.579275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.579687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.580041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.580091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.580511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.580944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.580974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.581332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.581703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.581733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.582120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.582531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.582562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.582935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.583369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.583401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.583837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.584215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.584246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.584679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.585083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.585114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.585304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.585671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.585712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.586060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.586476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.586507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.586837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.587181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.587213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.587626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.587989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.588020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.588384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.588747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.588777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.589193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.589548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.589578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.589940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.590300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.590331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.590731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.591005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.591035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.591417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.591847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.591878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.592264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.592643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.592673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.593110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.593532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.593567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.593939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.594350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.594382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.848 qpair failed and we were unable to recover it. 00:29:09.848 [2024-07-22 20:34:41.594793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.595070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.848 [2024-07-22 20:34:41.595086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.595485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.595876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.595907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.596251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.596680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.596712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.597156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.597588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.597618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.598091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.598451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.598482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.598843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.599277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.599309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.599671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.600026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.600071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.600415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.600699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.600734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.601209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.601636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.601672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.601964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.602285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.602316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.602634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.602990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.603020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.603467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.603818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.603848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.604283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.604737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.604768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.605202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.605484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.605515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.605964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.606338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.606370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.606735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.607164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.607195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.607607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.607978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.608008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.608411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.608793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.608825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.609176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.609597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.609634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.610081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.610474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.610504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.610997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.611405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.611436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.849 qpair failed and we were unable to recover it. 00:29:09.849 [2024-07-22 20:34:41.611826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.612167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.849 [2024-07-22 20:34:41.612198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.612589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.613041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.613084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.613501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.613931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.613962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.614340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.614699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.614730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.615141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.615527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.615558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.615947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.616330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.616361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.616752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.617183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.617214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.617596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.617949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.617969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.618378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.618787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.618818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.619208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.619591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.619623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.620093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.620505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.620536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.620978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.621357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.621390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.621830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.622206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.622238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.622680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.623126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.623157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.623624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.623979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.624010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.624389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.624840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.624871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.625289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.625722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.625753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.626181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.626644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.626675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.627062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.627514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.627543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.627946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.628384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.628416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.628881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.629337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.629371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.629818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.630236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.630269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.630713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.631157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.631174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.631590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.631890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.631921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.632371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.632721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.632752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.850 qpair failed and we were unable to recover it. 00:29:09.850 [2024-07-22 20:34:41.633132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.633569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.850 [2024-07-22 20:34:41.633599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.634030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.634497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.634538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.634940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.635377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.635409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.635889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.636253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.636285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.636591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.637029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.637069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.637542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.637980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.638011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.638372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.638755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.638786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.639139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.639530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.639561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.639944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.640360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.640393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.640747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.641169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.641201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.641629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.641976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.642007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.642377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.642788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.642819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.643266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.643707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.643737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.644118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.644533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.644564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.644927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.645336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.645368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.645816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.646182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.646213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.646576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.647019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.647063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.647534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.647886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.647916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.648274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.648642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.648673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.649039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.649467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.649498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.649949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.650386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.650419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.650796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.651251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.651283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.651725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.652088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.652120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.652520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.652957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.652987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.653421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.653883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.653914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.654359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.654801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.654832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.655274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.655635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.655666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.656016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.656454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.656485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.656926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.657314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.851 [2024-07-22 20:34:41.657346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.851 qpair failed and we were unable to recover it. 00:29:09.851 [2024-07-22 20:34:41.657800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.658215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.658247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.658607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.659034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.659074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.659466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.659852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.659882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.660331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.660774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.660802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.661275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.661712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.661739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.662184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.662574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.662601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.662962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.663382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.663410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.663862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.664233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.664265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.664706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.665127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.665144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.665480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.665841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.665857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.666202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.666646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.666677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.667157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.667570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.667601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.668019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.668441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.668473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.668859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.669210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.669242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.669687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.670244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.670275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.670657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.671069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.671101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.671572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.671881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.671898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.672293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.672724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.672755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.673229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.673583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.673614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.674040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.674380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.674415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.674810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.675178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.675210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.675659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.676053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.676070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.676472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.676891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.676922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.677298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.677741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.677772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.678193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.678548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.678579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.678952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.679387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.679419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.679873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.680253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.680285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.680727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.681117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.681150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.852 qpair failed and we were unable to recover it. 00:29:09.852 [2024-07-22 20:34:41.681619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.852 [2024-07-22 20:34:41.681971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.682001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.682378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.682762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.682778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.683186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.683552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.683583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.683997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.684390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.684408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.684807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.685093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.685127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.685570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.685920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.685952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.686351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.686741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.686772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.687134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.687494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.687526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.687914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.688331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.688363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.688719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.689005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.689019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.689437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.689860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.689892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.690305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.690651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.690682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.691073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.691452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.691482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.691879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.692311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.692342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.692716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.693148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.693180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.693643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.694067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.694099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.694562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.695000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.695031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.695411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.695810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.695827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.696162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.696585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.696616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.697012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.697350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.697366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.697754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.698149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.698181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.698625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.699076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.699107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.699467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.699831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.699862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.700300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.700685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.700716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.701074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.701443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.701475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.701915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.702274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.702307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.702656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.703088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.703121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.703565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.703846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.703877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.853 [2024-07-22 20:34:41.704180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.704600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.853 [2024-07-22 20:34:41.704630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.853 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.705074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.705519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.705535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.705823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.706214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.706246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.706542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.707003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.707034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.707466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.707762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.707794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.708239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.708592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.708623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.708855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.709217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.709233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.709557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.709931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.709946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.710348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.710772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.710802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.711249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.711627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.711658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.712058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.712299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.712330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.712702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.713062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.713093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.713501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.713944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.713974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.714342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.714786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.714817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.715241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.715706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.715736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.716103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.716466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.716496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.716914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.717338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.717370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.717691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.718063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.718096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.718396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.718811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.718847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.719204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.719596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.719627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.720097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.720472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.720502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.720898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.721251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.721283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.721637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.722063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.722095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.722452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.722748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.722780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.854 qpair failed and we were unable to recover it. 00:29:09.854 [2024-07-22 20:34:41.723145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.723515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.854 [2024-07-22 20:34:41.723546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.723995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.724349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.724381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.724804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.725151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.725183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.725613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.726055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.726088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.726461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.726845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.726883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.727331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.727684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.727715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.728159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.728517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.728546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.728989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.729418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.729434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.729819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.730265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.730297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.730678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.731094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.731125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.731520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.731961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.731992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.732405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.732769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.732800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.733172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.733609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.733640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.734114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.734502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.734533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.734953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.735350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.735389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.735768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.736205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.736237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.736715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.737154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.737187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.737632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.737993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.738024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.738453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.738909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.738940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.739376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.739750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.739781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.740172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.740611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.740643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.741115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.741555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.741586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.741968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.742327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.742359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.742784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.743245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.743278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.743720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.744142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.744164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.744532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.744875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.744905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.745344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.745800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.745831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.746304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.746746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.746777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.747250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.747610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.855 [2024-07-22 20:34:41.747641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.855 qpair failed and we were unable to recover it. 00:29:09.855 [2024-07-22 20:34:41.747953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.748411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.748444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.748909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.749347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.749378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.749828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.750265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.750297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.750782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.751221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.751253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.751708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.752149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.752181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.752539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.752961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.752992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.753480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.753832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.753862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.754295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.754642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.754672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.755015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.755402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.755433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.755856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.756318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.756350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.756770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.757197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.757214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.757608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.758025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.758067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.758498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.758935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.758965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.759443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.759886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.759917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.760292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.760734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.760766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.761235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.761535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.761566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.762051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.762518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.762549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.762936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.763383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.763399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.763818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.764232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.764264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.764699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.765088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.765120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.765482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.765920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.765952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.766316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.766758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.766790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.767227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.767654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.767685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.768062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.768499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.768530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.768970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.769344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.769376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.769823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.770202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.770234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.770682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.771059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.771092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.771453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.771786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.771817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.856 [2024-07-22 20:34:41.772267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.772691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.856 [2024-07-22 20:34:41.772722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.856 qpair failed and we were unable to recover it. 00:29:09.857 [2024-07-22 20:34:41.773155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.857 [2024-07-22 20:34:41.773563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.857 [2024-07-22 20:34:41.773579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.857 qpair failed and we were unable to recover it. 00:29:09.857 [2024-07-22 20:34:41.773998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.857 [2024-07-22 20:34:41.774454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.857 [2024-07-22 20:34:41.774486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.857 qpair failed and we were unable to recover it. 00:29:09.857 [2024-07-22 20:34:41.774908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.857 [2024-07-22 20:34:41.775356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.857 [2024-07-22 20:34:41.775372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:09.857 qpair failed and we were unable to recover it. 00:29:09.857 [2024-07-22 20:34:41.775784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.776184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.776201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.776539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.776951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.776967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.777325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.777746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.777777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.778195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.778618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.778649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.779033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.779394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.779410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.779828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.780209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.780241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.780650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.781018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.781063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.781498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.781939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.781969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.782330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.782750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.782781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.783221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.783581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.783612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.122 qpair failed and we were unable to recover it. 00:29:10.122 [2024-07-22 20:34:41.784064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.784502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.122 [2024-07-22 20:34:41.784532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.785008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.785371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.785403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.785847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.786216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.786247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.786699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.787142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.787173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.787596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.788008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.788040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.788538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.788904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.788934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.789382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.789794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.789810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.790218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.790592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.790623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.790999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.791446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.791477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.791849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.792257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.792289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.792733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.793177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.793208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.793679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.794093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.794126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.794564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.795015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.795063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.795480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.795898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.795914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.796340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.796693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.796723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.797148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.797491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.797508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.797898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.798273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.798305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.798774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.799137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.799168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.799587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.799962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.799993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.800373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.800811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.800842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.801315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.801661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.801692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.802082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.802522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.802553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.803023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.803457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.803489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.803943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.804364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.804396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.804864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.805301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.805317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.123 qpair failed and we were unable to recover it. 00:29:10.123 [2024-07-22 20:34:41.805724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.123 [2024-07-22 20:34:41.806113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.806145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.806594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.807033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.807074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.807451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.807890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.807922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.808383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.808745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.808776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.809166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.809605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.809635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.810108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.810481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.810511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.810889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.811303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.811334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.811781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.812198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.812231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.812725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.813164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.813195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.813564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.814004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.814035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.814400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.814843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.814874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.815295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.815735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.815765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.816136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.816490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.816521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.816921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.817376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.817408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.817876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.818319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.818350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.818793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.819159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.819191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.819612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.820076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.820109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.820534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.820915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.820947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.821378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.821828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.821844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.822190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.822626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.822657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.823118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.823557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.823587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.824015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.824477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.824508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.824950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.825306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.825338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.825786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.826149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.826181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.826581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.826961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.826992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.827474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.827917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.827948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.828418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.828763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.828793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.829171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.829462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.829493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.124 qpair failed and we were unable to recover it. 00:29:10.124 [2024-07-22 20:34:41.829960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.124 [2024-07-22 20:34:41.830309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.830341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.830771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.831223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.831241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.831580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.831946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.831977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.832418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.832781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.832812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.833228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.833587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.833603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.833963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.834313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.834345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.834755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.835165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.835182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.835599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.835963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.835994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.836448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.836822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.836853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.837298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.837738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.837769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.838215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.838633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.838664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.838949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.839394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.839426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.839794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.840117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.840133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.840551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.840999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.841029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.841464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.841916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.841947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.842367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.842786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.842817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.843261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.843692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.843724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.844099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.844542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.844573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.845041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.845521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.845551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.845974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.846413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.846446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.846919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.847334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.847365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.847795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.848168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.848201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.848574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.849023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.849063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.125 qpair failed and we were unable to recover it. 00:29:10.125 [2024-07-22 20:34:41.849527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.125 [2024-07-22 20:34:41.849836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.849867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.850331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.850767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.850798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.851288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.851707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.851723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.852134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.852528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.852559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.852929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.853363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.853395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.853815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.854253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.854285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.854764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.855130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.855163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.855554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.855916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.855973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.856420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.856883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.856914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.857372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.857729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.857747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.858177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.858487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.858518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.858969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.859411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.859444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.859915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.860272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.860306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.860625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.861009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.861039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.861447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.861819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.861850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.862295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.862715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.862746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.863179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.863502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.863533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.863980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.864327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.864361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.864666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.865110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.865150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.865584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.865950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.865981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.866379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.866820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.866850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.867327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.867698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.867730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.868179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.868616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.868647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.869124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.869506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.869538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.869961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.870331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.870348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.126 qpair failed and we were unable to recover it. 00:29:10.126 [2024-07-22 20:34:41.870768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.126 [2024-07-22 20:34:41.871185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.871218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.871673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.872062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.872095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.872482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.872849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.872880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.873357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.873782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.873804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.874217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.874634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.874664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.875031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.875414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.875447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.875864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.876309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.876342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.876817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.877253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.877286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.877767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.878122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.878155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.878555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.878918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.878950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.879309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.879751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.879781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.880177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.880541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.880557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.880949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.881363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.881397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.881827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.882282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.882322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.882791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.883165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.883198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.883655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.884055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.884091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.884459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.884877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.884908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.885353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.885795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.885826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.886191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.886635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.886666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.887088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.887525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.887542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.887899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.888319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.127 [2024-07-22 20:34:41.888351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.127 qpair failed and we were unable to recover it. 00:29:10.127 [2024-07-22 20:34:41.888816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.889185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.889223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.889577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.889991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.890023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.890391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.890826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.890858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.891331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.891688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.891719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.892166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.892584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.892615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.892970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.893341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.893373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.893856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.894295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.894327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.894680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.895132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.895164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.895537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.895977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.896007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.896390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.896780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.896796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.897198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.897640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.897671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.898147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.898564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.898595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.899014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.899403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.899436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.899866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.900226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.900259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.900621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.901063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.901095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.901444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.901892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.901922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.902274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.902659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.902690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.903113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.903527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.903558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.903929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.904365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.904398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.904869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.905252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.905284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.905725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.906168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.906200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.906668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.907021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.907060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.907513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.907889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.128 [2024-07-22 20:34:41.907919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.128 qpair failed and we were unable to recover it. 00:29:10.128 [2024-07-22 20:34:41.908375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.908792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.908823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.909190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.909572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.909602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.910023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.910465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.910497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.910936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.911357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.911390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.911759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.912200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.912248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.912669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.913117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.913149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.913598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.914039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.914089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.914560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.915016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.915056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.915522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.915916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.915950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.916420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.916699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.916730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.917157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.917576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.917606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.917986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.918430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.918462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.918901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.919322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.919354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.919797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.920256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.920288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.920652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.921022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.921063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.921436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.921894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.921924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.922378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.922680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.922697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.923120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.923464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.923496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.923954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.924302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.924335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.924765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.925201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.925232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.925705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.926145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.926177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.926553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.926914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.926944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.927390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.927744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.927775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.928153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.928599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.928630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.929060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.929652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.929683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.930128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.930548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.930579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.129 qpair failed and we were unable to recover it. 00:29:10.129 [2024-07-22 20:34:41.930940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.129 [2024-07-22 20:34:41.931361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.931393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.931833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.932198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.932230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.932604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.933037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.933076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.933545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.933981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.934012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.934453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.934877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.934908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.935402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.935746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.935777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.936216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.936583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.936613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.936970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.937385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.937417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.937837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.938272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.938304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.938780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.939101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.939133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.939490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.939899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.939930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.940313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.940754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.940785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.941254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.941627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.941658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.942100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.942463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.942504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.942910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.943355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.943387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.943826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.944286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.944318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.944768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.945184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.945215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.945656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.946078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.946110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.946495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.946931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.946961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.947384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.947832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.947847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.948177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.948641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.948672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.949096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.949464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.949494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.949858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.950274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.950307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.950798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.951164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.951196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.951609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.951970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.951986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.952372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.952767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.952798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.130 [2024-07-22 20:34:41.953244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.953690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.130 [2024-07-22 20:34:41.953721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.130 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.954140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.954579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.954610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.955003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.955454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.955487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.955957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.956330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.956371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.956703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.957062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.957093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.957557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.957855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.957885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.958200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.958638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.958669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.959092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.959507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.959538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.959910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.960294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.960326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.960745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.961184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.961216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.961613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.961992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.962023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.962468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.962773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.962803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.963364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.963849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.963880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.964305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.964791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.964822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.965236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.965692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.965725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.966097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.966538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.966570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.966963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.967355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.967387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.967773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.968160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.968193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.968581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.969057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.969090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.969448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.969815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.969845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.970269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.970660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.970691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.971109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.971410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.971441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.131 [2024-07-22 20:34:41.971916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.972280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.131 [2024-07-22 20:34:41.972313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.131 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.972926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.973256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.973287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.973678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.974118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.974150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.974630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.974986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.975017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.975348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.975782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.975822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.976242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.976682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.976715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.977136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.977548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.977580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.978083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.978519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.978535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.978949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.979264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.979297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.979718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.980107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.980139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.980560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.980993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.981023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.981500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.981805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.981836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.982205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.982629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.982660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.983081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.983446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.983476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.983892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.984260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.984293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.984655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.985005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.985036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.985409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.985792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.985808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.986181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.986631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.986662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.987084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.987389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.987421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.987831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.988197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.988228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.988586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.988906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.988937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.989383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.989753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.989769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.990176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.990567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.990598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.991038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.991408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.991439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.991801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.992170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.992202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.132 qpair failed and we were unable to recover it. 00:29:10.132 [2024-07-22 20:34:41.992560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.992981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.132 [2024-07-22 20:34:41.993011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:41.993386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.993691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.993727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:41.994195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.994644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.994675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:41.995146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.995584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.995614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:41.996066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.996432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.996463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:41.996899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.997191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.997223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:41.997662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.998029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.998069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:41.998426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.998858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.998874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:41.999262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.999593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:41.999624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.000064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.000440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.000472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.000897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.001330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.001363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.001795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.002221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.002264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.002648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.003089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.003121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.003571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.003921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.003952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.004388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.004746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.004762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.005175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.005517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.005548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.005994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.006360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.006392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.006763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.007178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.007212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.007596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.008026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.008049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.008425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.008755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.008786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.009168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.009558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.009588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.010062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.010477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.010514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.010917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.011339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.011371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.133 [2024-07-22 20:34:42.011760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.012122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.133 [2024-07-22 20:34:42.012154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.133 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.012600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.013060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.013094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.013451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.013916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.013947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.014473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.014961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.014993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.015464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.015872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.015903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.016265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.016641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.016673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.017052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.017423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.017453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.017936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.018236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.018253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.018584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.019036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.019085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.019482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.019917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.019948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.020397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.020739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.020771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.021214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.021523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.021556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.022025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.022458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.022490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.022993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.023591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.023624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.023990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.024469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.024502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.024815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.025229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.025260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.025704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.026079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.026114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.026429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.026986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.027018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.027397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.027818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.027849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.028221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.028644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.028675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.029116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.029562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.029592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.029985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.030358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.030390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.030759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.031189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.031221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.031535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.031993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.032024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.032347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.032714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.032745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.033124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.033563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.033595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.033975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.034415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.034447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.034858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.035220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.035252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.134 [2024-07-22 20:34:42.035637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.036077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.134 [2024-07-22 20:34:42.036109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.134 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.036430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.036776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.036807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.037255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.037615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.037645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.038031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.038423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.038454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.038872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.039310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.039342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.039817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.040168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.040204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.040591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.041064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.041097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.041505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.041918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.041949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.042472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.042820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.042836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.043283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.043576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.043608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.044079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.044478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.044509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.044971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.045341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.045373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.045771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.046062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.046108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.046555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.046994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.047024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.047489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.047917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.047947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.048246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.048666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.048698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.049146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.049504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.049521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.049942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.050284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.050317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.050756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.051123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.051139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.051466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.051801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.051816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.052216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.052504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.052534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.135 [2024-07-22 20:34:42.052971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.053298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.135 [2024-07-22 20:34:42.053314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.135 qpair failed and we were unable to recover it. 00:29:10.402 [2024-07-22 20:34:42.053734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.054057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.054073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.054459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.054728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.054744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.055158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.055513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.055543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.055968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.056340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.056372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.056725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.057029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.057079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.057505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.057947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.057978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.058366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.058731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.058762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.059207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.059651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.059681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.060137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.060593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.060624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.061099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.061544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.061574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.061995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.062368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.062400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.062764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.063157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.063189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.063634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.064016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.064056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.064500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.064913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.064944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.065388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.065809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.065840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.066238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.066681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.066712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.067128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.067387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.067418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.067863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.068224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.068257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.068618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.069055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.069087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.069538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.069934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.069965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.070434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.070807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.070838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.071215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.071631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.071662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.072083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.072531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.072562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.073035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.073495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.073527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.073969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.074323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.074356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.074808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.075171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.075203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.403 qpair failed and we were unable to recover it. 00:29:10.403 [2024-07-22 20:34:42.075567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.075923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.403 [2024-07-22 20:34:42.075954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.076396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.076840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.076871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.077230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.077651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.077681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.078079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.078452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.078482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.078905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.079346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.079379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.079854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.080209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.080240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.080664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.081040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.081105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.081532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.081969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.082000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.082371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.082731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.082762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.083202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.083564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.083594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.084014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.084457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.084489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.084963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.085328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.085359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.085730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.086168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.086200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.086647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.087004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.087035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.087415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.087780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.087810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.088246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.088587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.088603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.088945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.089388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.089420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.089796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.090209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.090241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.090684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.091063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.091095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.091536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.091977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.092008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.092437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.092897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.092927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.093227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.093637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.093653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.094059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.094434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.094464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.094903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.095207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.095240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.095711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.096153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.096185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.096650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.097007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.097038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.097464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.097818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.097849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.404 qpair failed and we were unable to recover it. 00:29:10.404 [2024-07-22 20:34:42.098275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.404 [2024-07-22 20:34:42.098717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.098748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.099193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.099622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.099653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.100140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.100555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.100585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.101008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.101451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.101483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.101928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.102285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.102316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.102743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.103168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.103199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.103695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.104171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.104204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.104656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.105070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.105103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.105526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.105962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.105992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.106449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.106877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.106908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.107335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.107719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.107757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.108056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.108476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.108507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.108880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.109266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.109298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.109661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.110083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.110115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.110563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.111001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.111032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.111511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.111949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.111980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.112450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.112894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.112925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.113347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.113705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.113735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.114093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.114533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.114564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.115013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.115456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.115488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.115958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.116372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.116404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.116825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.117270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.117302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.117725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.118092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.118124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.118539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.118982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.119012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.119317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.119736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.119766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.120130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.120566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.120598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.121088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.121423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.405 [2024-07-22 20:34:42.121461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.405 qpair failed and we were unable to recover it. 00:29:10.405 [2024-07-22 20:34:42.121832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.122206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.122237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.122688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.123070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.123101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.123454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.123830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.123861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.124301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.124694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.124724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.125164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.125482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.125512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.125896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.126252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.126284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.126709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.127062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.127094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.127539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.127952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.127983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.128337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.128762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.128792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.129172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.129615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.129656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.129980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.130409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.130425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.130815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.131230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.131262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.131560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.131975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.132006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.132377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.132691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.132721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.133110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.133557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.133588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.133942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.134366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.134397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.134786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.135198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.135214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.135541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.135998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.136029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.136397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.136814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.136844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.137301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.137746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.137783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.138205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.138642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.138673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.139133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.139501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.139532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.139937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.140312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.140343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.140763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.141187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.141220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.141675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.142062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.142095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.142478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.142917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.142948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.406 [2024-07-22 20:34:42.143432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.143821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.406 [2024-07-22 20:34:42.143852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.406 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.144237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.144650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.144680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.145127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.145556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.145588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.145948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.146389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.146426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.146897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.147258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.147290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.147744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.148107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.148123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.148531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.148849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.148880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.149172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.149651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.149683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.150075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.150511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.150542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.150903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.151321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.151353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.151700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.152136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.152168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.152610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.152979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.153010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.153406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.153825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.153856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.154326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.154771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.154802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.155183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.155626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.155656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.156082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.156471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.156502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.156889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.157312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.157344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.157727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.158165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.158197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.158641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.159083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.159130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.159536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.159903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.159934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.160374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.160721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.160751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.407 qpair failed and we were unable to recover it. 00:29:10.407 [2024-07-22 20:34:42.161191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.407 [2024-07-22 20:34:42.161639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.161670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.162097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.162534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.162565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.163024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.163447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.163463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.163885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.164298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.164314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.164738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.165176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.165207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.165633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.166075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.166118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.166474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.166889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.166919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.167295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.167737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.167767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.168214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.168593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.168623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.169062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.169499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.169530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.169905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.170347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.170380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.170823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.171199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.171232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.171614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.172028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.172076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.172465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.172784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.172815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.173261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.173713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.173743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.174215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.174660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.174691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.175063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.175407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.175424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.175836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.176203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.176235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.176678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.177039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.177085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.177462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.177901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.177932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.178401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.178791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.178822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.179177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.179603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.179634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.180010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.180435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.180467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.180931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.181372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.181404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.181831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.182268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.182301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.182726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.183163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.183196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.408 qpair failed and we were unable to recover it. 00:29:10.408 [2024-07-22 20:34:42.183635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.184080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.408 [2024-07-22 20:34:42.184112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.184476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.184856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.184886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.185265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.185623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.185654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.186094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.186461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.186492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.186935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.187376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.187408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.187878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.188317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.188349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.188726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.189018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.189069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.189448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.189886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.189917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.190393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.190778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.190809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.191232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.191582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.191612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.191980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.192350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.192382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.192741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.193155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.193172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.193583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.194065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.194098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.194447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.194835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.194866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.195289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.195674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.195705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.196148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.196523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.196553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.196929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.197365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.197398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.197824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.198282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.198314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.198759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.199136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.199168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.199528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.199966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.199998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.200504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.200892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.200908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.201172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.201587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.201617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.202068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.202482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.202498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.202854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.203293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.203325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.203695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.204001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.204032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.204366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.204809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.204840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.205256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.205670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.205687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.409 qpair failed and we were unable to recover it. 00:29:10.409 [2024-07-22 20:34:42.206057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.206489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.409 [2024-07-22 20:34:42.206520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.206942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.207356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.207387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.207830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.208152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.208184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.208617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.209031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.209081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.209513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.209952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.209983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.210475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.210834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.210865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.211225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.211579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.211595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.211917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.212241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.212258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.212699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.213125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.213157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.213633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.214031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.214073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.214431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.214887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.214918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.215285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.215839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.215870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.216318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.216757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.216773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.217194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.217511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.217542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.217989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.218381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.218414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.218856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.219227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.219260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.219678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.220006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.220022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.220303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.220695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.220712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.221107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.221439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.221471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.221929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.222370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.222402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.222794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.223124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.223141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.223532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.223890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.223906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.224321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.224708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.224741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.225168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.225585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.225617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.226213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.226643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.226684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.227072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.227456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.227497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.227957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.228305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.228333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.410 qpair failed and we were unable to recover it. 00:29:10.410 [2024-07-22 20:34:42.228729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.410 [2024-07-22 20:34:42.229093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.229139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.229533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.230019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.230094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.230439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.230823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.230855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.231220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.231672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.231711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.232191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.232681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.232715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.233087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.233435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.233471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.233792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.234195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.234238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.234609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.235060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.235095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.235455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.235833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.235884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.236370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.236687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.236704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.237098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.237437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.237468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.237788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.238138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.238170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.238577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.238948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.238979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.239335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.239754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.239769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.240181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.240453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.240485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.240913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.241347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.241379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.241757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.242231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.242263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.242643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.243106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.243144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.243432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.243783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.243813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.244284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.244699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.244731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.245170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.245588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.245604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.245953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.246372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.246404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.246854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.247251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.247283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.247637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.247949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.247979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.248422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.248839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.248870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.249265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.249704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.249735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.250068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.250486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.250517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.250957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.251321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.251353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.411 qpair failed and we were unable to recover it. 00:29:10.411 [2024-07-22 20:34:42.251717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.411 [2024-07-22 20:34:42.252154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.252186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.252666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.253114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.253145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.253613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.253977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.254007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.254453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.254889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.254919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.255360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.255802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.255832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.256302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.256720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.256763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.257201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.257590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.257620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.258011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.258439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.258472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.258797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.259214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.259246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.259685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.260015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.260058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.260411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.260850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.260880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.261302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.261718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.261749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.262191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.262636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.262668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.263028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.263453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.263484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.263854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.264271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.264303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.264793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.265143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.265163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.265504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.265925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.265955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.266419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.266831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.266863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.267291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.267677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.267692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.268100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.268368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.268383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.268790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.269197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.269214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.269591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.269930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.269946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.270381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.270792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.412 [2024-07-22 20:34:42.270808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.412 qpair failed and we were unable to recover it. 00:29:10.412 [2024-07-22 20:34:42.271222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.271634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.271650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.271974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.272356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.272372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.272779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.273192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.273211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.273624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.273976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.273992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.274430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.274838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.274854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.275250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.275647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.275663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.276001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.276413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.276429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.276807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.277216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.277232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.277537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.277923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.277939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.278272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.278682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.278698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.279079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.279497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.279513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.279897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.280233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.280249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.280603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.281009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.281027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.281375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.281760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.281776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.282183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.282453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.282469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.282894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.283230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.283246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.283656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.283929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.283946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.284351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.284678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.284694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.285079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.285493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.285508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.285837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.286250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.286266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.286676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.287090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.287106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.287437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.287826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.287843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.288182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.288540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.288555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.288991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.289352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.289369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.289777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.290201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.290217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.290567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.291011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.291028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.291476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.291814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.291829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.413 qpair failed and we were unable to recover it. 00:29:10.413 [2024-07-22 20:34:42.292270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.413 [2024-07-22 20:34:42.292681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.292697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.293106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.293393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.293409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.293745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.294157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.294173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.294596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.295002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.295018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.295351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.295770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.295785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.296117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.296524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.296540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.296876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.297329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.297345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.297663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.298058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.298074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.298405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.298797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.298813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.299163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.299497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.299513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.299900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.300362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.300394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.300857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.301284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.301300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.301707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.302095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.302112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.302517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.302896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.302911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.303226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.303585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.303601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.304029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.304384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.304400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.304761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.305025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.305040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.305458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.305843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.305859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.306270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.306659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.306674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.307086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.307438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.307453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.307785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.308204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.308220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.308582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.309013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.309029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.309428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.309807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.309822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.310151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.310437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.310453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.310859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.311138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.311154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.311542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.311945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.311961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.312383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.312657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.312673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.414 qpair failed and we were unable to recover it. 00:29:10.414 [2024-07-22 20:34:42.313085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.414 [2024-07-22 20:34:42.313414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.313430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.313711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.314127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.314144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.314420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.314816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.314832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.315254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.315675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.315691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.316111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.316521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.316537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.316945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.317263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.317280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.317603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.318049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.318066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.318476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.318860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.318876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.319285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.319655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.319671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.320033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.320439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.320454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.320859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.321265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.321282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.321707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.322123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.322139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.322552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.322956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.322973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.323363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.323770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.323785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.324191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.324507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.324523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.324933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.325339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.325355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.325773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.326129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.326147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.326508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.326950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.326966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.327312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.327631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.327647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.327925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.328329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.328345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.328773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.329161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.329178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.329514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.329864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.329881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.330147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.330460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.330476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.330892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.331232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.331248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.331657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.332047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.415 [2024-07-22 20:34:42.332063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.415 qpair failed and we were unable to recover it. 00:29:10.415 [2024-07-22 20:34:42.332469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.682 [2024-07-22 20:34:42.332857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.682 [2024-07-22 20:34:42.332872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.682 qpair failed and we were unable to recover it. 00:29:10.682 [2024-07-22 20:34:42.333224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.682 [2024-07-22 20:34:42.333614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.682 [2024-07-22 20:34:42.333629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.682 qpair failed and we were unable to recover it. 00:29:10.682 [2024-07-22 20:34:42.334033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.682 [2024-07-22 20:34:42.334437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.334452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.334838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.335260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.335277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.335688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.336012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.336027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.336443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.336827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.336842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.337252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.337657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.337673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.338068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.338397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.338413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.338742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.339135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.339151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.339551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.339946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.339962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.340300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.340632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.340649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.341067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.341475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.341491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.341887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.342211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.342227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.342610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.343016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.343032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.343429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.343837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.343854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.344266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.344680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.344695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.345024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.345428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.345444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.345849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.346243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.346259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.346664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.347055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.347071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.347422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.347702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.347719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.348136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.348552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.348569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.348982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.349397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.349413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.349827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.350234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.350251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.350666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.351041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.351062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.351467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.351798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.351814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.352157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.352503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.352519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.352854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.353212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.353228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.683 [2024-07-22 20:34:42.353557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.353967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.683 [2024-07-22 20:34:42.353982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.683 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.354312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.354723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.354739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.355154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.355493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.355509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.355916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.356232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.356248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.356655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.357048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.357064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.357468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.357873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.357889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.358211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.358536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.358552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.358882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.359273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.359290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.359702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.360109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.360126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.360524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.360857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.360873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.361285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.361667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.361683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.362094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.362385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.362402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.362809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.363197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.363213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.363621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.363881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.363896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.364309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.364661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.364678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.365110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.365426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.365442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.365853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.366177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.366193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.366606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.367018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.367034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.367416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.367806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.367822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.368227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.368618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.368634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.369038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.369390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.369405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.369740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.370029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.370051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.370440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.370846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.370863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.371198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.371608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.371624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.372009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.372368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.372385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.372819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.373143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.373159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.373490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.373830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.373845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.684 [2024-07-22 20:34:42.374178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.374470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.684 [2024-07-22 20:34:42.374486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.684 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.374828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.375115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.375132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.375540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.375958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.375975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.376317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.376749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.376764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.377173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.377560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.377575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.377960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.378370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.378386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.378714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.379055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.379072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.379482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.379833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.379849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.380235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.380584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.380600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.380866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.381256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.381273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.381626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.381963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.381982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.382328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.382735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.382751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.383086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.383473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.383489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.383745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.384130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.384146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.384550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.384895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.384911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.385343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.385729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.385744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.386018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.386432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.386448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.386858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.387184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.387200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.387608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.387940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.387956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.388280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.388687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.388702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.389110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.389374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.389392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.389684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.390068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.390085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.390444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.390873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.390889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.391248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.391544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.391560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.391919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.392330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.392346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.392707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.393141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.393157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.685 qpair failed and we were unable to recover it. 00:29:10.685 [2024-07-22 20:34:42.393517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.393926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.685 [2024-07-22 20:34:42.393942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.394280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.394690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.394706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.395112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.395440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.395455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.395906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.396315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.396332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.396659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.397060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.397080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.397470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.397858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.397873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.398284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.398621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.398637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.398994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.399404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.399420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.399830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.400144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.400160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.400496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.400906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.400922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.401308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.401717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.401733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.402052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.402368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.402386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.402715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.403080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.403097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.403511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.403930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.403946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.404308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.404638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.404658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.404981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.405392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.405409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.405746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.406099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.406116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.406638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.406974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.406990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.407489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.407904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.407920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.408352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.408757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.408772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.409110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.409521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.409537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.409936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.410311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.410328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.410718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.411122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.411138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.411581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.411884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.411899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.412332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.412699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.412715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.413128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.413408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.413424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.413809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.414213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.414230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.686 qpair failed and we were unable to recover it. 00:29:10.686 [2024-07-22 20:34:42.414570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.686 [2024-07-22 20:34:42.414984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.415000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.415408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.415783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.415798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.416138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.416506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.416522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.416938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.417302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.417319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.417653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.417993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.418009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.418375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.418623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.418639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.419066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.419480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.419496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.419895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.420297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.420314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.420708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.421065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.421081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.421408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.421793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.421809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.422236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.422643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.422659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.423036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.423453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.423469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.423869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.424263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.424282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.424677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.425090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.425106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.425390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.425776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.425792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.426195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.426608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.426624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.427054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.427332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.427348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.427761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.428145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.428161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.428533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.428947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.428963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.429368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.429760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.429776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.687 qpair failed and we were unable to recover it. 00:29:10.687 [2024-07-22 20:34:42.430189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.430603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.687 [2024-07-22 20:34:42.430619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.430945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.431334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.431351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.431751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.432159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.432175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.432572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.432970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.432986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.433383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.433792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.433808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.434204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.434500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.434515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.434848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.435255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.435271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.435624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.436063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.436079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.436359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.436765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.436781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.437192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.437529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.437544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.437832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.438242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.438258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.438587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.438922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.438938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.439425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.439814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.439829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.440216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.440579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.440596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.440983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.441278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.441294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.441631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.442055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.442071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.442483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.442873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.442890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.443277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.443686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.443701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.444092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.444438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.444455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.444801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.445311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.445328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.445778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.446113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.446129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.446489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.446828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.446844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.447181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.447524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.447539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.447945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.448335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.448352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.448691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.449020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.449034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.449326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.449684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.449699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.688 [2024-07-22 20:34:42.450010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.450395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.688 [2024-07-22 20:34:42.450411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.688 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.450828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.451244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.451260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.451601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.451889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.451919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.452249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.452661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.452677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.453107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.453468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.453484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.453764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.454151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.454168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.454575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.454839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.454856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.455267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.455588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.455605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.455954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.456259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.456276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.456559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.456828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.456845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.457263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.457588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.457605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.457949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.458305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.458322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.458737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.459081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.459099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.459379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.459658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.459674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.460061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.460402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.460417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.460855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.461276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.461294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.461568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.461954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.461971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.462382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.462658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.462675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.463037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.463350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.463364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.463751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.464115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.464131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.464470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.464804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.464820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.465227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.465622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.465639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.465973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.466515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.466531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.466878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.467285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.467302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.467630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.468054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.468071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.689 [2024-07-22 20:34:42.468443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.468770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.689 [2024-07-22 20:34:42.468786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.689 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.469193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.469464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.469480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.469820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.470162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.470178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.470617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.471041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.471070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.471351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.471667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.471683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.472035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.472399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.472415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.472803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.473206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.473222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.473582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.473914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.473930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.474249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.474602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.474619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.474916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.475257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.475273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.475619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.475936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.475951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.476359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.476696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.476712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.477036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.477391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.477406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.477755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.478168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.478184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.478519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.478843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.478858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.479132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.479553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.479569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.479910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.480296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.480312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.480728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.481093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.481110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.481475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.481827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.481843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.482190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.482513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.482528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.482943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.483350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.483366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.483616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.483887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.483903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.484191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.484427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.484442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.484771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.485159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.485176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.485526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.485788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.485804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.486212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.486613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.486629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.486952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.487252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.487268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.487439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.487726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.487742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.690 qpair failed and we were unable to recover it. 00:29:10.690 [2024-07-22 20:34:42.488063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.690 [2024-07-22 20:34:42.488381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.488396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.488667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.489081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.489097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.489493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.489847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.489863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.490251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.490539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.490554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.490892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.491277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.491293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.491630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.491894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.491910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.492243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.492402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.492418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.492603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.492925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.492940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.493181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.493564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.493579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.493832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.494099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.494118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.494532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.494852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.494868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.495090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.495415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.495430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.495832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.496219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.496235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.496548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.496818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.496833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.497107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.497432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.497448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.497762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.498084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.498100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.498348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.498741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.498757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.499073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.499404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.499420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.499827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.500209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.500225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.500613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.501005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.501024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.501366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.501683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.501699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.502005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.502329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.502346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.502680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.503088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.503104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.503532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.503864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.503880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.504266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.504592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.504608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.504994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.505341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.505356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.505655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.505984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.506000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.691 qpair failed and we were unable to recover it. 00:29:10.691 [2024-07-22 20:34:42.506403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.691 [2024-07-22 20:34:42.506728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.506744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.507142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.507528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.507543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.507807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.508188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.508206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.508489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.508747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.508763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.509089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.509491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.509506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.509849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.510172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.510188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.510454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.510787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.510803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.511123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.511527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.511542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.511891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.512179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.512196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.512516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.512897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.512913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.513292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.513675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.513691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.514008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.514284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.514300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.514684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.515013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.515032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.515448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.515878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.515893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.516296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.516633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.516648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.516984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.517264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.517279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.517635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.518031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.518058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.518405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.518728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.518744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.519004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.519323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.519339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.519659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.519864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.519879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.520305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.520742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.520757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.521107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.521426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.521440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.692 [2024-07-22 20:34:42.521845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.522176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.692 [2024-07-22 20:34:42.522192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.692 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.522606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.522935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.522950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.523380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.523759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.523774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.524085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.524491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.524507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.524699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.525077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.525093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.525368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.525644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.525660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.525988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.526367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.526383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.526668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.526925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.526941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.527204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.527603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.527619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.527855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.528265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.528280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.528621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.528954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.528970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.529381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.529709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.529724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.529991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.530253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.530268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.530651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.530972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.530987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.531310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.531714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.531729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.532055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.532464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.532479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.532832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.533168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.533184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.533385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.533763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.533778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.534156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.534584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.534600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.534927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.535258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.535274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.535550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.535868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.535883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.536288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.536697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.536712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.536988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.537322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.537338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.537605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.537926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.537940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.538270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.538442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.538457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.538766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.539154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.539169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.539496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.539816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.539830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.540213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.540588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.540603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.693 qpair failed and we were unable to recover it. 00:29:10.693 [2024-07-22 20:34:42.540881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.693 [2024-07-22 20:34:42.541205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.541221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.541555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.541954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.541970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.542295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.542688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.542703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.543041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.543333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.543347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.543638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.544033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.544054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.544390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.544723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.544738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.545080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.545419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.545433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.545628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.545950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.545965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.546230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.546546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.546561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.546904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.547245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.547261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.547571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.547837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.547853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.548127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.548443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.548458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.548794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.549147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.549179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.549537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.549913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.549928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.550236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.550632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.550647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.551086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.551490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.551506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.551811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.552229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.552244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.552489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.552889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.552903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.553220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.553646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.553661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.553970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.554307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.554322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.554744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.555067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.555082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.555448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.555797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.555812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.556059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.556316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.556331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.556705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.557104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.557120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.557443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.557846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.557860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.558183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.558578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.558593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.558842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.559153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.559169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.559491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.559889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.559904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.694 qpair failed and we were unable to recover it. 00:29:10.694 [2024-07-22 20:34:42.560230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.560545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.694 [2024-07-22 20:34:42.560560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.560874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.561248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.561263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.561570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.561762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.561777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.562091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.562434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.562449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.562822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.563138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.563154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.563530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.563726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.563741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.564135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.564507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.564521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.564943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.565199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.565214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.565567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.565841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.565855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.566127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.566434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.566450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.566792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.567101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.567116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.567435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.567741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.567756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.568159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.568553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.568567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.568892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.569211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.569226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.569546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.569861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.569876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.570198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.570571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.570585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.570917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.571245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.571260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.571586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.571959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.571974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.572313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.572622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.572637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.572897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.573284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.573299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.573643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.574014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.574028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.574283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.574535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.574550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.574942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.575196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.575211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.575540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.575807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.575822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.576241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.576566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.576599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.576861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.577177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.577191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.577505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.577767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.577781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.578090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.578463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.578478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.695 [2024-07-22 20:34:42.578795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.579130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.695 [2024-07-22 20:34:42.579145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.695 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.579461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.579782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.579797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.580137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.580477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.580491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.580748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.581066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.581082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.581336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.581706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.581720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.582116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.582392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.582406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.582722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.583038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.583058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.583428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.583812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.583827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.584143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.584420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.584434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.584754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.585013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.585027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.585352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.585669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.585684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.586031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.586363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.586377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.586747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.587057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.587072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.587346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.587605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.587620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.587936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.588328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.588343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.588597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.588905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.588919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.589182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.589498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.589512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.589910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.590249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.590265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.590583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.590900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.590914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.591231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.591569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.591583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.591902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.592296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.592311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.592530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.592849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.592865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.593188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.593446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.593461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.593845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.594176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.594192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.594563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.594797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.594812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.595183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.595520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.595535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.595848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.596104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.596117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.596375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.596709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.596724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.596990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.597369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.597384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.696 qpair failed and we were unable to recover it. 00:29:10.696 [2024-07-22 20:34:42.597758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.696 [2024-07-22 20:34:42.598076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.598091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.598406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.598731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.598746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.599067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.599383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.599397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.599743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.600088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.600103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.600520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.601010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.601025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.601362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.601626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.601640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.602021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.602340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.602355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.602663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.603056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.603071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.603345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.603720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.603738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.604064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.604458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.604473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.604791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.605189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.605204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.605449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.605754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.605769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.606082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.606399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.606414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.606687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.607039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.607066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.607385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.607707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.607722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.607997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.608389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.608404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.608660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.608974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.608988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.609303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.609615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.609629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.609962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.610299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.610316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.610687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.611007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.611021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.611276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.611647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.611661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.697 qpair failed and we were unable to recover it. 00:29:10.697 [2024-07-22 20:34:42.611845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.697 [2024-07-22 20:34:42.612174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.612189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.612578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.612929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.612944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.613275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.613587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.613602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.613930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.614233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.614249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.614506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.614903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.614918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.615037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.615365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.615379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.615661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.615964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.615979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.616297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.616546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.616563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.616754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.617124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.617140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.617324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.617639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.617654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.617977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.618232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.618247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.618550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.618894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.618909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.619238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.619497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.619512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.619882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.620187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.620202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.620551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.620794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.620809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.621114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.621422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.621436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.621833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.622158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.622173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.622431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.622671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.622688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.623003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.623371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.623386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.623779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.624053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.624069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.624385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.624634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.624648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.624984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.625263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.625278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.625518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.625824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.625839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.626086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.626437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.626452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.626689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.627038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.627063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.627465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.627712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.627727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.628072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.628440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.628454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.628767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.629018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.629033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.629285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.629614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.629628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.629948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.630285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.630300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.630605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.631000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.631015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.631288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.631591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.631606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.631920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.632232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.632246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.632637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.632871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.632886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.633204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.633515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.633530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.633934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.634254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.634269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.634592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.634990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.635004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.635257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.635377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.635392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.635794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.636177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.636192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.636554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.636972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.636987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.637321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.637712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.637726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.638122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.638396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.638411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.638716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.639037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.639060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.639371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.639739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.639754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.640086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.640362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.640376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.640625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.640793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.640808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.961 qpair failed and we were unable to recover it. 00:29:10.961 [2024-07-22 20:34:42.641125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.961 [2024-07-22 20:34:42.641435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.641449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.641822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.642144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.642159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.642549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.642863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.642878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.643138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.643449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.643463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.643795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.644063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.644077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.644417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.644665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.644680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.644941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.645254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.645268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.645608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.646004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.646018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.646342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.646664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.646678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.647056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.647299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.647314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.647684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.648078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.648093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.648438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.648743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.648758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.649096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.649280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.649295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.649536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.649885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.649899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.650221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.650592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.650607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.650868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.651177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.651192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.651507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.651690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.651705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.652119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.652451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.652465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.652792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.653163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.653178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.653596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.653898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.653913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.654184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.654514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.654528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.654872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.655224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.655239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.655554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.655876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.655891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.656241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.656557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.656572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.656758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.657075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.657090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.657480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.657796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.657810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.658179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.658429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.658443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.658761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.659139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.659154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.659407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.659659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.659674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.660052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.660362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.660376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.660695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.660826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.660840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.661224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.661559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.661574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.661892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.662270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.662285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.662691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.662946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.662961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.663292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.663650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.663665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.664041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.664377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.664391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.664706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.665020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.665035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.665359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.665616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.665630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.665812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.666151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.666166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.666434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.666802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.666817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.667130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.667531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.667546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.667932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.668237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.668252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.668654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.668973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.668988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.669224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.669559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.669573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.669833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.670139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.670154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.670478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.670781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.670796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.671052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.671234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.671248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.671584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.671928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.671942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.962 qpair failed and we were unable to recover it. 00:29:10.962 [2024-07-22 20:34:42.672313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.962 [2024-07-22 20:34:42.672570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.672584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.672955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.673350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.673365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.673613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.673916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.673931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.674301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.674581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.674595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.674911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.675242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.675257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.675603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.675921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.675936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.676237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.676552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.676566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.676890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.677207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.677222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.677595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.677941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.677955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.678326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.678721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.678736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.679062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.679482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.679497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.679865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.680182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.680197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.680588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.680828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.680842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.681212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.681543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.681557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.681679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.681864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.681878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.682178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.682547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.682562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.682880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.683201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.683216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.683586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.683933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.683948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.684321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.684488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.684503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.684817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.685219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.685234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.685549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.685896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.685910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.686228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.686546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.686561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.686901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.687277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.687293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.687685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.687999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.688013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.688269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.688538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.688552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.688926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.689245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.689260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.689593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.689861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.689876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.690194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.690464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.690478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.690846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.691271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.691285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.691543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.691845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.691860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.692117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.692438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.692452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.692701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.693019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.693033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.693299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.693541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.693556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.693817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.694152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.694167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.694478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.694750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.694765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.695139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.695384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.695399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.695704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.696016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.696031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.696354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.696549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.696563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.696950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.697213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.697228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.697596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.697928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.697942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.698360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.698749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.698764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.699099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.699295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.699309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.699631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.699887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.699901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.700232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.700569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.700583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.700849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.701110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.701125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.963 qpair failed and we were unable to recover it. 00:29:10.963 [2024-07-22 20:34:42.701438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.963 [2024-07-22 20:34:42.701623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.701638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.701877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.702186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.702201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.702522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.702829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.702842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.703125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.703373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.703388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.703776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.704039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.704070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.704442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.704698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.704713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.705028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.705451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.705466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.705769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.706088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.706103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.706365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.706666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.706681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.706937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.707319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.707336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.707654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.707992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.708007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.708376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.708697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.708711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.708986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.709154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.709169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.709487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.709729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.709744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.710098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.710333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.710348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.710717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.711033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.711056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.711432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.711554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.711568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.711909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.712281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.712296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.712666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.713008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.713022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.713213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.713550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.713567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.713945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.714294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.714309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.714575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.714902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.714917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.715290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.715657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.715671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.715935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.716237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.716252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.716552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.716918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.716932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.717303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.717680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.717695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.717997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.718306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.718321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.718623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.719019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.719034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.719413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.719784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.719798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.720060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.720298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.720316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.720724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.721029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.721049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.721361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.721669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.721684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.721931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.722328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.722343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.722658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.723026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.723040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.723232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.723594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.723608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.723852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.724094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.724109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.724346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.724666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.724680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.724952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.725225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.725240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.725636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.725875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.725890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.726261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.726613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.726631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.726881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.727276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.727291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.727604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.727994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.728009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.728315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.728575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.728604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.728891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.729130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.729161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.729429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.729764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.729794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.730198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.730543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.730572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.731002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.731327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.731358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.731699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.732017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.732031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.732364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.732702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.732731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.733074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.733364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.733394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.733738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.733954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.733984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.734372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.734706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.734735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.735076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.735437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.735467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.964 qpair failed and we were unable to recover it. 00:29:10.964 [2024-07-22 20:34:42.735683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.736075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.964 [2024-07-22 20:34:42.736108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.736513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.736955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.736984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.737391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.737727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.737742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.738031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.738476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.738505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.738906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.739243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.739274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.739630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.740064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.740094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.740460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.740795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.740809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.741075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.741470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.741485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.741803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.742095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.742126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.742433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.742878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.742907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.743224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.743586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.743615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.743834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.744195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.744248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.744603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.744948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.744963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.745337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.745739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.745768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.746184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.746544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.746558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.746862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.747116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.747148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.747516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.747917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.747946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.748326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.748694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.748722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.749022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.749365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.749395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.749772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.750174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.750203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.750587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.750949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.750978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.751273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.751652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.751681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.752089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.752517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.752547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.752950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.753408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.753447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.753708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.754085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.754116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.754308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.754647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.754677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.755019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.755263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.755279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.755673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.756012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.756041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.756303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.756671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.756700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.757065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.757476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.757505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.757871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.758268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.758283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.758601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.758944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.758974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.759351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.759713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.759727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.760142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.760531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.760560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.760906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.761192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.761223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.761664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.762002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.762032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.762416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.762763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.762793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.763221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.763553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.763581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.763797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.764089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.764119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.764525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.764818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.764848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.765200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.765456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.765486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.765844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.766235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.766250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.766573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.766904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.766934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.767288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.767711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.767740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.768096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.768500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.768529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.768934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.769281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.769313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.769667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.770091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.770122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.770535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.770974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.771004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.771301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.771650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.771680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.772110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.772462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.772491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.772948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.773373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.773414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.773801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.774104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.774134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.774377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.774666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.774696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.775077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.775361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.775391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.775737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.776085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.965 [2024-07-22 20:34:42.776115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.965 qpair failed and we were unable to recover it. 00:29:10.965 [2024-07-22 20:34:42.776492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.776916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.776946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.777397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.777693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.777723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.778098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.778361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.778391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.778839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.779182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.779213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.779582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.779938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.779967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.780397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.780780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.780809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.781158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.781586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.781615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.782051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.782420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.782449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.782881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.783166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.783197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.783551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.783902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.783932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.784215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.784635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.784665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.785002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.785290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.785329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.785730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.786038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.786059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.786322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.786543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.786572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.786928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.787214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.787246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.787590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.787879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.787909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.788272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.788555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.788584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.789011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.789235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.789265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.789550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.789868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.789898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.790246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.790602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.790631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.790969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.791370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.791401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.791805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.792095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.792126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.792429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.792866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.792896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.793238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.793641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.793670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.793969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.794306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.794337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.794789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.795171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.795202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.795614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.795911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.795941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.796247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.796620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.796649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.797099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.797463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.797493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.797819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.798263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.798294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.798739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.799093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.799123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.799550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.799913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.799942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.800257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.800576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.800605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.800962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.801340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.801371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.801722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.802140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.802171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.802600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.802961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.802991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.803345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.803709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.803738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.804171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.804509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.804523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.804825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.805151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.805165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.805549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.805950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.805979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.806417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.806754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.806783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.806966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.807288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.807303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.807686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.808097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.808129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.808442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.808783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.808812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.809215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.809552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.809581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.809930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.810305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.810336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.810674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.811003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.811018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.811345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.811667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.811682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.966 [2024-07-22 20:34:42.811929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.812235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.966 [2024-07-22 20:34:42.812250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.966 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.812580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.812977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.813006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.813315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.813759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.813788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.814091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.814522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.814551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.814957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.815327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.815368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.815710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.816066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.816097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.816401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.816697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.816727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.817015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.817393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.817424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.817854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.818064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.818095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.818459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.818797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.818825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.819250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.819651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.819681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.820051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.820342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.820371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.820796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.821170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.821201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.821583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.821979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.822009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.822386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.822744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.822780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.823135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.823533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.823562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.823865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.824259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.824290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.824719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.825108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.825139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.825539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.825881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.825911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.826265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.826582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.826611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.827013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.827425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.827456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.827812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.827992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.828007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.828335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.828735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.828764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.829106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.829417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.829446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.829872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.830237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.830273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.830624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.831023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.831061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.831284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.831630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.831660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.832017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.832376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.832406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.832809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.833174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.833205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.833555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.833965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.833994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.834351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.834636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.834650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.834966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.835247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.835277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.835629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.836058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.836088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.836462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.836758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.836788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.837135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.837492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.837526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.837900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.838246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.838277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.838617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.839031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.839069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.839414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.839838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.839867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.840248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.840541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.840571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.840978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.841315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.841346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.841749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.842088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.842119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.842535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.842903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.842932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.843303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.843647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.843676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.844104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.844441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.844470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.844880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.845053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.845084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.845428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.845801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.845830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.846212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.846642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.846672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.847029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.847314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.847343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.847744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.848090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.848121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.848410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.848761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.848791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.849193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.849544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.849573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.850001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.850362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.850392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.850740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.850956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.850985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.851343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.851692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.851721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.852148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.852551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.852581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.967 qpair failed and we were unable to recover it. 00:29:10.967 [2024-07-22 20:34:42.853024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.967 [2024-07-22 20:34:42.853383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.853413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.853845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.854137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.854167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.854592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.854942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.854971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.855375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.855747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.855776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.856079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.856529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.856558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.856858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.857206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.857237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.857527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.857811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.857840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.858270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.858649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.858679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.859032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.859398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.859428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.859648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.860088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.860121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.860546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.860899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.860929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.861352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.861797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.861826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.862146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.862569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.862599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.862952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.863313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.863342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.863695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.864115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.864146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.864577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.864914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.864943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.865238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.865391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.865421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.865871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.866208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.866238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.866588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.866943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.866971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.867380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.867803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.867832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.868238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.868642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.868671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.869096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.869397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.869427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.869798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.870135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.870165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.870596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.870947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.870976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.871255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.871536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.871566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.871933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.872355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.872387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.872740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.873160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.873191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.873529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.873875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.873905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.874308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.874650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.874680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.875130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.875570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.875599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.875956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.876357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.876388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.876813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.877217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.877248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.877610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.877907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.877936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.878301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.878655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.878685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.879108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.879441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.879471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.879758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.880101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.880133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.880488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.880910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.880940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.881313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.881743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.881772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.882179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.882520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.882549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.882894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.883331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.883362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.883719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.884085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.884117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.884408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.884750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.884779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.885213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.885635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.885664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.885961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.886337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.886367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.886719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.887147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.887178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.887632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.887993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.888022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.888455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.888874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.888889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.889204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.889387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.889414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.889663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.889903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.889918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.890245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.890574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.890589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.968 qpair failed and we were unable to recover it. 00:29:10.968 [2024-07-22 20:34:42.890844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.891269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.968 [2024-07-22 20:34:42.891300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.969 qpair failed and we were unable to recover it. 00:29:10.969 [2024-07-22 20:34:42.891650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.969 [2024-07-22 20:34:42.891978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.969 [2024-07-22 20:34:42.891992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.969 qpair failed and we were unable to recover it. 00:29:10.969 [2024-07-22 20:34:42.892316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.969 [2024-07-22 20:34:42.892734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.969 [2024-07-22 20:34:42.892763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.969 qpair failed and we were unable to recover it. 00:29:10.969 [2024-07-22 20:34:42.893167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.969 [2024-07-22 20:34:42.893527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.969 [2024-07-22 20:34:42.893557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:10.969 qpair failed and we were unable to recover it. 00:29:11.234 [2024-07-22 20:34:42.893970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.234 [2024-07-22 20:34:42.894226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.234 [2024-07-22 20:34:42.894242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.234 qpair failed and we were unable to recover it. 00:29:11.234 [2024-07-22 20:34:42.894493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.234 [2024-07-22 20:34:42.894824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.234 [2024-07-22 20:34:42.894839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.234 qpair failed and we were unable to recover it. 00:29:11.234 [2024-07-22 20:34:42.895152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.234 [2024-07-22 20:34:42.895499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.895529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.895926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.896327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.896358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.896712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.897131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.897163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.897540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.897892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.897923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.898233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.898629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.898659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.899065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.899469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.899499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.899840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.900169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.900200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.900629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.901085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.901117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.901475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.901816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.901845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.902253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.902600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.902630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.903057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.903425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.903454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.903812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.904164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.904195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.904468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.904887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.904916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.905215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.905646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.905676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.906050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.906226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.906256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.906661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.906945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.906975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.907400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.907744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.907758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.908076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.908505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.908535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.908752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.909094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.909125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.909530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.909947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.909976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.235 [2024-07-22 20:34:42.910263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.910685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.235 [2024-07-22 20:34:42.910714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.235 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.911061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.911350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.911379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.911813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.911980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.912009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.912430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.912792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.912822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.913226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.913655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.913685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.914106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.914394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.914423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.914863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.915210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.915241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.915593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.915883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.915912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.916203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.916531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.916561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.916920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.917268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.917299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.917649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.918004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.918051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.918368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.918768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.918797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.919152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.919443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.919472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.919901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.920187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.920217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.920490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.920918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.920947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.921297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.921587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.921615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.922050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.922462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.922491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.922861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.923285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.923316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.923595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.924017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.924062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.924424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.924798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.924828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.925162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.925439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.925468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.236 qpair failed and we were unable to recover it. 00:29:11.236 [2024-07-22 20:34:42.925918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.236 [2024-07-22 20:34:42.926252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.926283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.926646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.926999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.927029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.927442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.927793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.927823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.928251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.928627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.928657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.928953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.929286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.929318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.929632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.930053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.930084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.930514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.930865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.930907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.931304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.931643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.931672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.932014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.932439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.932470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.932826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.933159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.933191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.933593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.933950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.933980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.934337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.934769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.934799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.935115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.935515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.935544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.935897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.936248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.936284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.936697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.937094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.937133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.937536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.937886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.937915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.938345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.938615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.938644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.939078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.939423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.939453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.939797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.940146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.940177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.940539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.940825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.940854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.941198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.941480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.941509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.941865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.942285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.942316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.942652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.942922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.942952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.943293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.943695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.943729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.944092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.944514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.237 [2024-07-22 20:34:42.944543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.237 qpair failed and we were unable to recover it. 00:29:11.237 [2024-07-22 20:34:42.944953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.945372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.945403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.945832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.946233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.946263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.946669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.947024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.947061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.947421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.947831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.947861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.948222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.948634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.948663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.949029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.949437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.949467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.949888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.950254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.950285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.950693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.951059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.951074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.951388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.951692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.951709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.952022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.952361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.952402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.952789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.953068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.953098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.953500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.953900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.953929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.954297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.954729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.954759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.955168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.955458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.955488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.955856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.955983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.955997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.956258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.956630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.956659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.957012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.957349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.957364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.957735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.957929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.957959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.958322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.958753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.958788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.959082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.959577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.959607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.959891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.960240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.960254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.960509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.960904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.960918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.961307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.961655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.961684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.962097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.962450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.962479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.962832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.963169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.963185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.963537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.963886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.963916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.964269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.964591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.964621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.238 qpair failed and we were unable to recover it. 00:29:11.238 [2024-07-22 20:34:42.964977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.238 [2024-07-22 20:34:42.965334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.965364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.965734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.966125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.966140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.966502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.966847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.966877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.967290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.967644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.967673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.968051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.968450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.968480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.968833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.969244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.969259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.969633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.970061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.970093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.970524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.970807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.970837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.971264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.971619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.971648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.971950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.972165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.972196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.972488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.972899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.972929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.973327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.973700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.973730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.974158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.974450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.974479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.974750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.975113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.975128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.975527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.975872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.975902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.976306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.976581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.976611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.976987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.977249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.977280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.977568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.977990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.978020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.978324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.978594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.978624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.978859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.979261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.979292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.979700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.980124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.980155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.980309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.980653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.980684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.980984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.981323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.981353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.981714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.982119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.982134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.982481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.982898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.982912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.983288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.983637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.983666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.984113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.984524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.984538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.984931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.985202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.985232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.239 qpair failed and we were unable to recover it. 00:29:11.239 [2024-07-22 20:34:42.985522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.985942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.239 [2024-07-22 20:34:42.985972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.986272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.986593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.986623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.986883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.987172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.987203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.987564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.987923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.987952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.988393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.988665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.988695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.988986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.989134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.989165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.989595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.989889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.989918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.990329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.990756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.990786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.991196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.991543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.991573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.991943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.992352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.992383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.992736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.993061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.993077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.993298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.993574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.993603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.993996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.994308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.994339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.994726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.995065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.995096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.995526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.995899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.995928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.996214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.996602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.996632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.997009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.997381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.997411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.997768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.998137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.998152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.998470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.998898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.998928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:42.999356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.999717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:42.999746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:43.000115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:43.000477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:43.000507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:43.000914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:43.001206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:43.001237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.240 qpair failed and we were unable to recover it. 00:29:11.240 [2024-07-22 20:34:43.001588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.240 [2024-07-22 20:34:43.001857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.001887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.002229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.002618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.002648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.003003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.003350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.003381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.003768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.004184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.004199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.004510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.004831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.004846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.005176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.005557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.005587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.005938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.006363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.006394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.006828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.007187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.007202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.007555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.007852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.007881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.008257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.008683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.008713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.009079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.009434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.009464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.009866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.010267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.010282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.010660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.011022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.011060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.011407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.011804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.011833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.012271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.012634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.012663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.013041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.013416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.013431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.013771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.013928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.013958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.014243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.014577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.014606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.014960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.015302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.015333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.015701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.016060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.016091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.016489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.016761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.016791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.017073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.017415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.017445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.017885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.018270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.018301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.018667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.019041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.019079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.019515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.019849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.019879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.020186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.020529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.020560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.020988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.021342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.021374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.021809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.022145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.022160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.241 [2024-07-22 20:34:43.022500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.022923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.241 [2024-07-22 20:34:43.022952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.241 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.023388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.023738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.023768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.024052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.024451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.024481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.024909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.025246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.025277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.025505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.025859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.025889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.026242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.026653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.026682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.026979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.027320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.027351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.027518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.027969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.027999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.028344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.028767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.028798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.029149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.029451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.029480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.029780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.030085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.030100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.030425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.030712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.030742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.031191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.031620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.031635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.032028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.032460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.032490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.032826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.033126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.033157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.033507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.033859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.033890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.034241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.034638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.034652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.035023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.035284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.035319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.035774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.036115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.036146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.036770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.036915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.036930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.037260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.037522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.037536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.037856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.038177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.038193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.038507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.038742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.038756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.039019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.039206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.039221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.039532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.039849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.039864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.040188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.040512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.040527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.040844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.041242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.041256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.041584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.041954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.041985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.242 [2024-07-22 20:34:43.042398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.042818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.242 [2024-07-22 20:34:43.042833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.242 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.043157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.043542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.043557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.043874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.044137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.044151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.044494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.044742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.044756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.045074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.045405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.045420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.045607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.045919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.045934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.046210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.046639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.046669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.047015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.047424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.047455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.047806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.048146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.048181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.048563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.048844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.048873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.049165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.049510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.049539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.049881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.050282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.050314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.050668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.051003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.051033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.051389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.051749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.051779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.052135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.052496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.052525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.052941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.053285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.053315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.053662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.054025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.054069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.054426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.054826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.054856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.055282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.055635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.055665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.056037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.056337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.056357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.056667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.057078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.057110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.057412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.057699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.057729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.058003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.058437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.058468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.058827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.059227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.059257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.059545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.059887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.059916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.060369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.060650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.060665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.060866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.061212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.061230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.061567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.061944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.061972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.062391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.062729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.062759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.243 qpair failed and we were unable to recover it. 00:29:11.243 [2024-07-22 20:34:43.063181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.243 [2024-07-22 20:34:43.063468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.063497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.063945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.064293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.064324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.064749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.065081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.065113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.065455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.065880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.065910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.066253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.066563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.066593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.066951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.067299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.067330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.067608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.067946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.067975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.068262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.068656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.068691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.069038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.069421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.069457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.069833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.070098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.070130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.070488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.070885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.070915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.071269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.071620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.071649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.071991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.072345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.072376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.072730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.073074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.073106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.073449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.073847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.073876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.074247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.074669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.074699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.075060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.075284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.075298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.075607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.075954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.075989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.076356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.076780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.076810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.077149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.077510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.077540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.077914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.078249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.078280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.078440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.078771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.078801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.079085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.079507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.079537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.079883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.080213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.080243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.244 qpair failed and we were unable to recover it. 00:29:11.244 [2024-07-22 20:34:43.080597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.080896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.244 [2024-07-22 20:34:43.080925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.081327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.081774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.081804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.082168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.082463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.082492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.082848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.083076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.083107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.083513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.083865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.083895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.084235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.084543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.084573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.085004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.085235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.085266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.085670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.086016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.086059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.086315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.086710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.086725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.086999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.087427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.087457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.087785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.088137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.088168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.088626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.089025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.089073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.089535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.089805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.089834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.090293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.090718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.090748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.091122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.091495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.091524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.091878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.092175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.092206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.092542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.092756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.092786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.093192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.093592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.093622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.094040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.094394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.094424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.094789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.095089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.095120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.095479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.095885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.095914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.096259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.096600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.096629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.097072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.097367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.097381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.097734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.098068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.098098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.098529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.098813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.098842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.099144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.099494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.099523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.099932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.100345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.100376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.100766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.101198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.101230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.245 qpair failed and we were unable to recover it. 00:29:11.245 [2024-07-22 20:34:43.101657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.245 [2024-07-22 20:34:43.102061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.102092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.102392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.102799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.102829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.103182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.103599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.103628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.104035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.104469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.104499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.104881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.105282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.105313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.105609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.105940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.105970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.106334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.106687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.106717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.107198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.107486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.107501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.107896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.108197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.108228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.108580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.108915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.108945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.109374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.109743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.109773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.110060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.110458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.110488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.110846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.111182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.111197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.111378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.111742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.111772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.112201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.112510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.112539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.112899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.113244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.113275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.113703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.114017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.114069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.114478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.114793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.114823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.115037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.115396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.115426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.115643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.116009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.116038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.116402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.116783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.116811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.117038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.117427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.117456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.117809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.118236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.118267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.246 qpair failed and we were unable to recover it. 00:29:11.246 [2024-07-22 20:34:43.118572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.118892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.246 [2024-07-22 20:34:43.118907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.119347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.119715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.119730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.120105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.120531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.120561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.120930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.121214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.121245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.121574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.121997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.122026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.122443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.122785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.122815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.123219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.123621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.123651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.124080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.124393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.124423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.124845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.125149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.125180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.125539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.125938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.125968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.126377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.126802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.126831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.127072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.127435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.127465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.127822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.128246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.128277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.128726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.129149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.129180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.129546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.129947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.129977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.130406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.130809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.130838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.131194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.131622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.131652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.132065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.132483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.132512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.132854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.133280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.133311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.133655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.134015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.134053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.134401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.134818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.134847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.135150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.135503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.135518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.135941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.136319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.136351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.136662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.137091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.137122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.137416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.137840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.137869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.138185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.138590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.138619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.138966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.139387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.139417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.247 qpair failed and we were unable to recover it. 00:29:11.247 [2024-07-22 20:34:43.139828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.247 [2024-07-22 20:34:43.140181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.140212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.140618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.140835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.140864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.141245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.141646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.141676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.142084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.142510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.142540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.142978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.143332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.143363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.143765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.144136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.144175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.144520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.144868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.144898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.145124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.145472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.145502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.145902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.146302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.146333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.146713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.147137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.147168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.147461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.147766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.147795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.148225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.148680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.148709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.149133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.149427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.149457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.149801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.150225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.150256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.150644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.151063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.151095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.151468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.151892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.151922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.152278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.152632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.152661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.153069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.153336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.153365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.153709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.154040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.154061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.154319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.154604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.154633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.155001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.155432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.155463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.155840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.156142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.156173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.156577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.156954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.156983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.157324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.157730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.157759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.158122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.158495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.158525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.158947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.159370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.159401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.248 [2024-07-22 20:34:43.159828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.160176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.248 [2024-07-22 20:34:43.160219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.248 qpair failed and we were unable to recover it. 00:29:11.249 [2024-07-22 20:34:43.160666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.160943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.160957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.249 qpair failed and we were unable to recover it. 00:29:11.249 [2024-07-22 20:34:43.161172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.161492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.161522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.249 qpair failed and we were unable to recover it. 00:29:11.249 [2024-07-22 20:34:43.161809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.162103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.162133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.249 qpair failed and we were unable to recover it. 00:29:11.249 [2024-07-22 20:34:43.162571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.162921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.162935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.249 qpair failed and we were unable to recover it. 00:29:11.249 [2024-07-22 20:34:43.163266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.163606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.163636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.249 qpair failed and we were unable to recover it. 00:29:11.249 [2024-07-22 20:34:43.164063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.164444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.164474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.249 qpair failed and we were unable to recover it. 00:29:11.249 [2024-07-22 20:34:43.164826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.165133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.249 [2024-07-22 20:34:43.165148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.249 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.165521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.165841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.165856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.166184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.166520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.166550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.166897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.167236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.167271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.167682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.168081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.168112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.168356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.168560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.168575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.168901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.169295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.169326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.169758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.170180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.170212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.170599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.170949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.170979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.171343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.171683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.171712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.171868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.172218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.172249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.172654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.172942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.172972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.173335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.173759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.173788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.174151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.174496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.174531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.174763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.175164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.175195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.175574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.176036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.176076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.176427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.176828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.176858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.177193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.177593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.177622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.178058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.178345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.178374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.178796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.179124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.179139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.179467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.179767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.179804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.180128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.180453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.180483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.180886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.181245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.181277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.181627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.181970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.182006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.182354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.182660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.182691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.183123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.183413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.183442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.183787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.184137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.184168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.184511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.184933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.184962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.185318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.185729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.185759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.186122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.186524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.186554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.186918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.187318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.187348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.521 qpair failed and we were unable to recover it. 00:29:11.521 [2024-07-22 20:34:43.187720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.521 [2024-07-22 20:34:43.188041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.188061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.188389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.188740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.188770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.189203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.189540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.189575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.189916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.190252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.190283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.190724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.191113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.191144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.191532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.191959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.191989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.192347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.192689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.192703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.192891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.193291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.193322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.193729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.194126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.194156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.194585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.194921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.194951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.195388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.195727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.195757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.196113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.196521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.196550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.196980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.197331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.197363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.197800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.198225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.198256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.198570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.198994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.199024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.199464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.199798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.199813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.200157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.200514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.200544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.200703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.201099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.201130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.201482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.201800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.201815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.202137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.202512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.202526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.202818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.203034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.203078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.203482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.204023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.204063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.204479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.204851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.204866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.205242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.205546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.205561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.205949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.206233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.206264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.206553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.206951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.206981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.207328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.207755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.207786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.208091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.208438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.208468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.208632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.208945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.208975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.209317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.209752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.209781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.210206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.210614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.210643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.211000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.211425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.211457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.211757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.212109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.212139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.212574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.213019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.213060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.213279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.213644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.213673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.214111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.214456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.214486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.522 qpair failed and we were unable to recover it. 00:29:11.522 [2024-07-22 20:34:43.214776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.215195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.522 [2024-07-22 20:34:43.215225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.215618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.216062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.216093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.216493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.216842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.216872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.217231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.217632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.217661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.218069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.218438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.218468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.218835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.219251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.219282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.219682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.220031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.220071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.220518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.220862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.220891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.221243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.221535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.221565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.221911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.222205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.222236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.222635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.222941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.222970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.223408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.223684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.223714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.224144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.224512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.224526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.224839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.225016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.225052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.225405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.225737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.225751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.226158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.226498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.226527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.226880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.227293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.227324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.227734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.228008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.228038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.228349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.228746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.228776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.229209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.229554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.229584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.229926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.230141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.230172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.230605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.230882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.230897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.231144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.231406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.231421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.231811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.232060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.232076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.232573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.232865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.232895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.233233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.233585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.233615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.233921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.234222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.234236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.234608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.235026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.235075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.235456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.235795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.235825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.236113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.236534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.236564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.236785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.237119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.237150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.237514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.237861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.237890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.238317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.238741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.238768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.239121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.239577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.239606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.239994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.240293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.240324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.240693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.241023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.523 [2024-07-22 20:34:43.241064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.523 qpair failed and we were unable to recover it. 00:29:11.523 [2024-07-22 20:34:43.241369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.241710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.241725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.242123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.242496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.242526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.242971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.243222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.243237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.243548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.243920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.243950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.244295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.244649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.244678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.245011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.245359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.245389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.245744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.245960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.245989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.246351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.246723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.246752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.246907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.247293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.247308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.247683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.247982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.248012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.248428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.248706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.248736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.249095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.249440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.249470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.249851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.250141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.250172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.250622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.250962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.250991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.251360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.251697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.251711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.252105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.252508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.252537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.252942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.253295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.253325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.253693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.253973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.254002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.254311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.254645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.254675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.255076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.255507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.255544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.255942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.256237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.256269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.256608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.257037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.257075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.257461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.257748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.257777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.258204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.258604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.258634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.259057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.259434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.259464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.259753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.260099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.260131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.260508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.260729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.260758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.261182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.261501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.261530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.524 qpair failed and we were unable to recover it. 00:29:11.524 [2024-07-22 20:34:43.261883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.524 [2024-07-22 20:34:43.262161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.262176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.262456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.262855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.262885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.263315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.263715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.263744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.264033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.264501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.264531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.264876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.265299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.265330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.265729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.266011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.266040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.266419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.266758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.266788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.267133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.267406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.267435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.267731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.268160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.268175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.268498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.268823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.268853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.269143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.269541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.269570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.269919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.270265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.270296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.270639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.271064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.271095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.271375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.271666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.271696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.272055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.272346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.272375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.272732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.273101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.273132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.273423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.273824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.273853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.274291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.274635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.274664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.275071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.275421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.275451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.275806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.276225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.276256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.276552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.276898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.276928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.277356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.277777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.277806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.278149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.278586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.278616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.278971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.279339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.279370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.279705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.280129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.280160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.280447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.280726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.280757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.281113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.281438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.281453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.281824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.282246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.282277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.282593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.282938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.282967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.283329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.283663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.283693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.284128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.284432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.284462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.284753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.285082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.285113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.285463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.285825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.285855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.286220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.286630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.286665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.287009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.287369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.287399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.287740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.288163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.288193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.288551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.288884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.288913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.289295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.289601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.289630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.289992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.290344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.290374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.290824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.291224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.291254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.291612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.291967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.291997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.292407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.292843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.292873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.293226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.293505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.293534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.293939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.294363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.294399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.525 [2024-07-22 20:34:43.294781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.295137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.525 [2024-07-22 20:34:43.295167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.525 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.295519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.295871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.295900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.296203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.296604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.296634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.296994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.297364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.297395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.297759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.298159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.298191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.298557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.298905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.298935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.299340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.299720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.299750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.300103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.300349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.300363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.300692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.301026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.301065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.301418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.301789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.301824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.302128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.302479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.302508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.302857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.303257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.303287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.303670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.304062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.304093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.304522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.304858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.304887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.305319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.305735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.305764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.306142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.306577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.306606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.306903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.307300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.307331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.307756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.308050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.308081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.308381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.308652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.308682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.309052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.309398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.309434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.309812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.310210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.310241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.310587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.311030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.311079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.311417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.311827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.311857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.312283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.312707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.312736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.313082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.313413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.313443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.313847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.314291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.314322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.314676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.315112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.315143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.315555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.315747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.315776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.316124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.316459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.316488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.316890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.317109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.317140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.317439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.317860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.317890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.318292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.318579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.318609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.318954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.319291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.319322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.319603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.319953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.319984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.320387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.320732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.320761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.321128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.321545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.321574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.322003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.322399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.322430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.322833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.323180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.323211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.323523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.323868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.323897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.324250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.324471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.324500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.324874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.325252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.325282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.325635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.326071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.326101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.326473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.326874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.326903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.327189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.327481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.327512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.526 qpair failed and we were unable to recover it. 00:29:11.526 [2024-07-22 20:34:43.327894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.328189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.526 [2024-07-22 20:34:43.328220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.328573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.328910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.328940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.329304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.329709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.329739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.330106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.330440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.330469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.330813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.331160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.331191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.331622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.332026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.332065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.332481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.332916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.332945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.333294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.333655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.333684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.333987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.334437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.334467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.334895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.335272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.335303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.335659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.336022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.336149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.336557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.336723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.336753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.337169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.337451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.337481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.337828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.338114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.338129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.338491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.338852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.338881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.339303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.339716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.339745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.340125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.340467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.340496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.340712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.341050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.341082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.341513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.341853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.341883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.342326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.342669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.342699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.343064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.343412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.343442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.343849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.344206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.344238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.344575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.344912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.344942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.345313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.345726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.345756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.346111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.346457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.346487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.346894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.347261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.347292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.347583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.347927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.347956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.348303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.348727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.348757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.349126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.349439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.349468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.349785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.350142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.350172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.350552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.350827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.350856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.351211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.351648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.351677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.352065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.352464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.352493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.352836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.353209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.353240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.353669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.353965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.353996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.354413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.354760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.354790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.355230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.355579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.355608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.355981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.356352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.356383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.356799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.357105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.357135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.357563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.357909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.357939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.358281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.358623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.358652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.359057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.359509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.359538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.359964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.360390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.360421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.360785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.361206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.361236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.361665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.362067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.362097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.527 qpair failed and we were unable to recover it. 00:29:11.527 [2024-07-22 20:34:43.362460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.527 [2024-07-22 20:34:43.362799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.362828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.363259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.363573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.363603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.364004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.364413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.364444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.364813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.365154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.365186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.365533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.365869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.365898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.366356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.366758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.366788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.367074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.367493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.367523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.367876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.368210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.368259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.368693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.369106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.369137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.369439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.369797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.369826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.370188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.370631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.370660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.370884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.371217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.371247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.371675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.372056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.372086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.372441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.372730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.372760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.373173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.373508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.373537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.373989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.374265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.374280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.374673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.375096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.375127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.375488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.375934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.375964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.376368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.376708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.376737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.377147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.377575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.377605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.377810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.378234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.378266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.378624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.378973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.379003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.379440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.379812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.379842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.380288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.380716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.380745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.381095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.381524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.381553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.381957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.382360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.382390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.382739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.383163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.383193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.383543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.383759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.383789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.384189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.384597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.384627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.385064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.385417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.385447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.385885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.386233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.386264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.386621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.386995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.387025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.387442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.387875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.387904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.388262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.388615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.388644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.389062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.389440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.389470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.389831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.390285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.390299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.390699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.391106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.391136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.391558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.391891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.391920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.392344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.392762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.392777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.393152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.393453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.393483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.393678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.394076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.394107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.394511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.394859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.394890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.395359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.395710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.395740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.396146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.396496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.396525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.396919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.397271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.397302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.397728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.398152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.528 [2024-07-22 20:34:43.398183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.528 qpair failed and we were unable to recover it. 00:29:11.528 [2024-07-22 20:34:43.398592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.398892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.398921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.399275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.399677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.399707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.400158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.400375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.400405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.400837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.401172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.401202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.401608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.401950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.401979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.402337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.402703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.402732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.403136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.403468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.403498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.403838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.404190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.404220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.404569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.404933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.404964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.405381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.405697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.405727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.406073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.406491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.406521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.406950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.407350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.407380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.407730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.408078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.408108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.408505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.408864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.408894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.409299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.409664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.409694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.410067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.410421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.410456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.410809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.411153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.411184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.411596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.411995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.412025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.412385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.412808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.412837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.413186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.413502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.413531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.413905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.414331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.414362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.414792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.415054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.415069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.415408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.415777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.415807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.416228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.416482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.416511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.416860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.417137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.417168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.417514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.417696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.417713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.418032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.418477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.418507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.418815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.419159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.419174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.419548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.419975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.420005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.420332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.420756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.420786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.421138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.421482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.421511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.421877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.422285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.422316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.422720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.423069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.423100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.423551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.423922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.423952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.424234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.424642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.424672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.425027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.425432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.425449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.425818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.426090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.426120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.426407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.426752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.426782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.427135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.427485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.427514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.427951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.428317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.428347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.428794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.429147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.429178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.429522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.429898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.429928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.430283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.430708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.430738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.431182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.431515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.431544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.431892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.432324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.432355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.432628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.432978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.433008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.433446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.433790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.433820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.434245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.434665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.434695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.435055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.435484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.435514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.435924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.436343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.436374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.436779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.437143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.437173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.529 qpair failed and we were unable to recover it. 00:29:11.529 [2024-07-22 20:34:43.437615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.529 [2024-07-22 20:34:43.437989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.438018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.438405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.438765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.438794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.439148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.439594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.439623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.439977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.440420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.440450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.440799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.441130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.441161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.441567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.441927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.441957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.442342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.442734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.442764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.443110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3583785 Killed "${NVMF_APP[@]}" "$@" 00:29:11.530 [2024-07-22 20:34:43.443443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.443458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 20:34:43 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:29:11.530 20:34:43 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:29:11.530 20:34:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:11.530 20:34:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:11.530 [2024-07-22 20:34:43.443838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 20:34:43 -- common/autotest_common.sh@10 -- # set +x 00:29:11.530 [2024-07-22 20:34:43.444224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.444239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.444555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.444868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.444882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.445210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.445514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.445529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.445785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.446123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.446139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.446530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.446851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.446865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.447256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.447588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.447606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.447924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.448292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.448307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 20:34:43 -- nvmf/common.sh@469 -- # nvmfpid=3584518 00:29:11.530 20:34:43 -- nvmf/common.sh@470 -- # waitforlisten 3584518 00:29:11.530 [2024-07-22 20:34:43.448680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 20:34:43 -- common/autotest_common.sh@819 -- # '[' -z 3584518 ']' 00:29:11.530 20:34:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:11.530 20:34:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:11.530 20:34:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:11.530 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:11.530 [2024-07-22 20:34:43.448942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.448957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 20:34:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:11.530 20:34:43 -- common/autotest_common.sh@10 -- # set +x 00:29:11.530 [2024-07-22 20:34:43.449286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 20:34:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:29:11.530 [2024-07-22 20:34:43.449538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.449553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.449905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.450295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.450310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.530 [2024-07-22 20:34:43.450638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.451032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.530 [2024-07-22 20:34:43.451053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.530 qpair failed and we were unable to recover it. 00:29:11.796 [2024-07-22 20:34:43.451330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.451723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.451738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.452137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.452408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.452422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.452731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.452990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.453025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.453406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.453835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.453865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.454233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.454614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.454629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.454949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.455284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.455299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.455622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.455996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.456011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.456333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.456607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.456621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.456886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.457192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.457208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.457522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.458054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.458069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.458411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.458742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.458757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.459023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.459546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.459560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.459979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.460139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.460154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.460473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.460724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.460739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.461054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.461394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.461408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.461712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.462027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.462041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.462364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.462614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.462628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.463024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.463361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.463375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.463697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.464007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.464022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.464407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.464663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.464678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.465032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.465454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.465469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.465847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.466151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.466166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.466564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.466936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.466951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.467388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.467641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.467654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.467980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.468299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.468315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.468633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.468957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.797 [2024-07-22 20:34:43.468971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.797 qpair failed and we were unable to recover it. 00:29:11.797 [2024-07-22 20:34:43.469308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.469565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.469579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.469980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.470297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.470312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.470615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.470936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.470950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.471273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.471587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.471601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.471975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.472279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.472294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.472559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.472880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.472894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.473171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.473487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.473501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.473781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.473939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.473954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.474266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.474549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.474563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.474914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.475428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.475443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.475748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.476090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.476105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.476435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.476685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.476700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.477031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.477400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.477415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.477739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.478055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.478070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.478388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.478716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.478732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.478849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.479183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.479198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.479447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.479773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.479787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.480129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.480273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.480287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.480677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.480944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.480959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.481329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.481566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.798 [2024-07-22 20:34:43.481580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.798 qpair failed and we were unable to recover it. 00:29:11.798 [2024-07-22 20:34:43.481924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.482243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.482259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.482601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.482997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.483011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.483333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.483657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.483672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.484057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.484380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.484394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.484703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.484961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.484975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.485292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.485559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.485574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.485885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.486254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.486270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.486622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.486942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.486956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.487289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.487559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.487573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.488016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.488267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.488282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.488603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.488918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.488932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.489302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.489829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.489843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.490219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.490489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.490504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.490897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.491215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.491230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.491330] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:29:11.799 [2024-07-22 20:34:43.491370] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:11.799 [2024-07-22 20:34:43.491632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.491974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.491986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.492314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.492561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.492576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.492835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.493174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.493188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.799 [2024-07-22 20:34:43.493580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.493889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.799 [2024-07-22 20:34:43.493903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.799 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.494325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.494578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.494593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.495013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.495271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.495286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.495595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.495914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.495928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.496301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.496489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.496504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.496835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.497094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.497109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.497504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.497810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.497824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.498097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.498454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.498468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.498672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.498989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.499003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.499339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.499652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.499666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.499974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.500297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.500312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.500648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.501066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.501081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.501411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.501744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.501758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.502089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.502437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.502451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.502754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.503076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.503091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.503355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.503601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.503616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.503939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.504336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.504350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.504749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.505065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.505080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.505366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.505667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.505682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.800 qpair failed and we were unable to recover it. 00:29:11.800 [2024-07-22 20:34:43.505991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.506314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.800 [2024-07-22 20:34:43.506331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.506587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.506916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.506930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.507284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.507674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.507688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.508097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.508252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.508266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.508581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.508901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.508915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.509285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.509562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.509576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.509875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.510064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.510079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.510401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.510801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.510816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.511057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.511359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.511374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.511651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.512021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.512036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.512352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.512617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.512631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.512883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.513281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.513295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.513638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.513842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.513856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.514123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.514308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.514322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.514649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.514985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.514999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.515397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.515769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.515783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.516173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.516481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.516495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.516818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.517142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.517157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.517473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.517865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 [2024-07-22 20:34:43.517880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.801 qpair failed and we were unable to recover it. 00:29:11.801 [2024-07-22 20:34:43.518221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.801 EAL: No free 2048 kB hugepages reported on node 1 00:29:11.801 [2024-07-22 20:34:43.518540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.518555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.518880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.519070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.519085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.519455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.519781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.519795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.520111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.520431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.520445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.520752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.521064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.521079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.521425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.521748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.521762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.522136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.522459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.522474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.522869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.523113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.523128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.523522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.523835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.523849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.524195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.524567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.524582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.524960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.525309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.525324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.525569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.525888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.525902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.526300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.526613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.526628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.526975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.527374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.527388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.527702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.528105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.528121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.528500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.528890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.528905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.529094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.529429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.529443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.529833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.530134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.530149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.802 qpair failed and we were unable to recover it. 00:29:11.802 [2024-07-22 20:34:43.530499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.802 [2024-07-22 20:34:43.530738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.530751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.531063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.531456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.531470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.531781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.532148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.532163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.532429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.532697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.532716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.533093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.533207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.533221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.533555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.533871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.533886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.534258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.534574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.534589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.534908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.535020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.535034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.535374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.535702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.535717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.536031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.536357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.536372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.536696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.537012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.537027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.537288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.537692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.537706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.537977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.538177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.538191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.538512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.538904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.538921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.803 qpair failed and we were unable to recover it. 00:29:11.803 [2024-07-22 20:34:43.539173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.803 [2024-07-22 20:34:43.539482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.539496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.539626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.539946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.539961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.540281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.540541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.540555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.540813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.540937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.540952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.541345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.541647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.541662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.542048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.542418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.542432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.542800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.543193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.543207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.543558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.543926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.543940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.544324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.544717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.544731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.544993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.545386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.545404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.545798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.546168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.546182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.546448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.546815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.546830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.547215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.547519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.547533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.547851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.548166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.548181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.548525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.548917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.548931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.549324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.549580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.549595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.549914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.550173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.550189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.550557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.550881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.550895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.551148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.551455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.551471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.804 qpair failed and we were unable to recover it. 00:29:11.804 [2024-07-22 20:34:43.551785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.552125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.804 [2024-07-22 20:34:43.552144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.552551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.552853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.552867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.553192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.553575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.553590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.553902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.554041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.554063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.554379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.554772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.554787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.554971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.555282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.555297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.555621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.555959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.555974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.556234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.556631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.556646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.556965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.557336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.557351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.557728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.558049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.558064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.558193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.558584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.558598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.558972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.559368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.559384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.559776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.560129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.560144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.560523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.560701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:11.805 [2024-07-22 20:34:43.560773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.560787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.561131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.561499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.561513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.561893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.562289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.562304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.562619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.562953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.562967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.563309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.563492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.563507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.563771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.564081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.564097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.564494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.564810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.564825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.805 [2024-07-22 20:34:43.565097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.565489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.805 [2024-07-22 20:34:43.565506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.805 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.565814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.566117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.566132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.566540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.566860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.566875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.567008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.567324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.567339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.567712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.568110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.568125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.568404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.568772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.568787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.569128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.569447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.569463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.569729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.569968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.569983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.570291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.570604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.570619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.570993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.571306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.571320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.571707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.572021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.572039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.572417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.572752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.572767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.573164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.573351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.573366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.573696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.574018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.574032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.574300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.574618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.574633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.575028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.575341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.575356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.575700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.576077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.576092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.576493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.576761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.576776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.577106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.577446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.577460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.577772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.578117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.578131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.578434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.578778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.578796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.806 [2024-07-22 20:34:43.579195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.579375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.806 [2024-07-22 20:34:43.579390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.806 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.579705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.580096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.580111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.580429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.580801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.580817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.581148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.581426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.581440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.581780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.582172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.582187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.582578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.582964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.582979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.583305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.583559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.583573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.583822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.584230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.584245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.584616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.585004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.585018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.585355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.585729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.585743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.586098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.586422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.586437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.586783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.587113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.587128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.587498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.587914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.587929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.588238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.588556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.588570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.588888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.589260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.589275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.589587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.589968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.589983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.590306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.590607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.590621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.591016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.591257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.591273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.591613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.591879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.591894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.592155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.592406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.592421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.592791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.593103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.593118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.593455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.593781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.593796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.807 [2024-07-22 20:34:43.594058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.594381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.807 [2024-07-22 20:34:43.594397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.807 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.594715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.594899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.594914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.595218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.595586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.595601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.595907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.596243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.596264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.596662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.597041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.597071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.597481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.597691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.597707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.598031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.598389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.598406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.598801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.599191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.599206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.599518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.599849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.599865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.600208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.600533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.600549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.600929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.601119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.601135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.601456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.601716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.601731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.602050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.602452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.602468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.602727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.603069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.603086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.603480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.603792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.603808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.604123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.604514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.604531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.604785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.605108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.605125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.605447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.605797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.605812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.606135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.606461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.606476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.606882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.607200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.607215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.607589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.607714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.607729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.608052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.608370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.608385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.608650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.608973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.608987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.609117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.609386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.609401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.609783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.610120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.610135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.610506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.610873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.610889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.611078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.611391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.611406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.808 qpair failed and we were unable to recover it. 00:29:11.808 [2024-07-22 20:34:43.611671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.611981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.808 [2024-07-22 20:34:43.611996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.612305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.612627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.612642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.613066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.613383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.613397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.613608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.613860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.613876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.614066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.614438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.614452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.614833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.615224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.615239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.615494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.615813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.615827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.616049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.616300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.616315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.616635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.616959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.616973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.617235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.617565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.617579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.617893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.618261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.618276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.618469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.618839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.618854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.619139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.619548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.619562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.619693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.620080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.620094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.620488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.620829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.620844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.621215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.621472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.621486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.621770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.622037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.622057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.622259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.622520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.622534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.622800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.623107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.623122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.623383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.623697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.623712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.624017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.624362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.624377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.624494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.624740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.624754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.625068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.625446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.625460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.809 qpair failed and we were unable to recover it. 00:29:11.809 [2024-07-22 20:34:43.625783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.809 [2024-07-22 20:34:43.626104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.626119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.626380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.626769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.626783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.627111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.627316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.627330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.627723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.627984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.627998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.628328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.628629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.628643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.628821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.629187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.629202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.629539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.629856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.629870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.630190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.630512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.630527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.630819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.631172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.631188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.631503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.631892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.631908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.632162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.632309] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:11.810 [2024-07-22 20:34:43.632407] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:11.810 [2024-07-22 20:34:43.632417] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:11.810 [2024-07-22 20:34:43.632423] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:11.810 [2024-07-22 20:34:43.632550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.632561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.632533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:29:11.810 [2024-07-22 20:34:43.632641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:29:11.810 [2024-07-22 20:34:43.632747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:29:11.810 [2024-07-22 20:34:43.632749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:29:11.810 [2024-07-22 20:34:43.632927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.633237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.633251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.633577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.633969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.633981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.634242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.634610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.634621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.634916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.635299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.635310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.635618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.635945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.635956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.636330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.636690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.636705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.637102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.637487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.637501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.637883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.638272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.638288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.638600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.638971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.638986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.639335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.639648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.639663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.640035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.640428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.640443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.640814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.641162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.641178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.641497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.641896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.641913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.642296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.642522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.642539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.642852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.642975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.810 [2024-07-22 20:34:43.642990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf0000b90 with addr=10.0.0.2, port=4420 00:29:11.810 qpair failed and we were unable to recover it. 00:29:11.810 [2024-07-22 20:34:43.643119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2355200 is same with the state(5) to be set 00:29:11.810 [2024-07-22 20:34:43.643549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.643870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.643886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2347710 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.644289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.644605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.644616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.645004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.645328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.645339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.645699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.646020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.646031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.646420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.646796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.646807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.647215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.647577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.647588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.647950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.648364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.648375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.648775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.649088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.649100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.649416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.649733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.649745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.649981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.650378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.650389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.650762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.651123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.651134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.651519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.651880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.651892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.652281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.652669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.652681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.652998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.653338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.653349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.653675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.653991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.654003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.654395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.654761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.654774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.655185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.655493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.655504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.655868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.656239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.656252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.656643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.657017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.657031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.657428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.657818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.657832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.658196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.658567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.658583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.658973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.659364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.659377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.659743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.660069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.660082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.660426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.660817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.660832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.661222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.661579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.661592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.661958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.662343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.662357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.662750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.663077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.663091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.663402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.663764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.663777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.811 qpair failed and we were unable to recover it. 00:29:11.811 [2024-07-22 20:34:43.664165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.811 [2024-07-22 20:34:43.664426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.664440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.664844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.665233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.665245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.665613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.665976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.665988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.666293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.666678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.666692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.667084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.667476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.667489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.667751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.668138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.668150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.668480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.668842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.668854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.669269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.669641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.669652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.669960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.670323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.670334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.670726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.670994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.671005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.671300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.671692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.671703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.672066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.672391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.672402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.672774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.673135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.673147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.673566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.673908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.673920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.674310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.674678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.674690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.674998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.675365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.675377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.675739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.676076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.676089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.676402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.676732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.676744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.677052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.677444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.677455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.677841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.678174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.678187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.678570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.678804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.678818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.679188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.679555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.679568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.679895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.680260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.680285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.680535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.680902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.680913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.681297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.681691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.681703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.682123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.682493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.682505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.682818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.683182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.683194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.683514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.683901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.683912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.812 [2024-07-22 20:34:43.684304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.684558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.812 [2024-07-22 20:34:43.684570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.812 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.684824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.685202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.685213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.685513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.685825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.685836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.686163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.686528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.686541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.686878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.687192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.687205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.687577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.687879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.687890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.688195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.688588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.688600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.688986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.689347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.689358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.689685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.690075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.690086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.690476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.690841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.690852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.691200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.691591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.691602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.691989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.692283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.692294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.692608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.692941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.692952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.693335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.693727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.693739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.693969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.694291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.694303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.694557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.694924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.694936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.695295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.695706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.695717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.696060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.696446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.696457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.696850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.697088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.697100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.697427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.697794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.697805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.698152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.698476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.698487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.698733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.699094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.699105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.699418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.699790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.699802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.700111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.700518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.700529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.700793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.701056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.701068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.701403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.701735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.701746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.702017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.702277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.702289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.702559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.702869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.702880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.703196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.703460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.813 [2024-07-22 20:34:43.703471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.813 qpair failed and we were unable to recover it. 00:29:11.813 [2024-07-22 20:34:43.703844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.814 [2024-07-22 20:34:43.704141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.814 [2024-07-22 20:34:43.704151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.814 qpair failed and we were unable to recover it. 00:29:11.814 [2024-07-22 20:34:43.704487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.814 [2024-07-22 20:34:43.704867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.814 [2024-07-22 20:34:43.704878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.814 qpair failed and we were unable to recover it. 00:29:11.814 [2024-07-22 20:34:43.705255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.705497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.705508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.705813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.706204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.706215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.706550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.706913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.706924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.707223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.707545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.707556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.707951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.708209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.708221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.708551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.708862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.708873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.709199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.709567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.709578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.709942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.710242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.710253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.710567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.710940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.710952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.711307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.711693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.711705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.712098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.712437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.712448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.712839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.713174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.713186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.713552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.713798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.713809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.714140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.714508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.714518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.714791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.715154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.715165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.715365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.715635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.715647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.715943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.716325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.716337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.716835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.717146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.717157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.717406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.717745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.717756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.718065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.718314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.718324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.815 [2024-07-22 20:34:43.718620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.718729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.815 [2024-07-22 20:34:43.718740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.815 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.718927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.719334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.719345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.719669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.720051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.720062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.720316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.720626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.720639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.720910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.721255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.721270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.721642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.721954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.721968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.722253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.722441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.722452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.722840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.722949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.722965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.723278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.723654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.723667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.723926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.724185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.724196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.724547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.724862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.816 [2024-07-22 20:34:43.724875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:11.816 qpair failed and we were unable to recover it. 00:29:11.816 [2024-07-22 20:34:43.725250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.725551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.725562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.725814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.726141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.726157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.726551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.726871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.726886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.727201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.727456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.727468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.727780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.728028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.728040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.728292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.728545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.728556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.728857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.729031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.729046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.729290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.729658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.729670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.729935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.730186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.730198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.730586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.730865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.730877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.731152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.731389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.731401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.731589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.731851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.731863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.732253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.732499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.732513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.732830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.733123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.733134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.733400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.733767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.733779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.734227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.734478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.734489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.734735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.735099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.735112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.735352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.735584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.735595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.081 qpair failed and we were unable to recover it. 00:29:12.081 [2024-07-22 20:34:43.735986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.081 [2024-07-22 20:34:43.736249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.736261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.736588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.736837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.736848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.737025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.737268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.737280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.737643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.737952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.737963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.738247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.738552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.738563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.738947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.739188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.739199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.739440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.739672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.739683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.739937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.740274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.740285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.740546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.740913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.740924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.741165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.741289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.741299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.741617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.741901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.741913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.742252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.742563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.742574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.742894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.743146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.743158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.743418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.743653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.743664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.743993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.744236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.744248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.744508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.744754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.744766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.745014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.745335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.745346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.745611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.745917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.745928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.746234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.746492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.746504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.746689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.746962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.746974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.747279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.747516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.747528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.747770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.748027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.748038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.748357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.748718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.748729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.748962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.749281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.749292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.749535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.749800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.749812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.749927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.750195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.750206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.750441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.750740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.750751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.750993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.751106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.751117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.751415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.751717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.751728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.082 qpair failed and we were unable to recover it. 00:29:12.082 [2024-07-22 20:34:43.751843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.082 [2024-07-22 20:34:43.752216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.752227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.752535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.752857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.752869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.753196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.753507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.753517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.753837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.754143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.754154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.754592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.754995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.755009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.755188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.755547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.755560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.755695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.755957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.755970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.756334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.756729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.756741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.757061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.757372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.757383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.757635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.757940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.757952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.758219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.758455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.758466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.758834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.759092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.759105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.759466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.759723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.759734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.759993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.760259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.760270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.760571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.760830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.760841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.761086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.761402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.761415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.761554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.761896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.761907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.762024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.762297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.762310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.762744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.763061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.763073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.763382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.763792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.763803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.764100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.764403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.764414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.764756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.764994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.765005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.765258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.765499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.765510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.765817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.766119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.766130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.766254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.766573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.766585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.766893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.767280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.767293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.767705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.767887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.767897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.768197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.768459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.768470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.768716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.769134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.769144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.769416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.769671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.769683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.083 qpair failed and we were unable to recover it. 00:29:12.083 [2024-07-22 20:34:43.769988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.083 [2024-07-22 20:34:43.770289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.770302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.770655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.771066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.771078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.771332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.771564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.771575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.771791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.772111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.772123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.772377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.772689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.772700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.772961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.773257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.773269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.773577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.773828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.773839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.774171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.774417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.774428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.774751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.775066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.775078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.775374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.775741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.775753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.776074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.776332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.776343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.776646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.776899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.776911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.777172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.777419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.777430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.777673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.777989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.778001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.778270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.778574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.778586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.778844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.779148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.779165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.779471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.779643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.779654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.779893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.780131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.780143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.780440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.780765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.780776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.781021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.781408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.781419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.781756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.781991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.782002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.782272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.782511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.782522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.782767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.783129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.783140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.783422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.783728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.783739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.783974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.784221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.784232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.784603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.784907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.784919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.785151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.785406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.785417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.785714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.785972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.785983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.786312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.786613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.786623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.084 qpair failed and we were unable to recover it. 00:29:12.084 [2024-07-22 20:34:43.786869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.084 [2024-07-22 20:34:43.787256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.787267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.787590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.787891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.787901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.788233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.788597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.788608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.788907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.789213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.789224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.789369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.789771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.789783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.790032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.790361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.790372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.790680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.790931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.790941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.791184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.791495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.791507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.791767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.792039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.792054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.792292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.792542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.792552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.792852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.793109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.793121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.793379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.793629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.793639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.793880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.794196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.794207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.794506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.794851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.794862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.795172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.795499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.795510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.795830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.796068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.796080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.796330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.796660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.796671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.796902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.797215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.797226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.797540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.797952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.797963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.798345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.798706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.798717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.799079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.799398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.799409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.799666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.799994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.800005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.800309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.800623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.800634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.085 qpair failed and we were unable to recover it. 00:29:12.085 [2024-07-22 20:34:43.801054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.085 [2024-07-22 20:34:43.801309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.801320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.801586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.801839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.801849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.802237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.802559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.802571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.802973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.803342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.803353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.803716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.804029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.804040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.804344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.804515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.804525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.804831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.805096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.805107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.805419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.805732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.805743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.806086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.806412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.806423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.806755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.807170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.807181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.807498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.807832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.807843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.808214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.808494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.808505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.808844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.809230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.809242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.809606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.809927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.809938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.810272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.810621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.810634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.810981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.811296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.811308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.811566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.811879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.811890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.812271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.812581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.812592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.812922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.813336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.813348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.813663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.814078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.814090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.814309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.814627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.814639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.814967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.815288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.815299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.815551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.815954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.815964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.816264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.816532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.816542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.816923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.817333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.817346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.817661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.818069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.818080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.818353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.818672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.818684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.819076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.819331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.819342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.819656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.819981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.819993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.086 qpair failed and we were unable to recover it. 00:29:12.086 [2024-07-22 20:34:43.820313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.820622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.086 [2024-07-22 20:34:43.820633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.820983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.821310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.821321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.821684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.821989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.822000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.822322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.822741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.822751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.823055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.823369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.823382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.823742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.824130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.824143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.824398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.824761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.824772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.825194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.825499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.825509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.825838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.826149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.826161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.826501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.826821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.826831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.827204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.827470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.827481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.827783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.828086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.828097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.828360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.828661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.828672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.829112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.829429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.829441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.829703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.830020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.830030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.830289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.830600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.830615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.831012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.831334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.831345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.831767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.832140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.832152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.832417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.832726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.832736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.833046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.833345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.833356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.833696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.834062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.834072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.834412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.834831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.834842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.835211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.835532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.835543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.835949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.836204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.836216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.836496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.836803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.836814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.837159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.837472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.837483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.837794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.838104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.838116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.838368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.838688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.838699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.839111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.839427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.839437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.087 [2024-07-22 20:34:43.839751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.840116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.087 [2024-07-22 20:34:43.840129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.087 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.840382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.840647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.840658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.841048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.841374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.841385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.841701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.842107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.842119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.842504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.842863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.842874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.843248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.843572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.843583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.843934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.844256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.844267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.844631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.845004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.845016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.845309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.845550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.845561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.845951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.846331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.846342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.846662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.846974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.846985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.847348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.847711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.847722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.848056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.848415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.848425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.848661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.849079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.849090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.849352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.849740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.849751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.850140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.850405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.850416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.850793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.851178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.851190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.851510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.851918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.851929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.852258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.852560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.852570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.852941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.853247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.853258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.853659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.853963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.853973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.854307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.854623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.854634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.854973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.855240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.855252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.855515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.855775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.855786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.856125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.856508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.856519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.856844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.857227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.857239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.857557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.857813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.857823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.858139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.858511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.858522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.858772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.859073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.859085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.859395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.859664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.859674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.088 [2024-07-22 20:34:43.860062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.860479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.088 [2024-07-22 20:34:43.860490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.088 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.860809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.861220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.861231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.861547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.861920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.861931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.862345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.862685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.862697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.863009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.863315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.863325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.863689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.864008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.864020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.864380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.864694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.864705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.865071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.865329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.865340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.865712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.866076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.866088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.866403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.866704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.866715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.866963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.867358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.867369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.867686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.867997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.868007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.868371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.868812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.868822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.869220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.869549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.869560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.869875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.870151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.870162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.870502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.870756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.870766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.871106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.871466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.871477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.871799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.872132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.872143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.872400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.872698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.872709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.873103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.873335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.873347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.873707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.874174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.874185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.874577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.874843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.874854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.875224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.875532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.875543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.875875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.876194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.876206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.876460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.876844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.876855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.877226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.877571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.877582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.878031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.878324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.878336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.878604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.879023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.879034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.879410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.879722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.879733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.880126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.880384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.880395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.880711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.881091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.881103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.089 qpair failed and we were unable to recover it. 00:29:12.089 [2024-07-22 20:34:43.881420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.089 [2024-07-22 20:34:43.881804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.881815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.882147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.882406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.882417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.882745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.883058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.883069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.883435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.883740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.883751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.884140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.884478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.884489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.884804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.885106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.885116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.885475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.885789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.885800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.886163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.886476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.886487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.886949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.887334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.887345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.887592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.887906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.887917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.888231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.888553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.888564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.888892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.889188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.889199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.889503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.889902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.889914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.890342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.890660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.890671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.891049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.891370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.891380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.891741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.892114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.892126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.892424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.892740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.892751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.893002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.893332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.893343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.893649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.893963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.893974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.894295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.894714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.894725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.895112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.895362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.895373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.895758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.896067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.896079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.896441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.896755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.896765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.897128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.897394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.897405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.897717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.898075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.898086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.898396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.898656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.898667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.090 qpair failed and we were unable to recover it. 00:29:12.090 [2024-07-22 20:34:43.898919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.090 [2024-07-22 20:34:43.899279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.899290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.899616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.900060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.900072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.900340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.900729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.900739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.901115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.901438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.901449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.901723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.902051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.902062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.902394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.902699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.902710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.903169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.903531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.903543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.903883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.904283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.904294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.904681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.905015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.905027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.905337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.905651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.905662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.905975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.906227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.906238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.906507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.906810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.906821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.907200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.907505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.907515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.907867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.908293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.908304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.908618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.908934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.908945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.909249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.909624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.909635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.910022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.910341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.910353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.910617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.910873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.910884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.911257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.911647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.911658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.911913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.912272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.912284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.912600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.912985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.912996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.913379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.913640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.913651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.914001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.914262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.914273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.914541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.914871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.914881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.915150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.915528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.915539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.915867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.916190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.916202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.916567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.916921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.916932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.917359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.917673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.917684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.918063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.918395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.918406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.918675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.918916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.918928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.919263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.919524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.091 [2024-07-22 20:34:43.919537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.091 qpair failed and we were unable to recover it. 00:29:12.091 [2024-07-22 20:34:43.919930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.920269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.920281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.920537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.920916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.920927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.921264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.921562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.921573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.922039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.922430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.922442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.922692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.922999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.923010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.923396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.923665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.923676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.924062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.924327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.924338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.924595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.924986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.924997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.925317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.925571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.925582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.925894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.926287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.926300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.926699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.927011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.927022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.927347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.927708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.927719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.928038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.928308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.928319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.928567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.928953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.928964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.929291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.929619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.929630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.930054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.930391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.930402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.930673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.931062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.931074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.931394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.931711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.931722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.932111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.932433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.932443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.932746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.933040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.933060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.933393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.933728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.933739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.934101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.934353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.934364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.934680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.934985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.934996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.935387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.935829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.935840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.936072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.936342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.936353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.936715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.937077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.937089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.937356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.937666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.937677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.937998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.938365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.938377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.938794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.939166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.939177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.939652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.940072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.940085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.092 [2024-07-22 20:34:43.940480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.940823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.092 [2024-07-22 20:34:43.940834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.092 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.941111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.941383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.941394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.941707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.942069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.942080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.942330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.942602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.942613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.943015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.943284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.943295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.943565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.943992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.944003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.944374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.944692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.944703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.945070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.945343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.945354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.945678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.946056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.946068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.946432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.946917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.946928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.947263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.947625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.947636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.947952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.948281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.948293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.948597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.948996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.949007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.949322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.949588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.949599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.949908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.950222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.950233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.950551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.950874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.950885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.951253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.951565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.951577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.951972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.952302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.952313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.952569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.952883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.952893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.953283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.953597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.953608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.954013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.954488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.954499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.954815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.955166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.955177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.955440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.955810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.955821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.956131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.956492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.956503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.956847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.957292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.957304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.957571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.957955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.957966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.958216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.958579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.958590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.959007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.959326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.959338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.959700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.960112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.960123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.960383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.960641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.960652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.961044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.961338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.961350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.093 qpair failed and we were unable to recover it. 00:29:12.093 [2024-07-22 20:34:43.961665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.093 [2024-07-22 20:34:43.962082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.962093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.962361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.962626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.962638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.963104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.963493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.963504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.963755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.964028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.964039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.964373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.964704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.964715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.965210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.965533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.965544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.965892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.966134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.966144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.966454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.966767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.966778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.967186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.967455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.967466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.967735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.968045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.968057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.968373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.968700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.968711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.968974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.969299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.969310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.969627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.969949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.969960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.970207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.970568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.970579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.970923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.971287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.971299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.971672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.971911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.971923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.972283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.972597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.972609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.973011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.973328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.973339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.973680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.974065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.974076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.974325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.974647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.974657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.975048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.975361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.975371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.975636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.976020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.976031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.976363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.976752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.976762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.977080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.977334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.977346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.977870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.978118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.978130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.978447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.978701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.978711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.094 qpair failed and we were unable to recover it. 00:29:12.094 [2024-07-22 20:34:43.979075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.979390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.094 [2024-07-22 20:34:43.979400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.979716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.980049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.980060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.980379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.980692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.980703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.981090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.981399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.981410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.981795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.982104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.982115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.982420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.982720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.982731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.982989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.983243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.983255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.983562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.983814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.983825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.984130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.984501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.984512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.984898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.985233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.985245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.985615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.986018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.986029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.986357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.986719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.986730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.987095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.987567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.987578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.987899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.988262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.988273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.988635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.988874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.988885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.989130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.989438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.989449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.989766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.990083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.990094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.990413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.990723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.990734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.991123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.991438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.991449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.991745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.992003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.992015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.992327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.992697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.992708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.993054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.993543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.993553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.993891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.994283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.994294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.994633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.995169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.995180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.995432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.995796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.995807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.996189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.996445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.996457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.996730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.997137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.997147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.997409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.997744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.997755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.998152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.998467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.998478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.998786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.999160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.999171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:43.999439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.999693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:43.999704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.095 qpair failed and we were unable to recover it. 00:29:12.095 [2024-07-22 20:34:44.000108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.095 [2024-07-22 20:34:44.000496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.000506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.000974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.001340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.001351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.001731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.002035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.002053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.002324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.002590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.002601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.003033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.003344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.003355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.003618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.003877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.003887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.004229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.004481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.004492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.004769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.005073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.005084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.005387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.005691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.005701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.006094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.006436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.006447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.006758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.007094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.007108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.007428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.007693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.007704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.008030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.008277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.008289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.008603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.008981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.008994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.009362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.009631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.009642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.009996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.010303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.096 [2024-07-22 20:34:44.010317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.096 qpair failed and we were unable to recover it. 00:29:12.096 [2024-07-22 20:34:44.010583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.011031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.011053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.011392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.011738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.011750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.012069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.012367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.012378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.012641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.012897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.012908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.013222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.013491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.013502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.013863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.014167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.014179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.014431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.014792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.014803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.015106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.015375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.015386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.015639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.015978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.015989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.016367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.016686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.016697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.017010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.017339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.017350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.017652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.017955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.017966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.018365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.018673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.018683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.019054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.019379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.019390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.019708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.020021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.020032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.020393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.020779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.020790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.021157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.021473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.021486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.021793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.022125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.022137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.022504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.022818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.022829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.023083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.023339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.023349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.023665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.023916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.023927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.362 qpair failed and we were unable to recover it. 00:29:12.362 [2024-07-22 20:34:44.024244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.362 [2024-07-22 20:34:44.024550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.024561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.024824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.025190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.025201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.025563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.025819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.025830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.026151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.026490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.026501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.026819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.027136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.027148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.027537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.027806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.027819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.028144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.028410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.028421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.028801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.029109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.029120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.029380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.029629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.029640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.030024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.030324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.030335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.030670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.031121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.031132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.031520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.031901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.031912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.032217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.032536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.032547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.032950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.033260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.033272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.033592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.033977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.033988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.034314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.034697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.034713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.035029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.035356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.035368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.035673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.036008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.036029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.036414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.036808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.036819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.037234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.037627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.037638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.037961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.038367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.038378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.038703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.039088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.039099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.039346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.039659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.039671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.040035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.040347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.040359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.040693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.040953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.040964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.041262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.041529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.041543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.041899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.042202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.042214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.042525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.042990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.043001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.363 qpair failed and we were unable to recover it. 00:29:12.363 [2024-07-22 20:34:44.043317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.363 [2024-07-22 20:34:44.043620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.043631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.043957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.044325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.044337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.044652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.044966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.044977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.045346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.045909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.045930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.046328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.046692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.046703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.046949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.047325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.047337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.047603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.047861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.047872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.048139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.048459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.048470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.048814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.049336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.049348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.049617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.049942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.049953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.050361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.050725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.050738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.051084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.051346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.051358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.051675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.051975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.051987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.052349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.052604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.052616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.052979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.053334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.053346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.053668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.053961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.053972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.054379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.054651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.054664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.055057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.055455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.055466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.055728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.056113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.056124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.056392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.056688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.056699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.057094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.057419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.057430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.057682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.058006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.058017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.058335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.058646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.058658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.059060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.059312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.059324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.059567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.060047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.060058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.060257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.060569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.060580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.060955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.061281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.061292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.061628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.061995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.062006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.364 qpair failed and we were unable to recover it. 00:29:12.364 [2024-07-22 20:34:44.062319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.062618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.364 [2024-07-22 20:34:44.062630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.062874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.063244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.063256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.063688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.064082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.064094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.064370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.064694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.064705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.065030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.065360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.065372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.065677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.066092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.066104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.066468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.066652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.066663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.067069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.067330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.067342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.067608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.068001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.068012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.068355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.068664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.068675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.068993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.069359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.069371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.069639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.069958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.069970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.070344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.070657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.070669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.071067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.071407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.071419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.071732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.072100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.072112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.072427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.072789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.072800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.073165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.073553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.073565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.073910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.074294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.074306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.074680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.075138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.075149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.075511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.075874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.075885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.076190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.076502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.076513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.076750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.077062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.077074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.077391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.077755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.077766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.078116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.078432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.078443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.078754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.079142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.079154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.079404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.079813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.079824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.080187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.080452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.080463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.080827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.081143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.081156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.081544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.081882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.365 [2024-07-22 20:34:44.081893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.365 qpair failed and we were unable to recover it. 00:29:12.365 [2024-07-22 20:34:44.082289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.082651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.082662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.083112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.083451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.083462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.083731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.084063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.084074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.084414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.084673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.084685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.085084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.085448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.085459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.085765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.086087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.086099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.086370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.086631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.086642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.087069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.087337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.087349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.087606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.087987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.087998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.088304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.088565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.088575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.088916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.089265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.089276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.089597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.089970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.089981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.090301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.090664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.090676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.091061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.091370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.091380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.091708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.091961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.091973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.092315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.092640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.092651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.092997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.093313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.093324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.093620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.093986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.093997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.094386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.094643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.094655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.095093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.095463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.095473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.095796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.096104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.096115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.096404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.096717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.096728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.096979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.097290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.097302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.366 qpair failed and we were unable to recover it. 00:29:12.366 [2024-07-22 20:34:44.097668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.366 [2024-07-22 20:34:44.097992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.098003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.098368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.098613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.098625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.098941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.099317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.099328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.099629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.099878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.099890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.100277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.100549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.100560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.100928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.101233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.101244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.101561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.101997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.102008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.102487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.102806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.102816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.103178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.103440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.103450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.103698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.104036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.104060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.104454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.104701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.104712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.105082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.105399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.105410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.105776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.106209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.106220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.106539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.106832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.106843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.107207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.107475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.107487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.107805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.108218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.108230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.108591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.108942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.108953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.109329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.109642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.109653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.110060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.110442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.110454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.110751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.111136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.111147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.111459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.111790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.111802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.112099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.112393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.112404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.112799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.113195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.113207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.113520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.113790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.113802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.114212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.114463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.114474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.114735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.115031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.115047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.115390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.115730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.115741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.116123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.116436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.116446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.367 [2024-07-22 20:34:44.116749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.117059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.367 [2024-07-22 20:34:44.117071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.367 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.117626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.118037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.118053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.118343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.118657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.118666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.119027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.119310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.119321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.119586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.120010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.120020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.120411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.120685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.120694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.121136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.121523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.121533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.121901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.122313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.122324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.122704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.123009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.123019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.123410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.123795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.123806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.124136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.124391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.124400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.124717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.125099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.125110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.125424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.125729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.125739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.126100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.126371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.126380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.126765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.127195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.127205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.127475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.127788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.127797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.128132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.128401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.128410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.128672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.128986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.128996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.129461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.129726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.129736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.130099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.130412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.130423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.130684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.130992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.131004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.131387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.131701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.131710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.132082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.132472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.132483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.132748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.133145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.133155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.133459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.133852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.133861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.134185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.134421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.134431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.134698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.135057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.135068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.135398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.135744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.135754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.136154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.136471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.136481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.368 qpair failed and we were unable to recover it. 00:29:12.368 [2024-07-22 20:34:44.136800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.368 [2024-07-22 20:34:44.137128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.137139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.137460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.137873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.137886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.138247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.138497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.138507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.138780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.139174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.139184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.139451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.139841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.139852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.140168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.140485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.140494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.140767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.141091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.141102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.141368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.141648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.141658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.142107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.142366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.142376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.142647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.143059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.143081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.143327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.143691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.143701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.144110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.144427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.144441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.144624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.144880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.144890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.145193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.145447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.145457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.145767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.146023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.146033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.146336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.146606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.146615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.146874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.147277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.147288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.147528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.147772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.147781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.148121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.148387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.148396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.148653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.148961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.148970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.149340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.149704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.149714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.150102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.150396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.150408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.150685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.150986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.150996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.151362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.151603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.151613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.151861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.152196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.152206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.152449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.152745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.152755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.152995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.153248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.153258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.153445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.153763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.153772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.369 [2024-07-22 20:34:44.154080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.154411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.369 [2024-07-22 20:34:44.154420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.369 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.154725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.154973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.154983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.155312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.155625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.155635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.155937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.156251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.156261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.156519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.156762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.156772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.157014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.157377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.157388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.157703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.158021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.158031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.158357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.158662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.158672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.158916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.159181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.159191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.159495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.159860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.159869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.160177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.160482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.160493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.160798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.161136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.161147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.161486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.161746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.161756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.162074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.162313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.162324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.162640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.162885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.162895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.163197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.163528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.163538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.163779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.164072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.164082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.164391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.164691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.164701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.164883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.165137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.165147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.165516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.165772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.165781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.166172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.166476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.166487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.166668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.166921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.166930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.167251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.167497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.167507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.167758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.167997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.168006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.168265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.168573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.168583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.168821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.169065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.169075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.169258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.169442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.169451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.169683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.169929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.169939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.170263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.170494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.370 [2024-07-22 20:34:44.170504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.370 qpair failed and we were unable to recover it. 00:29:12.370 [2024-07-22 20:34:44.170819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.171138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.171148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.171394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.171701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.171711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.171944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.172239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.172249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.172555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.172857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.172867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.173169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.173403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.173413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.173791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.174025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.174034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.174427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.174672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.174682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.174933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.175233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.175243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.175552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.175813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.175823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.176064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.176367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.176377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.176699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.177006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.177016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.177404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.177668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.177678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.178068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.178480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.178490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.178786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.179032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.179045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.179363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.179669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.179679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.179983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.180283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.180293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.180590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.180836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.180845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.181232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.181529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.181539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.181725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.182029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.182039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.182409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.182721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.182730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.183029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.183355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.183365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.183680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.184040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.184053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.184387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.184636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.184645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.184951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.185251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.185262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.371 [2024-07-22 20:34:44.185573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.185821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.371 [2024-07-22 20:34:44.185831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.371 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.186142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.186441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.186451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.186767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.187139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.187148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.187510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.187694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.187704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.187959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.188268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.188278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.188615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.188913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.188923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.189264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.189515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.189525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.189894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.190292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.190302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.190602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.190900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.190909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.191084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.191382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.191392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.191687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.192070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.192081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.192443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.192752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.192762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.193148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.193531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.193541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.193803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.194106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.194116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.194370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.194715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.194725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.195032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.195343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.195352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.195598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.195911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.195921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.196298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.196664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.196673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.197058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.197397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.197406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.197718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.198027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.198036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.198400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.198730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.198740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.198997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.199325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.199335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.199639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.199901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.199911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.200295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.200484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.200494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.200795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.201089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.201099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.201498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.201880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.201889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.202209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.202613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.202622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.202931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.203294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.203304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.203603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.204013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.372 [2024-07-22 20:34:44.204023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.372 qpair failed and we were unable to recover it. 00:29:12.372 [2024-07-22 20:34:44.204341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.204657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.204667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.204976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.205301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.205311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.205621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.205947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.205956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.206343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.206713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.206723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.207065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.207391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.207401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.207789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.208118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.208128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.208511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.208837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.208846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.209211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.209538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.209548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.209858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.210111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.210121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.210448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.210748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.210758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.211125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.211440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.211450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.211813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.212174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.212184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.212438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.212823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.212834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.213200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.213523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.213533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.213788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.214171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.214180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.214418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.214731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.214741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.215133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.215466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.215476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.215776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.216081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.216091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.216473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.216835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.216845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.217158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.217539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.217549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.217808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.218112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.218122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.218429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.218813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.218823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.219150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.219527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.219537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.219714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.220040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.220052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.220449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.220624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.220633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.220935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.221126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.221136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.221452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.221765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.221775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.222073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.222457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.222466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.373 qpair failed and we were unable to recover it. 00:29:12.373 [2024-07-22 20:34:44.222806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.223196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.373 [2024-07-22 20:34:44.223206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.223529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.223892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.223901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.224230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.224611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.224621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.224986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.225366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.225377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.225744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.226047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.226058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.226298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.226628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.226638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.226894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.227278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.227288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.227650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.228036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.228048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.228466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.228833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.228843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.229189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.229519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.229529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.229784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.230146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.230156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.230473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.230858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.230868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.231165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.231497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.231507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.231760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.232098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.232108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.232424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.232791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.232804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.233114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.233283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.233293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.233608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.233996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.234005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.234236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.234604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.234614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.234949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.235255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.235265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.235625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.236016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.236026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.236409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.236786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.236797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.237162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.237474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.237485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.237745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.238128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.238138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.238445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.238810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.238820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.239127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.239459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.239473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.239856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.240230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.240240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.240490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.240794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.240805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.241137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.241371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.241380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.241626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.242009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.374 [2024-07-22 20:34:44.242019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.374 qpair failed and we were unable to recover it. 00:29:12.374 [2024-07-22 20:34:44.242327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.242577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.242588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.242886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.243269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.243279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.243583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.243965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.243974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.244222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.244580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.244590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.244954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.245257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.245267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.245588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.245907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.245920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.246223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.246535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.246545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.246910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.247148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.247159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.247554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.247918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.247928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.248315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.248434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.248444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.248850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.249146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.249156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.249474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.249781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.249791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.250104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.250422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.250431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.250748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.251065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.251076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.251485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.251810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.251820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.252076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.252464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.252476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.252865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.253222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.253232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.253595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.253922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.253932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.254243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.254552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.254561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.254927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.255223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.255233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.255594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.255964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.255974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.256218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.256525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.256535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.256859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.257220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.257230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.257594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.257903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.257912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.258161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.258544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.258553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.258866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.259187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.259197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.259507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.259892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.259902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.260281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.260618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.260628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.375 qpair failed and we were unable to recover it. 00:29:12.375 [2024-07-22 20:34:44.260995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.261323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.375 [2024-07-22 20:34:44.261334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.261630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.261939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.261949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.262258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.262500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.262510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.262621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.262850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.262861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.263106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.263426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.263437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.263797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.264127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.264137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.264513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.264771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.264781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.265166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.265540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.265550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.265853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.266213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.266223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.266522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.266816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.266826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.267068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.267428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.267438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.267826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.268188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.268198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.268589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.269009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.269019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.269383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.269767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.269777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.270138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.270502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.270511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.270898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.271202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.271212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.271461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.271853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.271863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.272168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.272503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.272513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.272899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.273217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.273227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.273593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.273954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.273964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.274294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.274655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.274664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.275054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.275370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.275380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.275693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.276071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.276081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.276381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.276741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.276751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.277057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.277315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.277324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.376 qpair failed and we were unable to recover it. 00:29:12.376 [2024-07-22 20:34:44.277623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.376 [2024-07-22 20:34:44.277883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.277892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.278203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.278590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.278600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.278965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.279298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.279308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.279672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.279936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.279945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.280309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.280719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.280728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.284054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.284484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.284508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.284919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.285353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.285373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.285795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.286173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.286195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.286596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.286932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.286952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.287380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.287792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.287820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.288208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.288500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.288523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.288925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.289293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.289319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.289706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.289986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.290006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.290453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.290864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.377 [2024-07-22 20:34:44.290892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.377 qpair failed and we were unable to recover it. 00:29:12.377 [2024-07-22 20:34:44.291309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.291764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.291788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.292130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.292473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.292499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.292825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.293266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.293293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.293732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.294135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.294152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.294553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.294896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.294909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.295244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 20:34:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:12.638 20:34:44 -- common/autotest_common.sh@852 -- # return 0 00:29:12.638 20:34:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:12.638 20:34:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:12.638 20:34:44 -- common/autotest_common.sh@10 -- # set +x 00:29:12.638 [2024-07-22 20:34:44.296419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.296441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.296813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.297214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.297226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.297551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.297913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.297922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.298100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.298484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.298493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.298881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.299275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.299285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.299646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.299956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.299968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.300156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.300485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.300495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.300628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.300988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.638 [2024-07-22 20:34:44.300998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.638 qpair failed and we were unable to recover it. 00:29:12.638 [2024-07-22 20:34:44.301306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.301669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.301678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.301977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.302287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.302297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.302659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.302971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.302983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.303362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.303718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.303728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.304036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.304407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.304418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.304759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.305088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.305100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.305345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.305611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.305620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.305945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.306306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.306317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.306571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.306757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.306769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.307103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.307475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.307485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.307800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.308194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.308204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.308528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.308776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.308787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.309103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.309436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.309445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.309761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.310022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.310031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.310413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.310825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.310835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.311212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.311506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.311518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.311839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.312213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.312223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.312577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.312974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.312984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.313345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.313658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.313669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.313974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.314177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.314187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.314549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.314882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.314891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.315064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.315330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.315340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.315725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.316040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.316055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.316397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.316665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.316675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.316935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.317303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.317313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.317669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.318055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.318073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.639 qpair failed and we were unable to recover it. 00:29:12.639 [2024-07-22 20:34:44.318353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.639 [2024-07-22 20:34:44.318611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.318621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.318880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.319196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.319206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.319588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.319810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.319820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.320229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.320488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.320499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.320759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.321082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.321093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.321408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.321664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.321676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.322009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.322340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.322350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.322661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.322989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.323000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.323429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.323695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.323705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.324021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.324374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.324393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.324630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.325048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.325057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.325381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.325685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.325695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.326025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.326344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.326355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.326593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.326971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.326981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.327315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.327583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.327592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.327825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.328193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.328203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.328519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.328833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.328843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.329168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.329433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.329443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.329704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.329952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.329962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.330278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 20:34:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:12.640 [2024-07-22 20:34:44.330638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.330657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 20:34:44 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:12.640 [2024-07-22 20:34:44.331020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 20:34:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:12.640 [2024-07-22 20:34:44.331403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.331414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.640 [2024-07-22 20:34:44.331734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 20:34:44 -- common/autotest_common.sh@10 -- # set +x 00:29:12.640 [2024-07-22 20:34:44.332067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.640 [2024-07-22 20:34:44.332079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.640 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.332395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.332707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.332718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.332999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.333342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.333352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.333665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.333981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.333991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.334307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.334595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.334605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.335008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.335391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.335401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.335668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.335984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.335994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.336313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.336574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.336584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.336930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.337329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.337340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.337653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.338032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.338045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.338355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.338631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.338640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.338899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.339313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.339324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.339633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.340036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.340049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.340375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.340693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.340702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.341058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.341443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.341453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.341774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.342159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.342170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.342425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.342668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.342678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.343000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.343312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.343323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.343716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.344025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.344035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.344370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.344715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.344725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.345115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.345454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.345466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.345848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.346165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.346176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.346564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.346917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.346927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.347259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.347651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.347663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.348027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.348417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.348429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.348694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.349105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.349116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.349507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.349818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.349829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.641 [2024-07-22 20:34:44.350140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.350528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.641 [2024-07-22 20:34:44.350538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.641 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.350791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.351180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.351190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.351552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 Malloc0 00:29:12.642 20:34:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:12.642 20:34:44 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:29:12.642 20:34:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:12.642 20:34:44 -- common/autotest_common.sh@10 -- # set +x 00:29:12.642 [2024-07-22 20:34:44.352362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.352381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.352796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.353182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.353192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.353510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.353870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.353880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.354270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.354584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.354594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.355008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.355327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.355337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.355375] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:12.642 [2024-07-22 20:34:44.355722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.356016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.356028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.356411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.356723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.356733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.357097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.357460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.357469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.357832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.358185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.358195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.358566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.358919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.358929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.359344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.359730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.359739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.360104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.360465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.360475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.360791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.361174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.361184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.361571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.361929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.361939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.362306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.362617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.362626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.363016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.363330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.363340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 20:34:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:12.642 20:34:44 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:12.642 20:34:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:12.642 20:34:44 -- common/autotest_common.sh@10 -- # set +x 00:29:12.642 [2024-07-22 20:34:44.363970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.364401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.364413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.364756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.365128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.365142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.365410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.365793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.365803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.366197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.366587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.366596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.367000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.367386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.367396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.367784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.368096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.368106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.368364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.368667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.368677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.642 qpair failed and we were unable to recover it. 00:29:12.642 [2024-07-22 20:34:44.369067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.642 [2024-07-22 20:34:44.369379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.369389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.369701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.370087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.370097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.370514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.370811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.370821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.371074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.371378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.371388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 20:34:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:12.643 20:34:44 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:12.643 20:34:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:12.643 20:34:44 -- common/autotest_common.sh@10 -- # set +x 00:29:12.643 [2024-07-22 20:34:44.371956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.372354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.372366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.372761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.373150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.373161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.373522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.373930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.373939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.374325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.374581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.374591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.374976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.375376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.375386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.375779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.376082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.376092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.376458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.376843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.376852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.377169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.377418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.377427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.377730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.378032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.378048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.378414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.378820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.378829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.379138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.379448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.379458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.379864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 20:34:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:12.643 [2024-07-22 20:34:44.380191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.380202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 20:34:44 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:12.643 [2024-07-22 20:34:44.380587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 20:34:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:12.643 [2024-07-22 20:34:44.380974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.380984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 20:34:44 -- common/autotest_common.sh@10 -- # set +x 00:29:12.643 [2024-07-22 20:34:44.381350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.381711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.381721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.382129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.382510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.382520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.382926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.383290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.643 [2024-07-22 20:34:44.383300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7febf8000b90 with addr=10.0.0.2, port=4420 00:29:12.643 qpair failed and we were unable to recover it. 00:29:12.643 [2024-07-22 20:34:44.383617] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:12.643 [2024-07-22 20:34:44.383712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:12.644 [2024-07-22 20:34:44.386219] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:29:12.644 [2024-07-22 20:34:44.386257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7febf8000b90 (107): Transport endpoint is not connected 00:29:12.644 [2024-07-22 20:34:44.386300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 20:34:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:12.644 20:34:44 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:29:12.644 20:34:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:12.644 20:34:44 -- common/autotest_common.sh@10 -- # set +x 00:29:12.644 [2024-07-22 20:34:44.395999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.396134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.396158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.396166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.396173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 20:34:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:12.644 [2024-07-22 20:34:44.396191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 20:34:44 -- host/target_disconnect.sh@58 -- # wait 3583855 00:29:12.644 [2024-07-22 20:34:44.405891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.406007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.406026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.406033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.406040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.406062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.415915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.416075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.416093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.416100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.416106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.416123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.425964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.426093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.426114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.426121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.426127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.426142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.435995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.436113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.436131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.436138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.436148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.436164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.446020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.446140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.446159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.446166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.446172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.446189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.456015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.456132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.456151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.456158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.456164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.456180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.466130] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.466254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.466271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.466279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.466285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.466302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.476047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.476159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.476177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.476184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.476190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.476206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.486151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.486265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.486284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.486290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.486296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.486313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.496136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.644 [2024-07-22 20:34:44.496246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.644 [2024-07-22 20:34:44.496262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.644 [2024-07-22 20:34:44.496269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.644 [2024-07-22 20:34:44.496275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.644 [2024-07-22 20:34:44.496290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.644 qpair failed and we were unable to recover it. 00:29:12.644 [2024-07-22 20:34:44.506211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.645 [2024-07-22 20:34:44.506348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.645 [2024-07-22 20:34:44.506366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.645 [2024-07-22 20:34:44.506374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.645 [2024-07-22 20:34:44.506380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.645 [2024-07-22 20:34:44.506396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.645 qpair failed and we were unable to recover it. 00:29:12.645 [2024-07-22 20:34:44.516233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.645 [2024-07-22 20:34:44.516344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.645 [2024-07-22 20:34:44.516362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.645 [2024-07-22 20:34:44.516369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.645 [2024-07-22 20:34:44.516375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.645 [2024-07-22 20:34:44.516391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.645 qpair failed and we were unable to recover it. 00:29:12.645 [2024-07-22 20:34:44.526266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.645 [2024-07-22 20:34:44.526370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.645 [2024-07-22 20:34:44.526394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.645 [2024-07-22 20:34:44.526404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.645 [2024-07-22 20:34:44.526410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.645 [2024-07-22 20:34:44.526426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.645 qpair failed and we were unable to recover it. 00:29:12.645 [2024-07-22 20:34:44.536274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.645 [2024-07-22 20:34:44.536384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.645 [2024-07-22 20:34:44.536402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.645 [2024-07-22 20:34:44.536409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.645 [2024-07-22 20:34:44.536416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.645 [2024-07-22 20:34:44.536431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.645 qpair failed and we were unable to recover it. 00:29:12.645 [2024-07-22 20:34:44.546333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.645 [2024-07-22 20:34:44.546448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.645 [2024-07-22 20:34:44.546466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.645 [2024-07-22 20:34:44.546472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.645 [2024-07-22 20:34:44.546479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.645 [2024-07-22 20:34:44.546495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.645 qpair failed and we were unable to recover it. 00:29:12.645 [2024-07-22 20:34:44.556362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.645 [2024-07-22 20:34:44.556468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.645 [2024-07-22 20:34:44.556486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.645 [2024-07-22 20:34:44.556493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.645 [2024-07-22 20:34:44.556499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.645 [2024-07-22 20:34:44.556515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.645 qpair failed and we were unable to recover it. 00:29:12.645 [2024-07-22 20:34:44.566394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.645 [2024-07-22 20:34:44.566507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.645 [2024-07-22 20:34:44.566524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.645 [2024-07-22 20:34:44.566531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.645 [2024-07-22 20:34:44.566537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.645 [2024-07-22 20:34:44.566554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.645 qpair failed and we were unable to recover it. 00:29:12.903 [2024-07-22 20:34:44.576429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.903 [2024-07-22 20:34:44.576577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.903 [2024-07-22 20:34:44.576595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.903 [2024-07-22 20:34:44.576602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.903 [2024-07-22 20:34:44.576608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.903 [2024-07-22 20:34:44.576624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.903 qpair failed and we were unable to recover it. 00:29:12.903 [2024-07-22 20:34:44.586381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.903 [2024-07-22 20:34:44.586500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.903 [2024-07-22 20:34:44.586518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.903 [2024-07-22 20:34:44.586525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.903 [2024-07-22 20:34:44.586531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.903 [2024-07-22 20:34:44.586547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.903 qpair failed and we were unable to recover it. 00:29:12.903 [2024-07-22 20:34:44.596407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.903 [2024-07-22 20:34:44.596516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.903 [2024-07-22 20:34:44.596534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.903 [2024-07-22 20:34:44.596541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.903 [2024-07-22 20:34:44.596547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.903 [2024-07-22 20:34:44.596563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.903 qpair failed and we were unable to recover it. 00:29:12.903 [2024-07-22 20:34:44.606556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.903 [2024-07-22 20:34:44.606677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.903 [2024-07-22 20:34:44.606695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.903 [2024-07-22 20:34:44.606703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.903 [2024-07-22 20:34:44.606709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.903 [2024-07-22 20:34:44.606726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.903 qpair failed and we were unable to recover it. 00:29:12.903 [2024-07-22 20:34:44.616467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.903 [2024-07-22 20:34:44.616580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.903 [2024-07-22 20:34:44.616598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.903 [2024-07-22 20:34:44.616608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.903 [2024-07-22 20:34:44.616614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.903 [2024-07-22 20:34:44.616630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.903 qpair failed and we were unable to recover it. 00:29:12.903 [2024-07-22 20:34:44.626578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.903 [2024-07-22 20:34:44.626703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.903 [2024-07-22 20:34:44.626721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.903 [2024-07-22 20:34:44.626728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.903 [2024-07-22 20:34:44.626734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.903 [2024-07-22 20:34:44.626750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.903 qpair failed and we were unable to recover it. 00:29:12.903 [2024-07-22 20:34:44.636606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.903 [2024-07-22 20:34:44.636719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.903 [2024-07-22 20:34:44.636736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.903 [2024-07-22 20:34:44.636744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.903 [2024-07-22 20:34:44.636750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.903 [2024-07-22 20:34:44.636767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.903 qpair failed and we were unable to recover it. 00:29:12.903 [2024-07-22 20:34:44.646716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.646961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.646979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.646986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.646992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.647009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.656676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.656790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.656808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.656816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.656824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.656841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.666756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.666874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.666892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.666899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.666905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.666922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.676728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.676840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.676858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.676865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.676871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.676887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.686755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.686862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.686879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.686887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.686893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.686909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.696732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.696851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.696868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.696875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.696882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.696898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.706927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.707039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.707065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.707072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.707078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.707095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.716834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.717081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.717098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.717105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.717111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.717127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.726851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.726959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.726977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.726985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.726991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.727007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.736849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.736960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.736978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.736985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.736991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.737007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.746926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.747034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.747058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.747065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.747071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.747091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.756929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.757030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.757052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.757059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.757065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.757082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.766954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.767073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.767091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.767098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.904 [2024-07-22 20:34:44.767104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.904 [2024-07-22 20:34:44.767121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.904 qpair failed and we were unable to recover it. 00:29:12.904 [2024-07-22 20:34:44.776943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.904 [2024-07-22 20:34:44.777067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.904 [2024-07-22 20:34:44.777085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.904 [2024-07-22 20:34:44.777091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.905 [2024-07-22 20:34:44.777097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.905 [2024-07-22 20:34:44.777114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.905 qpair failed and we were unable to recover it. 00:29:12.905 [2024-07-22 20:34:44.786921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.905 [2024-07-22 20:34:44.787028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.905 [2024-07-22 20:34:44.787051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.905 [2024-07-22 20:34:44.787059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.905 [2024-07-22 20:34:44.787065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.905 [2024-07-22 20:34:44.787082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.905 qpair failed and we were unable to recover it. 00:29:12.905 [2024-07-22 20:34:44.797016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.905 [2024-07-22 20:34:44.797130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.905 [2024-07-22 20:34:44.797151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.905 [2024-07-22 20:34:44.797158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.905 [2024-07-22 20:34:44.797166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.905 [2024-07-22 20:34:44.797183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.905 qpair failed and we were unable to recover it. 00:29:12.905 [2024-07-22 20:34:44.807011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.905 [2024-07-22 20:34:44.807121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.905 [2024-07-22 20:34:44.807139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.905 [2024-07-22 20:34:44.807147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.905 [2024-07-22 20:34:44.807153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.905 [2024-07-22 20:34:44.807170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.905 qpair failed and we were unable to recover it. 00:29:12.905 [2024-07-22 20:34:44.817006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.905 [2024-07-22 20:34:44.817122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.905 [2024-07-22 20:34:44.817140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.905 [2024-07-22 20:34:44.817147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.905 [2024-07-22 20:34:44.817154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.905 [2024-07-22 20:34:44.817170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.905 qpair failed and we were unable to recover it. 00:29:12.905 [2024-07-22 20:34:44.827115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.905 [2024-07-22 20:34:44.827228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.905 [2024-07-22 20:34:44.827246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.905 [2024-07-22 20:34:44.827254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.905 [2024-07-22 20:34:44.827260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.905 [2024-07-22 20:34:44.827278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.905 qpair failed and we were unable to recover it. 00:29:12.905 [2024-07-22 20:34:44.837267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:12.905 [2024-07-22 20:34:44.837383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:12.905 [2024-07-22 20:34:44.837413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:12.905 [2024-07-22 20:34:44.837420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:12.905 [2024-07-22 20:34:44.837427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:12.905 [2024-07-22 20:34:44.837447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:12.905 qpair failed and we were unable to recover it. 00:29:13.164 [2024-07-22 20:34:44.847188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.164 [2024-07-22 20:34:44.847329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.164 [2024-07-22 20:34:44.847347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.164 [2024-07-22 20:34:44.847354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.164 [2024-07-22 20:34:44.847361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.164 [2024-07-22 20:34:44.847377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.164 qpair failed and we were unable to recover it. 00:29:13.164 [2024-07-22 20:34:44.857214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.164 [2024-07-22 20:34:44.857329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.164 [2024-07-22 20:34:44.857347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.164 [2024-07-22 20:34:44.857354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.164 [2024-07-22 20:34:44.857361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.164 [2024-07-22 20:34:44.857376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.164 qpair failed and we were unable to recover it. 00:29:13.164 [2024-07-22 20:34:44.867256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.164 [2024-07-22 20:34:44.867362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.164 [2024-07-22 20:34:44.867378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.164 [2024-07-22 20:34:44.867385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.164 [2024-07-22 20:34:44.867391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.164 [2024-07-22 20:34:44.867407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.164 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.877269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.877382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.877399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.877406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.877413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.877429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.887306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.887434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.887454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.887461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.887467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.887484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.897325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.897471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.897489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.897496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.897502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.897518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.907374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.907494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.907512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.907519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.907525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.907541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.917400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.917509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.917526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.917533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.917539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.917555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.927460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.927622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.927640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.927647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.927681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.927697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.937457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.937569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.937587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.937594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.937601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.937617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.947486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.947614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.947632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.947639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.947645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.947661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.957443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.957561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.957579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.957586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.957593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.957609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.967547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.967654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.967671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.967679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.967685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.967700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.977556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.977670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.977688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.977695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.977701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.977717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.987525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.987639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.987657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.987664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.987669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.987686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.165 qpair failed and we were unable to recover it. 00:29:13.165 [2024-07-22 20:34:44.997663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.165 [2024-07-22 20:34:44.997773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.165 [2024-07-22 20:34:44.997791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.165 [2024-07-22 20:34:44.997798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.165 [2024-07-22 20:34:44.997804] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.165 [2024-07-22 20:34:44.997820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.007665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.007771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.007789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.007796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.007802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.007818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.017607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.017728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.017746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.017753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.017764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.017780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.027725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.027838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.027856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.027863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.027869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.027885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.037762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.037871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.037888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.037894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.037901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.037917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.047785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.047894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.047912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.047918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.047924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.047940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.057734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.057849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.057866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.057873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.057879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.057895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.067847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.067955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.067977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.067984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.067990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.068007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.077870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.077978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.077995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.078002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.078008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.078024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.087909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.088022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.088040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.088054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.088060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.088076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.166 [2024-07-22 20:34:45.097933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.166 [2024-07-22 20:34:45.098053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.166 [2024-07-22 20:34:45.098070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.166 [2024-07-22 20:34:45.098077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.166 [2024-07-22 20:34:45.098083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.166 [2024-07-22 20:34:45.098100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.166 qpair failed and we were unable to recover it. 00:29:13.425 [2024-07-22 20:34:45.107933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.425 [2024-07-22 20:34:45.108062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.425 [2024-07-22 20:34:45.108080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.425 [2024-07-22 20:34:45.108091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.425 [2024-07-22 20:34:45.108097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.425 [2024-07-22 20:34:45.108113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.425 qpair failed and we were unable to recover it. 00:29:13.425 [2024-07-22 20:34:45.117990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.425 [2024-07-22 20:34:45.118146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.425 [2024-07-22 20:34:45.118164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.425 [2024-07-22 20:34:45.118171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.425 [2024-07-22 20:34:45.118177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.425 [2024-07-22 20:34:45.118194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.425 qpair failed and we were unable to recover it. 00:29:13.425 [2024-07-22 20:34:45.128123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.425 [2024-07-22 20:34:45.128225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.425 [2024-07-22 20:34:45.128249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.425 [2024-07-22 20:34:45.128257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.425 [2024-07-22 20:34:45.128263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.425 [2024-07-22 20:34:45.128279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.425 qpair failed and we were unable to recover it. 00:29:13.425 [2024-07-22 20:34:45.138056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.425 [2024-07-22 20:34:45.138168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.425 [2024-07-22 20:34:45.138185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.425 [2024-07-22 20:34:45.138192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.425 [2024-07-22 20:34:45.138198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.425 [2024-07-22 20:34:45.138215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.425 qpair failed and we were unable to recover it. 00:29:13.425 [2024-07-22 20:34:45.148087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.425 [2024-07-22 20:34:45.148200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.425 [2024-07-22 20:34:45.148218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.425 [2024-07-22 20:34:45.148225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.425 [2024-07-22 20:34:45.148231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.425 [2024-07-22 20:34:45.148247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.425 qpair failed and we were unable to recover it. 00:29:13.425 [2024-07-22 20:34:45.158032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.425 [2024-07-22 20:34:45.158147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.425 [2024-07-22 20:34:45.158165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.425 [2024-07-22 20:34:45.158172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.425 [2024-07-22 20:34:45.158178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.425 [2024-07-22 20:34:45.158194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.425 qpair failed and we were unable to recover it. 00:29:13.425 [2024-07-22 20:34:45.168134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.425 [2024-07-22 20:34:45.168292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.425 [2024-07-22 20:34:45.168310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.425 [2024-07-22 20:34:45.168317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.425 [2024-07-22 20:34:45.168323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.425 [2024-07-22 20:34:45.168339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.425 qpair failed and we were unable to recover it. 00:29:13.425 [2024-07-22 20:34:45.178119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.425 [2024-07-22 20:34:45.178264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.178281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.178288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.178294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.178311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.188175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.188289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.188307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.188314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.188320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.188337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.198232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.198339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.198361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.198371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.198378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.198394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.208216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.208363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.208382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.208389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.208395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.208412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.218262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.218372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.218390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.218398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.218405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.218422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.228279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.228391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.228408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.228415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.228421] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.228437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.238332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.238442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.238459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.238466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.238472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.238488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.248299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.248412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.248430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.248436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.248443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.248459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.258366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.258473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.258489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.258496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.258502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.258518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.268346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.268469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.268487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.268494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.268499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.268516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.278429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.278547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.278565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.278572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.426 [2024-07-22 20:34:45.278578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.426 [2024-07-22 20:34:45.278594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.426 qpair failed and we were unable to recover it. 00:29:13.426 [2024-07-22 20:34:45.288396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.426 [2024-07-22 20:34:45.288504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.426 [2024-07-22 20:34:45.288526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.426 [2024-07-22 20:34:45.288532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.427 [2024-07-22 20:34:45.288538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.427 [2024-07-22 20:34:45.288554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.427 qpair failed and we were unable to recover it. 00:29:13.427 [2024-07-22 20:34:45.298493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.427 [2024-07-22 20:34:45.298604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.427 [2024-07-22 20:34:45.298621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.427 [2024-07-22 20:34:45.298628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.427 [2024-07-22 20:34:45.298634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.427 [2024-07-22 20:34:45.298650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.427 qpair failed and we were unable to recover it. 00:29:13.427 [2024-07-22 20:34:45.308460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.427 [2024-07-22 20:34:45.308571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.427 [2024-07-22 20:34:45.308589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.427 [2024-07-22 20:34:45.308596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.427 [2024-07-22 20:34:45.308602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.427 [2024-07-22 20:34:45.308618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.427 qpair failed and we were unable to recover it. 00:29:13.427 [2024-07-22 20:34:45.318608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.427 [2024-07-22 20:34:45.318720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.427 [2024-07-22 20:34:45.318738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.427 [2024-07-22 20:34:45.318745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.427 [2024-07-22 20:34:45.318751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.427 [2024-07-22 20:34:45.318766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.427 qpair failed and we were unable to recover it. 00:29:13.427 [2024-07-22 20:34:45.328511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.427 [2024-07-22 20:34:45.328636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.427 [2024-07-22 20:34:45.328653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.427 [2024-07-22 20:34:45.328660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.427 [2024-07-22 20:34:45.328666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.427 [2024-07-22 20:34:45.328685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.427 qpair failed and we were unable to recover it. 00:29:13.427 [2024-07-22 20:34:45.338611] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.427 [2024-07-22 20:34:45.338724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.427 [2024-07-22 20:34:45.338742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.427 [2024-07-22 20:34:45.338749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.427 [2024-07-22 20:34:45.338755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.427 [2024-07-22 20:34:45.338772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.427 qpair failed and we were unable to recover it. 00:29:13.427 [2024-07-22 20:34:45.348564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.427 [2024-07-22 20:34:45.348671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.427 [2024-07-22 20:34:45.348693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.427 [2024-07-22 20:34:45.348700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.427 [2024-07-22 20:34:45.348706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.427 [2024-07-22 20:34:45.348722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.427 qpair failed and we were unable to recover it. 00:29:13.427 [2024-07-22 20:34:45.358616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.427 [2024-07-22 20:34:45.358734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.427 [2024-07-22 20:34:45.358750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.427 [2024-07-22 20:34:45.358757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.427 [2024-07-22 20:34:45.358764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.427 [2024-07-22 20:34:45.358780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.427 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.368694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.368812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.368829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.368836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.368842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.368859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.378868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.379004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.379025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.379032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.379038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.379061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.388748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.388897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.388915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.388922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.388928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.388944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.398796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.398910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.398928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.398934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.398941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.398957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.408798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.408911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.408929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.408935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.408941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.408958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.418840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.418954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.418972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.418979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.418988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.419005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.428821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.428931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.428952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.428959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.428965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.428981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.438882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.439030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.439055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.439063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.439069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.439085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.448941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.449056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.449073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.449080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.449086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.449102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.458958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.459072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.459089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.459096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.459103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.459119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.469004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.469125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.686 [2024-07-22 20:34:45.469142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.686 [2024-07-22 20:34:45.469149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.686 [2024-07-22 20:34:45.469156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.686 [2024-07-22 20:34:45.469172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.686 qpair failed and we were unable to recover it. 00:29:13.686 [2024-07-22 20:34:45.478951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.686 [2024-07-22 20:34:45.479060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.479077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.479084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.479089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.479105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.488983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.489104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.489122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.489128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.489135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.489151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.499011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.499129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.499146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.499153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.499158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.499174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.509103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.509215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.509232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.509239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.509249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.509265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.519152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.519269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.519287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.519294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.519300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.519317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.529132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.529278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.529296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.529303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.529309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.529325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.539152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.539266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.539284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.539291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.539297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.539313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.549213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.549364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.549383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.549390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.549396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.549413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.559288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.559421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.559439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.559447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.559453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.559469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.569302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.569417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.569434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.569442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.569447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.569464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.579264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.579370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.579386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.579394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.579400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.579415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.589373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.589484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.589501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.589508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.589514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.589530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.599441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.599570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.599588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.599599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.687 [2024-07-22 20:34:45.599605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.687 [2024-07-22 20:34:45.599621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.687 qpair failed and we were unable to recover it. 00:29:13.687 [2024-07-22 20:34:45.609392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.687 [2024-07-22 20:34:45.609537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.687 [2024-07-22 20:34:45.609554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.687 [2024-07-22 20:34:45.609561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.688 [2024-07-22 20:34:45.609567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.688 [2024-07-22 20:34:45.609583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.688 qpair failed and we were unable to recover it. 00:29:13.688 [2024-07-22 20:34:45.619402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.688 [2024-07-22 20:34:45.619519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.688 [2024-07-22 20:34:45.619536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.688 [2024-07-22 20:34:45.619543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.688 [2024-07-22 20:34:45.619549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.688 [2024-07-22 20:34:45.619565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.688 qpair failed and we were unable to recover it. 00:29:13.946 [2024-07-22 20:34:45.629482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.946 [2024-07-22 20:34:45.629612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.946 [2024-07-22 20:34:45.629630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.946 [2024-07-22 20:34:45.629636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.946 [2024-07-22 20:34:45.629642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.946 [2024-07-22 20:34:45.629659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.946 qpair failed and we were unable to recover it. 00:29:13.946 [2024-07-22 20:34:45.639520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.946 [2024-07-22 20:34:45.639631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.946 [2024-07-22 20:34:45.639649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.946 [2024-07-22 20:34:45.639656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.946 [2024-07-22 20:34:45.639662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.946 [2024-07-22 20:34:45.639679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.946 qpair failed and we were unable to recover it. 00:29:13.946 [2024-07-22 20:34:45.649549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.946 [2024-07-22 20:34:45.649658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.946 [2024-07-22 20:34:45.649676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.946 [2024-07-22 20:34:45.649683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.946 [2024-07-22 20:34:45.649689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.946 [2024-07-22 20:34:45.649705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.946 qpair failed and we were unable to recover it. 00:29:13.946 [2024-07-22 20:34:45.659568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.946 [2024-07-22 20:34:45.659681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.659698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.659705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.659711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.659727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.669597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.669708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.669725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.669732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.669738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.669754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.679627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.679735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.679752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.679759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.679765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.679781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.689703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.689822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.689840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.689850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.689857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.689872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.699669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.699780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.699798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.699805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.699811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.699827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.709712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.709822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.709840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.709848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.709854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.709870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.719756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.719867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.719885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.719892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.719898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.719914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.729702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.729814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.729832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.729839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.729845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.729861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.739787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.739901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.739920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.739926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.739932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.739948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.749869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.749997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.750015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.750022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.750028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.750051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.759868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.759977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.759995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.760002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.760007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.760024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.769914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.770049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.770066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.770073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.770079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.770096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.779919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.780026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.780053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.780060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.947 [2024-07-22 20:34:45.780066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.947 [2024-07-22 20:34:45.780083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.947 qpair failed and we were unable to recover it. 00:29:13.947 [2024-07-22 20:34:45.789955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.947 [2024-07-22 20:34:45.790067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.947 [2024-07-22 20:34:45.790083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.947 [2024-07-22 20:34:45.790090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.790096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.790112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.799982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.800098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.800116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.800123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.800129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.800145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.810009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.810256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.810274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.810281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.810287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.810304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.820023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.820137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.820155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.820162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.820168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.820188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.830059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.830171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.830188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.830195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.830202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.830218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.840110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.840225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.840243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.840250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.840256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.840272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.850137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.850245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.850263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.850270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.850276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.850292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.860155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.860264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.860282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.860289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.860295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.860311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.870195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.870309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.870330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.870338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.870344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.870360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:13.948 [2024-07-22 20:34:45.880270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:13.948 [2024-07-22 20:34:45.880431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:13.948 [2024-07-22 20:34:45.880449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:13.948 [2024-07-22 20:34:45.880456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:13.948 [2024-07-22 20:34:45.880461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:13.948 [2024-07-22 20:34:45.880477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:13.948 qpair failed and we were unable to recover it. 00:29:14.207 [2024-07-22 20:34:45.890238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.207 [2024-07-22 20:34:45.890376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.207 [2024-07-22 20:34:45.890393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.207 [2024-07-22 20:34:45.890401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.207 [2024-07-22 20:34:45.890406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.207 [2024-07-22 20:34:45.890422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.207 qpair failed and we were unable to recover it. 00:29:14.207 [2024-07-22 20:34:45.900280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.207 [2024-07-22 20:34:45.900392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.207 [2024-07-22 20:34:45.900409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.207 [2024-07-22 20:34:45.900416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.207 [2024-07-22 20:34:45.900422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.207 [2024-07-22 20:34:45.900438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.207 qpair failed and we were unable to recover it. 00:29:14.207 [2024-07-22 20:34:45.910319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.207 [2024-07-22 20:34:45.910445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.207 [2024-07-22 20:34:45.910463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.207 [2024-07-22 20:34:45.910470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.207 [2024-07-22 20:34:45.910476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.207 [2024-07-22 20:34:45.910495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.207 qpair failed and we were unable to recover it. 00:29:14.207 [2024-07-22 20:34:45.920329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.207 [2024-07-22 20:34:45.920443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.207 [2024-07-22 20:34:45.920460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.207 [2024-07-22 20:34:45.920467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.207 [2024-07-22 20:34:45.920473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.207 [2024-07-22 20:34:45.920490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.207 qpair failed and we were unable to recover it. 00:29:14.207 [2024-07-22 20:34:45.930347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.207 [2024-07-22 20:34:45.930464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.207 [2024-07-22 20:34:45.930482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.207 [2024-07-22 20:34:45.930489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.207 [2024-07-22 20:34:45.930495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.207 [2024-07-22 20:34:45.930512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.207 qpair failed and we were unable to recover it. 00:29:14.207 [2024-07-22 20:34:45.940380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.207 [2024-07-22 20:34:45.940494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.207 [2024-07-22 20:34:45.940511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.207 [2024-07-22 20:34:45.940518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.207 [2024-07-22 20:34:45.940524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.207 [2024-07-22 20:34:45.940540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.207 qpair failed and we were unable to recover it. 00:29:14.207 [2024-07-22 20:34:45.950428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.207 [2024-07-22 20:34:45.950541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.207 [2024-07-22 20:34:45.950558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.207 [2024-07-22 20:34:45.950565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.207 [2024-07-22 20:34:45.950571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.207 [2024-07-22 20:34:45.950587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.207 qpair failed and we were unable to recover it. 00:29:14.207 [2024-07-22 20:34:45.960495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.207 [2024-07-22 20:34:45.960612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:45.960632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:45.960639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:45.960645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:45.960661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:45.970509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:45.970639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:45.970657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:45.970664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:45.970670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:45.970686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:45.980495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:45.980608] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:45.980626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:45.980633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:45.980639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:45.980655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:45.990559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:45.990679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:45.990697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:45.990703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:45.990709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:45.990725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.000581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.000700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.000718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.000725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.000734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.000750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.010514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.010635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.010653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.010660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.010666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.010683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.020605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.020715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.020733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.020740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.020746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.020763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.030650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.030763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.030779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.030786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.030792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.030809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.040787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.040928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.040945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.040952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.040958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.040974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.050718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.050967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.050984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.050991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.050997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.051013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.060741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.060854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.060872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.060879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.060885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.060901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.070784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.070894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.070912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.070918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.070925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.070941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.080835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.208 [2024-07-22 20:34:46.080939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.208 [2024-07-22 20:34:46.080963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.208 [2024-07-22 20:34:46.080971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.208 [2024-07-22 20:34:46.080977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.208 [2024-07-22 20:34:46.080993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.208 qpair failed and we were unable to recover it. 00:29:14.208 [2024-07-22 20:34:46.090847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.209 [2024-07-22 20:34:46.090958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.209 [2024-07-22 20:34:46.090976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.209 [2024-07-22 20:34:46.090986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.209 [2024-07-22 20:34:46.090992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.209 [2024-07-22 20:34:46.091009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.209 qpair failed and we were unable to recover it. 00:29:14.209 [2024-07-22 20:34:46.100859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.209 [2024-07-22 20:34:46.100968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.209 [2024-07-22 20:34:46.100986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.209 [2024-07-22 20:34:46.100993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.209 [2024-07-22 20:34:46.101000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.209 [2024-07-22 20:34:46.101016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.209 qpair failed and we were unable to recover it. 00:29:14.209 [2024-07-22 20:34:46.110875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.209 [2024-07-22 20:34:46.110986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.209 [2024-07-22 20:34:46.111004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.209 [2024-07-22 20:34:46.111011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.209 [2024-07-22 20:34:46.111017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.209 [2024-07-22 20:34:46.111033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.209 qpair failed and we were unable to recover it. 00:29:14.209 [2024-07-22 20:34:46.120920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.209 [2024-07-22 20:34:46.121028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.209 [2024-07-22 20:34:46.121049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.209 [2024-07-22 20:34:46.121057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.209 [2024-07-22 20:34:46.121063] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.209 [2024-07-22 20:34:46.121079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.209 qpair failed and we were unable to recover it. 00:29:14.209 [2024-07-22 20:34:46.130900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.209 [2024-07-22 20:34:46.131041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.209 [2024-07-22 20:34:46.131063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.209 [2024-07-22 20:34:46.131070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.209 [2024-07-22 20:34:46.131076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.209 [2024-07-22 20:34:46.131093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.209 qpair failed and we were unable to recover it. 00:29:14.209 [2024-07-22 20:34:46.140993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.209 [2024-07-22 20:34:46.141137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.209 [2024-07-22 20:34:46.141155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.209 [2024-07-22 20:34:46.141162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.209 [2024-07-22 20:34:46.141168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.209 [2024-07-22 20:34:46.141184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.209 qpair failed and we were unable to recover it. 00:29:14.467 [2024-07-22 20:34:46.151013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.151145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.151163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.151170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.151175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.151192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.161039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.161158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.161175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.161182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.161188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.161203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.171073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.171186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.171203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.171210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.171216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.171232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.181094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.181207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.181225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.181235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.181241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.181257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.191162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.191275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.191293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.191299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.191306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.191322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.201118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.201232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.201249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.201256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.201262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.201278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.211190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.211301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.211318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.211325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.211331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.211347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.221212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.221323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.221340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.221347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.221353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.221369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.231225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.231379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.231397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.231404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.231409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.231426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.241272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.241386] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.241404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.241411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.241417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.241433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.251306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.251419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.251436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.251443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.251449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.251465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.261313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.261425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.261442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.261449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.261456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.261471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.271358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.271465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.468 [2024-07-22 20:34:46.271485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.468 [2024-07-22 20:34:46.271492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.468 [2024-07-22 20:34:46.271498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.468 [2024-07-22 20:34:46.271514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.468 qpair failed and we were unable to recover it. 00:29:14.468 [2024-07-22 20:34:46.281387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.468 [2024-07-22 20:34:46.281493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.281517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.281525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.281531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.281547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.291411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.291514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.291537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.291544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.291551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.291567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.301417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.301531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.301548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.301555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.301561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.301577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.311470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.311582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.311600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.311607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.311613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.311633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.321499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.321626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.321643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.321651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.321657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.321672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.331524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.331635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.331652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.331659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.331665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.331682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.341530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.341665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.341683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.341690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.341696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.341712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.351576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.351691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.351709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.351716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.351722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.351740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.361602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.361707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.361728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.361736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.361742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.361758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.371636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.371745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.371762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.371769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.371775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.371791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.381652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.381765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.381783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.381790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.381796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.381812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.391703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.391816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.391833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.391840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.391846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.391863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.469 [2024-07-22 20:34:46.401735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.469 [2024-07-22 20:34:46.401859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.469 [2024-07-22 20:34:46.401877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.469 [2024-07-22 20:34:46.401884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.469 [2024-07-22 20:34:46.401890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.469 [2024-07-22 20:34:46.401909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.469 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.411711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.411831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.411849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.411855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.411861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.411877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.421771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.421922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.421939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.421946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.421952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.421969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.431854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.431963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.431981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.431987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.431993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.432010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.441850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.441961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.441979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.441985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.441991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.442007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.451868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.451978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.452000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.452007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.452013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.452029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.461827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.461937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.461954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.461961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.461968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.461984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.471925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.472040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.472063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.472070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.472076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.472092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.481959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.482075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.482091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.482098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.482104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.482120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.492002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.492116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.492134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.492140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.492149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.492166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.501995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.502110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.502126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.502133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.502139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.502154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.512038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.512151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.512168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.512175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.512181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.512197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.522075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.730 [2024-07-22 20:34:46.522184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.730 [2024-07-22 20:34:46.522202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.730 [2024-07-22 20:34:46.522209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.730 [2024-07-22 20:34:46.522215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.730 [2024-07-22 20:34:46.522231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.730 qpair failed and we were unable to recover it. 00:29:14.730 [2024-07-22 20:34:46.532032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.532145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.532163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.532170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.532176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.532192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.542127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.542243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.542260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.542267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.542273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.542289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.552154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.552265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.552282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.552289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.552295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.552311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.562198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.562305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.562323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.562330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.562336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.562352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.572241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.572352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.572369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.572376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.572382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.572397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.582245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.582351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.582368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.582375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.582385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.582401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.592336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.592444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.592462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.592469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.592475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.592492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.602315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.602417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.602440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.602447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.602453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.602469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.612397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.612509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.612527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.612534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.612540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.612558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.622347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.622457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.622475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.622483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.622489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:14.731 [2024-07-22 20:34:46.622505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.632364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.632612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.632643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.632656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.632666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:14.731 [2024-07-22 20:34:46.632689] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.642362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.642472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.642491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.642499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.642505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:14.731 [2024-07-22 20:34:46.642522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.652494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.652613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.652634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.731 [2024-07-22 20:34:46.652641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.731 [2024-07-22 20:34:46.652647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:14.731 [2024-07-22 20:34:46.652664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:14.731 qpair failed and we were unable to recover it. 00:29:14.731 [2024-07-22 20:34:46.662562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:14.731 [2024-07-22 20:34:46.662685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:14.731 [2024-07-22 20:34:46.662704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:14.732 [2024-07-22 20:34:46.662712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:14.732 [2024-07-22 20:34:46.662719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:14.732 [2024-07-22 20:34:46.662737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:14.732 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.672593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.672714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.020 [2024-07-22 20:34:46.672735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.020 [2024-07-22 20:34:46.672747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.020 [2024-07-22 20:34:46.672754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.020 [2024-07-22 20:34:46.672771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.020 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.682574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.682689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.020 [2024-07-22 20:34:46.682710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.020 [2024-07-22 20:34:46.682717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.020 [2024-07-22 20:34:46.682724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.020 [2024-07-22 20:34:46.682741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.020 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.692555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.692668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.020 [2024-07-22 20:34:46.692687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.020 [2024-07-22 20:34:46.692694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.020 [2024-07-22 20:34:46.692701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.020 [2024-07-22 20:34:46.692718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.020 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.702582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.702711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.020 [2024-07-22 20:34:46.702730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.020 [2024-07-22 20:34:46.702737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.020 [2024-07-22 20:34:46.702744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.020 [2024-07-22 20:34:46.702760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.020 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.712621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.712759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.020 [2024-07-22 20:34:46.712778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.020 [2024-07-22 20:34:46.712785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.020 [2024-07-22 20:34:46.712791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.020 [2024-07-22 20:34:46.712807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.020 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.722582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.722747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.020 [2024-07-22 20:34:46.722766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.020 [2024-07-22 20:34:46.722773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.020 [2024-07-22 20:34:46.722779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.020 [2024-07-22 20:34:46.722795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.020 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.732691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.732801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.020 [2024-07-22 20:34:46.732820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.020 [2024-07-22 20:34:46.732827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.020 [2024-07-22 20:34:46.732833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.020 [2024-07-22 20:34:46.732848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.020 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.742784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.742944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.020 [2024-07-22 20:34:46.742963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.020 [2024-07-22 20:34:46.742970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.020 [2024-07-22 20:34:46.742976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.020 [2024-07-22 20:34:46.742991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.020 qpair failed and we were unable to recover it. 00:29:15.020 [2024-07-22 20:34:46.752732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.020 [2024-07-22 20:34:46.752845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.752864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.752870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.752876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.752893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.762686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.762812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.762831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.762841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.762847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.762863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.772820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.772976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.772994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.773001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.773007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.773024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.782771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.782881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.782899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.782907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.782913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.782929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.792840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.792952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.792970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.792978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.792984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.793000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.802888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.803000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.803019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.803026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.803032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.803053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.812958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.813091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.813110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.813117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.813123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.813140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.822952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.823072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.823097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.823104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.823111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.823127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.832946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.833070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.833088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.833095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.833101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.833117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.842960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.843077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.843101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.843108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.843114] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.843131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.853029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.853158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.853178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.853189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.853196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.853212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.863097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.863208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.863228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.863235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.863241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.863258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.021 [2024-07-22 20:34:46.873237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.021 [2024-07-22 20:34:46.873358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.021 [2024-07-22 20:34:46.873376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.021 [2024-07-22 20:34:46.873383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.021 [2024-07-22 20:34:46.873389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.021 [2024-07-22 20:34:46.873405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.021 qpair failed and we were unable to recover it. 00:29:15.022 [2024-07-22 20:34:46.883119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.022 [2024-07-22 20:34:46.883249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.022 [2024-07-22 20:34:46.883268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.022 [2024-07-22 20:34:46.883275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.022 [2024-07-22 20:34:46.883281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.022 [2024-07-22 20:34:46.883298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.022 qpair failed and we were unable to recover it. 00:29:15.022 [2024-07-22 20:34:46.893141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.022 [2024-07-22 20:34:46.893255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.022 [2024-07-22 20:34:46.893274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.022 [2024-07-22 20:34:46.893281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.022 [2024-07-22 20:34:46.893287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.022 [2024-07-22 20:34:46.893303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.022 qpair failed and we were unable to recover it. 00:29:15.022 [2024-07-22 20:34:46.903170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.022 [2024-07-22 20:34:46.903296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.022 [2024-07-22 20:34:46.903315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.022 [2024-07-22 20:34:46.903322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.022 [2024-07-22 20:34:46.903328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.022 [2024-07-22 20:34:46.903344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.022 qpair failed and we were unable to recover it. 00:29:15.022 [2024-07-22 20:34:46.913125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.022 [2024-07-22 20:34:46.913238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.022 [2024-07-22 20:34:46.913257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.022 [2024-07-22 20:34:46.913264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.022 [2024-07-22 20:34:46.913269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.022 [2024-07-22 20:34:46.913286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.022 qpair failed and we were unable to recover it. 00:29:15.022 [2024-07-22 20:34:46.923178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.022 [2024-07-22 20:34:46.923292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.022 [2024-07-22 20:34:46.923311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.022 [2024-07-22 20:34:46.923318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.022 [2024-07-22 20:34:46.923324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.022 [2024-07-22 20:34:46.923341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.022 qpair failed and we were unable to recover it. 00:29:15.022 [2024-07-22 20:34:46.933269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.022 [2024-07-22 20:34:46.933393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.022 [2024-07-22 20:34:46.933412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.022 [2024-07-22 20:34:46.933419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.022 [2024-07-22 20:34:46.933425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.022 [2024-07-22 20:34:46.933442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.022 qpair failed and we were unable to recover it. 00:29:15.022 [2024-07-22 20:34:46.943273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.022 [2024-07-22 20:34:46.943392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.022 [2024-07-22 20:34:46.943415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.022 [2024-07-22 20:34:46.943422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.022 [2024-07-22 20:34:46.943428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.022 [2024-07-22 20:34:46.943444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.022 qpair failed and we were unable to recover it. 00:29:15.022 [2024-07-22 20:34:46.953343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.022 [2024-07-22 20:34:46.953469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.022 [2024-07-22 20:34:46.953487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.022 [2024-07-22 20:34:46.953495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.022 [2024-07-22 20:34:46.953501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.022 [2024-07-22 20:34:46.953517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.022 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:46.963305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:46.963420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.281 [2024-07-22 20:34:46.963439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.281 [2024-07-22 20:34:46.963446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.281 [2024-07-22 20:34:46.963452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.281 [2024-07-22 20:34:46.963468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.281 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:46.973298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:46.973406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.281 [2024-07-22 20:34:46.973426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.281 [2024-07-22 20:34:46.973433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.281 [2024-07-22 20:34:46.973439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.281 [2024-07-22 20:34:46.973455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.281 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:46.983395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:46.983507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.281 [2024-07-22 20:34:46.983526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.281 [2024-07-22 20:34:46.983533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.281 [2024-07-22 20:34:46.983539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.281 [2024-07-22 20:34:46.983556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.281 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:46.993363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:46.993476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.281 [2024-07-22 20:34:46.993495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.281 [2024-07-22 20:34:46.993502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.281 [2024-07-22 20:34:46.993508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.281 [2024-07-22 20:34:46.993524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.281 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:47.003469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:47.003582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.281 [2024-07-22 20:34:47.003600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.281 [2024-07-22 20:34:47.003607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.281 [2024-07-22 20:34:47.003613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.281 [2024-07-22 20:34:47.003629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.281 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:47.013531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:47.013682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.281 [2024-07-22 20:34:47.013700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.281 [2024-07-22 20:34:47.013707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.281 [2024-07-22 20:34:47.013713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.281 [2024-07-22 20:34:47.013729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.281 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:47.023518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:47.023631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.281 [2024-07-22 20:34:47.023649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.281 [2024-07-22 20:34:47.023656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.281 [2024-07-22 20:34:47.023662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.281 [2024-07-22 20:34:47.023678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.281 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:47.033459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:47.033572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.281 [2024-07-22 20:34:47.033594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.281 [2024-07-22 20:34:47.033601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.281 [2024-07-22 20:34:47.033607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.281 [2024-07-22 20:34:47.033623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.281 qpair failed and we were unable to recover it. 00:29:15.281 [2024-07-22 20:34:47.043544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.281 [2024-07-22 20:34:47.043657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.043676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.043683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.043689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.043705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.053526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.053635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.053656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.053663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.053670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.053687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.063591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.063703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.063721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.063729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.063735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.063751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.073639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.073745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.073764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.073771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.073777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.073794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.083682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.083793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.083812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.083819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.083826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.083842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.093721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.093833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.093852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.093859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.093865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.093881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.103735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.103848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.103867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.103875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.103881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.103897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.113775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.113893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.113913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.113920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.113926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.113942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.123801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.123911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.123934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.123941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.123947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.123962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.133840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.133946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.133965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.133972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.133978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.133994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.143925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.144090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.144108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.144116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.144122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.144138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.153866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.153973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.153991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.153998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.154004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.154020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.163921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.164030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.164055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.164063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.282 [2024-07-22 20:34:47.164069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.282 [2024-07-22 20:34:47.164090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.282 qpair failed and we were unable to recover it. 00:29:15.282 [2024-07-22 20:34:47.173961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.282 [2024-07-22 20:34:47.174086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.282 [2024-07-22 20:34:47.174104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.282 [2024-07-22 20:34:47.174111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.283 [2024-07-22 20:34:47.174117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.283 [2024-07-22 20:34:47.174133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.283 qpair failed and we were unable to recover it. 00:29:15.283 [2024-07-22 20:34:47.184034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.283 [2024-07-22 20:34:47.184196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.283 [2024-07-22 20:34:47.184214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.283 [2024-07-22 20:34:47.184222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.283 [2024-07-22 20:34:47.184227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.283 [2024-07-22 20:34:47.184244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.283 qpair failed and we were unable to recover it. 00:29:15.283 [2024-07-22 20:34:47.194011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.283 [2024-07-22 20:34:47.194161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.283 [2024-07-22 20:34:47.194179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.283 [2024-07-22 20:34:47.194186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.283 [2024-07-22 20:34:47.194192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.283 [2024-07-22 20:34:47.194208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.283 qpair failed and we were unable to recover it. 00:29:15.283 [2024-07-22 20:34:47.204064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.283 [2024-07-22 20:34:47.204174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.283 [2024-07-22 20:34:47.204193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.283 [2024-07-22 20:34:47.204200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.283 [2024-07-22 20:34:47.204206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.283 [2024-07-22 20:34:47.204222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.283 qpair failed and we were unable to recover it. 00:29:15.283 [2024-07-22 20:34:47.214079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.283 [2024-07-22 20:34:47.214195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.283 [2024-07-22 20:34:47.214217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.283 [2024-07-22 20:34:47.214224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.283 [2024-07-22 20:34:47.214229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.283 [2024-07-22 20:34:47.214246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.283 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.224052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.224174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.224192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.224199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.224206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.224222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.234149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.234265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.234283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.234290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.234296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.234313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.244141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.244251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.244270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.244277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.244282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.244299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.254178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.254308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.254325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.254332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.254338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.254360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.264236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.264349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.264367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.264374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.264380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.264396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.274264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.274489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.274507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.274514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.274520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.274536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.284249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.284357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.284375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.284382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.284387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.284403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.294294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.294439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.294457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.294464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.294470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.294487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.304330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.304439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.304461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.304468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.304473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.304489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.314353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.314486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.314504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.314511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.314517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.314533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.324332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.324487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.324506] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.324513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.324519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.324535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.334435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.542 [2024-07-22 20:34:47.334553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.542 [2024-07-22 20:34:47.334572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.542 [2024-07-22 20:34:47.334579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.542 [2024-07-22 20:34:47.334585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.542 [2024-07-22 20:34:47.334600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.542 qpair failed and we were unable to recover it. 00:29:15.542 [2024-07-22 20:34:47.344442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.344557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.344575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.344583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.344589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.344608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.354475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.354591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.354610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.354617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.354623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.354639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.364500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.364606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.364624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.364632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.364637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.364653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.374535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.374640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.374658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.374665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.374671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.374688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.384587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.384694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.384713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.384720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.384725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.384741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.394597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.394706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.394728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.394735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.394740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.394756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.404642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.404755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.404773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.404780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.404786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.404802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.414673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.414800] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.414819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.414826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.414832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.414849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.424712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.424823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.424842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.424849] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.424855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.424871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.434705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.434816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.434835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.434842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.434850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.434866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.444674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.444786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.444804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.444811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.444817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.444833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.454776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.454885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.454904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.454911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.454918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.454935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.464810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.543 [2024-07-22 20:34:47.464924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.543 [2024-07-22 20:34:47.464943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.543 [2024-07-22 20:34:47.464950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.543 [2024-07-22 20:34:47.464956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.543 [2024-07-22 20:34:47.464971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.543 qpair failed and we were unable to recover it. 00:29:15.543 [2024-07-22 20:34:47.474821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.544 [2024-07-22 20:34:47.474940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.544 [2024-07-22 20:34:47.474958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.544 [2024-07-22 20:34:47.474966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.544 [2024-07-22 20:34:47.474972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.544 [2024-07-22 20:34:47.474988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.544 qpair failed and we were unable to recover it. 00:29:15.802 [2024-07-22 20:34:47.484867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.802 [2024-07-22 20:34:47.484984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.802 [2024-07-22 20:34:47.485006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.802 [2024-07-22 20:34:47.485013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.802 [2024-07-22 20:34:47.485020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.802 [2024-07-22 20:34:47.485036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.802 qpair failed and we were unable to recover it. 00:29:15.802 [2024-07-22 20:34:47.494939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.802 [2024-07-22 20:34:47.495106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.802 [2024-07-22 20:34:47.495125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.802 [2024-07-22 20:34:47.495132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.802 [2024-07-22 20:34:47.495137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.802 [2024-07-22 20:34:47.495154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.802 qpair failed and we were unable to recover it. 00:29:15.802 [2024-07-22 20:34:47.504846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.802 [2024-07-22 20:34:47.504960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.802 [2024-07-22 20:34:47.504977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.802 [2024-07-22 20:34:47.504984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.802 [2024-07-22 20:34:47.504989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.802 [2024-07-22 20:34:47.505005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.802 qpair failed and we were unable to recover it. 00:29:15.802 [2024-07-22 20:34:47.514955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.802 [2024-07-22 20:34:47.515080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.802 [2024-07-22 20:34:47.515099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.802 [2024-07-22 20:34:47.515106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.802 [2024-07-22 20:34:47.515112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.802 [2024-07-22 20:34:47.515128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.802 qpair failed and we were unable to recover it. 00:29:15.802 [2024-07-22 20:34:47.524982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.802 [2024-07-22 20:34:47.525117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.802 [2024-07-22 20:34:47.525135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.802 [2024-07-22 20:34:47.525142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.802 [2024-07-22 20:34:47.525151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.802 [2024-07-22 20:34:47.525168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.802 qpair failed and we were unable to recover it. 00:29:15.802 [2024-07-22 20:34:47.534929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.802 [2024-07-22 20:34:47.535034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.802 [2024-07-22 20:34:47.535059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.802 [2024-07-22 20:34:47.535066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.802 [2024-07-22 20:34:47.535072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.802 [2024-07-22 20:34:47.535087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.802 qpair failed and we were unable to recover it. 00:29:15.802 [2024-07-22 20:34:47.545047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.802 [2024-07-22 20:34:47.545168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.545186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.545193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.545199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.545215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.555063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.555181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.555200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.555207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.555212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.555228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.565108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.565213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.565232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.565239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.565245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.565261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.575141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.575266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.575284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.575291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.575297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.575314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.585152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.585264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.585282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.585289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.585295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.585310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.595177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.595289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.595308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.595315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.595320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.595338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.605215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.605459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.605478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.605484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.605490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.605505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.615204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.615330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.615348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.615355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.615364] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.615380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.625197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.625306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.625324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.625331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.625337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.625353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.635305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.635420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.635439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.635445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.635452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.635468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.645337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.645461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.645479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.645486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.645492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.645508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.655355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.655464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.655483] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.803 [2024-07-22 20:34:47.655490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.803 [2024-07-22 20:34:47.655496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.803 [2024-07-22 20:34:47.655513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.803 qpair failed and we were unable to recover it. 00:29:15.803 [2024-07-22 20:34:47.665395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.803 [2024-07-22 20:34:47.665516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.803 [2024-07-22 20:34:47.665534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.804 [2024-07-22 20:34:47.665541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.804 [2024-07-22 20:34:47.665547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.804 [2024-07-22 20:34:47.665563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.804 qpair failed and we were unable to recover it. 00:29:15.804 [2024-07-22 20:34:47.675414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.804 [2024-07-22 20:34:47.675528] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.804 [2024-07-22 20:34:47.675547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.804 [2024-07-22 20:34:47.675554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.804 [2024-07-22 20:34:47.675560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.804 [2024-07-22 20:34:47.675576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.804 qpair failed and we were unable to recover it. 00:29:15.804 [2024-07-22 20:34:47.685484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.804 [2024-07-22 20:34:47.685598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.804 [2024-07-22 20:34:47.685617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.804 [2024-07-22 20:34:47.685624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.804 [2024-07-22 20:34:47.685630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.804 [2024-07-22 20:34:47.685646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.804 qpair failed and we were unable to recover it. 00:29:15.804 [2024-07-22 20:34:47.695492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.804 [2024-07-22 20:34:47.695597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.804 [2024-07-22 20:34:47.695616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.804 [2024-07-22 20:34:47.695623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.804 [2024-07-22 20:34:47.695629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.804 [2024-07-22 20:34:47.695645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.804 qpair failed and we were unable to recover it. 00:29:15.804 [2024-07-22 20:34:47.705443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.804 [2024-07-22 20:34:47.705555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.804 [2024-07-22 20:34:47.705574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.804 [2024-07-22 20:34:47.705581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.804 [2024-07-22 20:34:47.705590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.804 [2024-07-22 20:34:47.705606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.804 qpair failed and we were unable to recover it. 00:29:15.804 [2024-07-22 20:34:47.715473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.804 [2024-07-22 20:34:47.715626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.804 [2024-07-22 20:34:47.715645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.804 [2024-07-22 20:34:47.715652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.804 [2024-07-22 20:34:47.715658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.804 [2024-07-22 20:34:47.715675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.804 qpair failed and we were unable to recover it. 00:29:15.804 [2024-07-22 20:34:47.725572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.804 [2024-07-22 20:34:47.725683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.804 [2024-07-22 20:34:47.725702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.804 [2024-07-22 20:34:47.725709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.804 [2024-07-22 20:34:47.725715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.804 [2024-07-22 20:34:47.725732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.804 qpair failed and we were unable to recover it. 00:29:15.804 [2024-07-22 20:34:47.735614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:15.804 [2024-07-22 20:34:47.735731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:15.804 [2024-07-22 20:34:47.735750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:15.804 [2024-07-22 20:34:47.735757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:15.804 [2024-07-22 20:34:47.735763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:15.804 [2024-07-22 20:34:47.735780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:15.804 qpair failed and we were unable to recover it. 00:29:16.062 [2024-07-22 20:34:47.745657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.745771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.745794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.745801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.745808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.745823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.755698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.755814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.755833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.755840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.755846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.755862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.765692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.765805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.765824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.765831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.765837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.765854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.775725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.775966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.775984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.775991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.775997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.776013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.785768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.785883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.785901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.785908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.785914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.785929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.795823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.795931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.795950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.795961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.795967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.795983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.805803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.805955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.805973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.805980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.805986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.806002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.815837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.815946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.815965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.815972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.815978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.815994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.825926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.826048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.826067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.826074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.826081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.826096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.835801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.835911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.835930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.835937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.835943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.835959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.845927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.846033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.846057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.846064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.846070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.846086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.855939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.856070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.856089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.856096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.856102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.856119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.063 qpair failed and we were unable to recover it. 00:29:16.063 [2024-07-22 20:34:47.865995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.063 [2024-07-22 20:34:47.866114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.063 [2024-07-22 20:34:47.866133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.063 [2024-07-22 20:34:47.866140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.063 [2024-07-22 20:34:47.866146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.063 [2024-07-22 20:34:47.866163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.876021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.876136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.876155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.876162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.876168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.876184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.886047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.886156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.886175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.886186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.886193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.886210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.896109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.896236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.896255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.896263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.896269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.896285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.906107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.906230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.906249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.906256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.906262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.906279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.916083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.916211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.916229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.916236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.916242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.916258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.926151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.926264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.926283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.926290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.926296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.926313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.936206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.936325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.936343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.936350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.936356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.936372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.946136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.946247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.946265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.946272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.946278] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.946294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.956238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.956348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.956367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.956374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.956380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.956397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.966281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.966387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.966406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.966413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.966419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.966435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.976329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.976442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.976461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.976472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.976478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.976494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.986332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.986441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.986459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.064 [2024-07-22 20:34:47.986467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.064 [2024-07-22 20:34:47.986473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.064 [2024-07-22 20:34:47.986489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.064 qpair failed and we were unable to recover it. 00:29:16.064 [2024-07-22 20:34:47.996357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.064 [2024-07-22 20:34:47.996475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.064 [2024-07-22 20:34:47.996493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.065 [2024-07-22 20:34:47.996500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.065 [2024-07-22 20:34:47.996506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.065 [2024-07-22 20:34:47.996522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.065 qpair failed and we were unable to recover it. 00:29:16.323 [2024-07-22 20:34:48.006386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.323 [2024-07-22 20:34:48.006507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.323 [2024-07-22 20:34:48.006526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.323 [2024-07-22 20:34:48.006533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.323 [2024-07-22 20:34:48.006539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.323 [2024-07-22 20:34:48.006555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.323 qpair failed and we were unable to recover it. 00:29:16.323 [2024-07-22 20:34:48.016403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.323 [2024-07-22 20:34:48.016511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.323 [2024-07-22 20:34:48.016529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.323 [2024-07-22 20:34:48.016536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.323 [2024-07-22 20:34:48.016542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.323 [2024-07-22 20:34:48.016558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.323 qpair failed and we were unable to recover it. 00:29:16.323 [2024-07-22 20:34:48.026450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.323 [2024-07-22 20:34:48.026563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.323 [2024-07-22 20:34:48.026582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.323 [2024-07-22 20:34:48.026589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.323 [2024-07-22 20:34:48.026596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.323 [2024-07-22 20:34:48.026611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.323 qpair failed and we were unable to recover it. 00:29:16.323 [2024-07-22 20:34:48.036474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.323 [2024-07-22 20:34:48.036582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.323 [2024-07-22 20:34:48.036601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.323 [2024-07-22 20:34:48.036608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.323 [2024-07-22 20:34:48.036614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.323 [2024-07-22 20:34:48.036630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.323 qpair failed and we were unable to recover it. 00:29:16.323 [2024-07-22 20:34:48.046476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.323 [2024-07-22 20:34:48.046626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.323 [2024-07-22 20:34:48.046645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.323 [2024-07-22 20:34:48.046652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.323 [2024-07-22 20:34:48.046658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.323 [2024-07-22 20:34:48.046674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.323 qpair failed and we were unable to recover it. 00:29:16.323 [2024-07-22 20:34:48.056538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.323 [2024-07-22 20:34:48.056668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.056688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.056695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.056702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.056720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.066586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.066697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.066716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.066729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.066736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.066752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.076602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.076714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.076733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.076741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.076749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.076765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.086567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.086672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.086696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.086703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.086710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.086726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.096591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.096706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.096726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.096733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.096740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.096758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.106681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.106795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.106814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.106821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.106827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.106843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.116717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.116829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.116847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.116854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.116860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.116877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.126791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.126905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.126924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.126931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.126937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.126954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.136784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.136917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.136936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.136942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.136948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.136965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.146754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.146868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.146887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.146894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.146900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.146916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.156862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.156989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.157012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.157019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.157025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.157048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.166880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.166994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.167012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.167020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.167026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.167048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.176881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.176989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.177009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.324 [2024-07-22 20:34:48.177016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.324 [2024-07-22 20:34:48.177022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.324 [2024-07-22 20:34:48.177038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.324 qpair failed and we were unable to recover it. 00:29:16.324 [2024-07-22 20:34:48.186881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.324 [2024-07-22 20:34:48.186992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.324 [2024-07-22 20:34:48.187016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.325 [2024-07-22 20:34:48.187023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.325 [2024-07-22 20:34:48.187028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.325 [2024-07-22 20:34:48.187050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.325 qpair failed and we were unable to recover it. 00:29:16.325 [2024-07-22 20:34:48.196967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.325 [2024-07-22 20:34:48.197121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.325 [2024-07-22 20:34:48.197140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.325 [2024-07-22 20:34:48.197146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.325 [2024-07-22 20:34:48.197152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.325 [2024-07-22 20:34:48.197169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.325 qpair failed and we were unable to recover it. 00:29:16.325 [2024-07-22 20:34:48.206982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.325 [2024-07-22 20:34:48.207097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.325 [2024-07-22 20:34:48.207120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.325 [2024-07-22 20:34:48.207127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.325 [2024-07-22 20:34:48.207133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.325 [2024-07-22 20:34:48.207149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.325 qpair failed and we were unable to recover it. 00:29:16.325 [2024-07-22 20:34:48.217018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.325 [2024-07-22 20:34:48.217133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.325 [2024-07-22 20:34:48.217151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.325 [2024-07-22 20:34:48.217158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.325 [2024-07-22 20:34:48.217164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.325 [2024-07-22 20:34:48.217180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.325 qpair failed and we were unable to recover it. 00:29:16.325 [2024-07-22 20:34:48.227073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.325 [2024-07-22 20:34:48.227187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.325 [2024-07-22 20:34:48.227206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.325 [2024-07-22 20:34:48.227213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.325 [2024-07-22 20:34:48.227219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.325 [2024-07-22 20:34:48.227235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.325 qpair failed and we were unable to recover it. 00:29:16.325 [2024-07-22 20:34:48.237068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.325 [2024-07-22 20:34:48.237183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.325 [2024-07-22 20:34:48.237202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.325 [2024-07-22 20:34:48.237209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.325 [2024-07-22 20:34:48.237215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.325 [2024-07-22 20:34:48.237232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.325 qpair failed and we were unable to recover it. 00:29:16.325 [2024-07-22 20:34:48.247122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.325 [2024-07-22 20:34:48.247226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.325 [2024-07-22 20:34:48.247248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.325 [2024-07-22 20:34:48.247255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.325 [2024-07-22 20:34:48.247261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.325 [2024-07-22 20:34:48.247277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.325 qpair failed and we were unable to recover it. 00:29:16.325 [2024-07-22 20:34:48.257174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.325 [2024-07-22 20:34:48.257292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.325 [2024-07-22 20:34:48.257310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.325 [2024-07-22 20:34:48.257317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.325 [2024-07-22 20:34:48.257323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.325 [2024-07-22 20:34:48.257340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.325 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.267206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.267328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.267347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.267354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.267360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.267376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.277248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.277364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.277382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.277389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.277396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.277412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.287199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.287339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.287358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.287364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.287370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.287387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.297243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.297356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.297375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.297382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.297388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.297404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.307337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.307453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.307471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.307479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.307485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.307501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.317270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.317409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.317427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.317435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.317441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.317457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.327346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.327457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.327476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.327483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.327489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.327504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.337371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.337488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.337510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.337517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.337523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.337539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.347424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.347536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.347554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.347561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.347567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.347583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.357472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.357585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.357603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.357610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.357616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.357633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.367422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.367534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.367553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.367560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.367566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.367582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.377526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.377650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.377669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.377676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.377682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.377702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.584 [2024-07-22 20:34:48.387696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.584 [2024-07-22 20:34:48.387888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.584 [2024-07-22 20:34:48.387907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.584 [2024-07-22 20:34:48.387914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.584 [2024-07-22 20:34:48.387920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.584 [2024-07-22 20:34:48.387937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.584 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.397520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.397664] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.397683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.397690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.397696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.397713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.407595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.407706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.407724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.407731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.407737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.407753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.417682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.417806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.417825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.417832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.417838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.417854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.427695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.427820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.427842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.427848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.427854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.427871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.437755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.437893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.437911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.437918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.437924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.437940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.447648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.447760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.447778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.447785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.447791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.447807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.457773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.458018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.458036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.458048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.458054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.458069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.467794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.467936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.467955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.467962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.467968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.467987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.477813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.477927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.477946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.477953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.477960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.477976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.487825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.487933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.487952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.487959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.487966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.487983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.497851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.497964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.497982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.497990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.497995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.498011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.507910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.508020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.508038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.508050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.508057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.508073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.585 [2024-07-22 20:34:48.517929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.585 [2024-07-22 20:34:48.518052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.585 [2024-07-22 20:34:48.518073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.585 [2024-07-22 20:34:48.518081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.585 [2024-07-22 20:34:48.518087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.585 [2024-07-22 20:34:48.518103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.585 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.527906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.528022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.528041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.528053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.528059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.528075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.537970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.538248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.538266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.538273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.538279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.538295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.548037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.548183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.548201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.548208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.548214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.548230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.557979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.558096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.558115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.558121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.558128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.558147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.568090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.568200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.568226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.568234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.568240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.568257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.578112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.578223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.578241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.578248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.578255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.578271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.588285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.588398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.588416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.588423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.588429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.588445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.598221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.598348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.598366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.598373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.598379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.598394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.608224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.608332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.608355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.608362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.608368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.608384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.844 qpair failed and we were unable to recover it. 00:29:16.844 [2024-07-22 20:34:48.618219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.844 [2024-07-22 20:34:48.618331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.844 [2024-07-22 20:34:48.618350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.844 [2024-07-22 20:34:48.618357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.844 [2024-07-22 20:34:48.618363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.844 [2024-07-22 20:34:48.618378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.628266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.628374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.628393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.628400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.628406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.628422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.638287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.638401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.638419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.638426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.638432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.638447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.648237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.648349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.648367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.648374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.648384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.648399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.658341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.658447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.658466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.658473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.658479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.658495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.668373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.668485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.668504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.668511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.668517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.668533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.678400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.678511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.678529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.678536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.678542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.678559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.688430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.688538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.688557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.688564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.688570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.688586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.698457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.698579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.698597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.698604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.698610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.698626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.708483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.708596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.708614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.708622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.708627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.708643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.718510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.718626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.718646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.718653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.718659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.718676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.728540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.728651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.728670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.728677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.728683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.728699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.738583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.738735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.738754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.738761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.738770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.738786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.748636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.748756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.845 [2024-07-22 20:34:48.748774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.845 [2024-07-22 20:34:48.748782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.845 [2024-07-22 20:34:48.748788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.845 [2024-07-22 20:34:48.748804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.845 qpair failed and we were unable to recover it. 00:29:16.845 [2024-07-22 20:34:48.758539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.845 [2024-07-22 20:34:48.758652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.846 [2024-07-22 20:34:48.758671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.846 [2024-07-22 20:34:48.758678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.846 [2024-07-22 20:34:48.758683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.846 [2024-07-22 20:34:48.758700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.846 qpair failed and we were unable to recover it. 00:29:16.846 [2024-07-22 20:34:48.768648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.846 [2024-07-22 20:34:48.768761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.846 [2024-07-22 20:34:48.768779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.846 [2024-07-22 20:34:48.768787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.846 [2024-07-22 20:34:48.768793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.846 [2024-07-22 20:34:48.768808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.846 qpair failed and we were unable to recover it. 00:29:16.846 [2024-07-22 20:34:48.778728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:16.846 [2024-07-22 20:34:48.778858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:16.846 [2024-07-22 20:34:48.778876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:16.846 [2024-07-22 20:34:48.778883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:16.846 [2024-07-22 20:34:48.778890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:16.846 [2024-07-22 20:34:48.778906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:16.846 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.788732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.788853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.788872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.788878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.788884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.788900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.798735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.798854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.798873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.798879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.798886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.798902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.808769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.808879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.808897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.808904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.808910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.808926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.818806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.818924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.818942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.818948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.818954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.818970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.828851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.828963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.828981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.828988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.828999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.829015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.838907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.839015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.839034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.839040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.839054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.839070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.848880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.848987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.849005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.849012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.849018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.849034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.858907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.859019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.859038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.859053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.859059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.859076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.105 [2024-07-22 20:34:48.868930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.105 [2024-07-22 20:34:48.869047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.105 [2024-07-22 20:34:48.869066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.105 [2024-07-22 20:34:48.869073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.105 [2024-07-22 20:34:48.869079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.105 [2024-07-22 20:34:48.869095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.105 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.878951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.879067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.879085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.879092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.879098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.879114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.888974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.889094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.889113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.889119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.889125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.889141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.899024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.899129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.899147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.899154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.899160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.899176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.909075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.909187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.909206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.909213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.909219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.909235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.919091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.919205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.919223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.919230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.919240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.919256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.929109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.929224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.929243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.929250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.929256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.929272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.939173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.939289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.939307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.939314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.939320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.939337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.949185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.949301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.949320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.949327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.949333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.949349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.959191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.959308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.959327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.959334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.959340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.959356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.969244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.969356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.969375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.969382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.969388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.969405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.979267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.979377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.979396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.979403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.979409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.979425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.989330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.989443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.989462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.989469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.989475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.989491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:48.999331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.106 [2024-07-22 20:34:48.999448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.106 [2024-07-22 20:34:48.999466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.106 [2024-07-22 20:34:48.999473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.106 [2024-07-22 20:34:48.999479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.106 [2024-07-22 20:34:48.999495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.106 qpair failed and we were unable to recover it. 00:29:17.106 [2024-07-22 20:34:49.009377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.107 [2024-07-22 20:34:49.009490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.107 [2024-07-22 20:34:49.009508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.107 [2024-07-22 20:34:49.009518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.107 [2024-07-22 20:34:49.009524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.107 [2024-07-22 20:34:49.009540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.107 qpair failed and we were unable to recover it. 00:29:17.107 [2024-07-22 20:34:49.019354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.107 [2024-07-22 20:34:49.019460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.107 [2024-07-22 20:34:49.019478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.107 [2024-07-22 20:34:49.019485] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.107 [2024-07-22 20:34:49.019490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.107 [2024-07-22 20:34:49.019506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.107 qpair failed and we were unable to recover it. 00:29:17.107 [2024-07-22 20:34:49.029415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.107 [2024-07-22 20:34:49.029531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.107 [2024-07-22 20:34:49.029550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.107 [2024-07-22 20:34:49.029557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.107 [2024-07-22 20:34:49.029563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.107 [2024-07-22 20:34:49.029579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.107 qpair failed and we were unable to recover it. 00:29:17.107 [2024-07-22 20:34:49.039440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.107 [2024-07-22 20:34:49.039558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.107 [2024-07-22 20:34:49.039575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.107 [2024-07-22 20:34:49.039582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.107 [2024-07-22 20:34:49.039588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.107 [2024-07-22 20:34:49.039604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.107 qpair failed and we were unable to recover it. 00:29:17.368 [2024-07-22 20:34:49.049482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.368 [2024-07-22 20:34:49.049731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.368 [2024-07-22 20:34:49.049751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.368 [2024-07-22 20:34:49.049757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.368 [2024-07-22 20:34:49.049763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.368 [2024-07-22 20:34:49.049779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.368 qpair failed and we were unable to recover it. 00:29:17.368 [2024-07-22 20:34:49.059512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.368 [2024-07-22 20:34:49.059626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.368 [2024-07-22 20:34:49.059645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.368 [2024-07-22 20:34:49.059652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.368 [2024-07-22 20:34:49.059658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.368 [2024-07-22 20:34:49.059674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.368 qpair failed and we were unable to recover it. 00:29:17.368 [2024-07-22 20:34:49.069543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.368 [2024-07-22 20:34:49.069654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.368 [2024-07-22 20:34:49.069673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.368 [2024-07-22 20:34:49.069680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.368 [2024-07-22 20:34:49.069686] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.368 [2024-07-22 20:34:49.069702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.368 qpair failed and we were unable to recover it. 00:29:17.368 [2024-07-22 20:34:49.079558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.368 [2024-07-22 20:34:49.079816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.368 [2024-07-22 20:34:49.079834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.368 [2024-07-22 20:34:49.079841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.368 [2024-07-22 20:34:49.079847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.368 [2024-07-22 20:34:49.079863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.368 qpair failed and we were unable to recover it. 00:29:17.368 [2024-07-22 20:34:49.089596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.368 [2024-07-22 20:34:49.089703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.368 [2024-07-22 20:34:49.089722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.368 [2024-07-22 20:34:49.089728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.368 [2024-07-22 20:34:49.089735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.368 [2024-07-22 20:34:49.089751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.368 qpair failed and we were unable to recover it. 00:29:17.368 [2024-07-22 20:34:49.099616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.368 [2024-07-22 20:34:49.099739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.368 [2024-07-22 20:34:49.099758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.368 [2024-07-22 20:34:49.099768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.368 [2024-07-22 20:34:49.099774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.368 [2024-07-22 20:34:49.099791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.368 qpair failed and we were unable to recover it. 00:29:17.368 [2024-07-22 20:34:49.109573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.109691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.109709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.109716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.369 [2024-07-22 20:34:49.109722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.369 [2024-07-22 20:34:49.109738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.369 qpair failed and we were unable to recover it. 00:29:17.369 [2024-07-22 20:34:49.119684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.119801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.119819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.119826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.369 [2024-07-22 20:34:49.119832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.369 [2024-07-22 20:34:49.119848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.369 qpair failed and we were unable to recover it. 00:29:17.369 [2024-07-22 20:34:49.129698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.129811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.129830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.129838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.369 [2024-07-22 20:34:49.129844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.369 [2024-07-22 20:34:49.129860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.369 qpair failed and we were unable to recover it. 00:29:17.369 [2024-07-22 20:34:49.139728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.139839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.139858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.139866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.369 [2024-07-22 20:34:49.139872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.369 [2024-07-22 20:34:49.139888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.369 qpair failed and we were unable to recover it. 00:29:17.369 [2024-07-22 20:34:49.149694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.149805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.149825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.149833] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.369 [2024-07-22 20:34:49.149839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.369 [2024-07-22 20:34:49.149855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.369 qpair failed and we were unable to recover it. 00:29:17.369 [2024-07-22 20:34:49.159798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.159919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.159938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.159945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.369 [2024-07-22 20:34:49.159951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.369 [2024-07-22 20:34:49.159968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.369 qpair failed and we were unable to recover it. 00:29:17.369 [2024-07-22 20:34:49.169835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.169944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.169963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.169971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.369 [2024-07-22 20:34:49.169978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.369 [2024-07-22 20:34:49.169995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.369 qpair failed and we were unable to recover it. 00:29:17.369 [2024-07-22 20:34:49.179836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.179946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.179965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.179972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.369 [2024-07-22 20:34:49.179979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.369 [2024-07-22 20:34:49.179995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.369 qpair failed and we were unable to recover it. 00:29:17.369 [2024-07-22 20:34:49.189893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.369 [2024-07-22 20:34:49.190005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.369 [2024-07-22 20:34:49.190023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.369 [2024-07-22 20:34:49.190034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.370 [2024-07-22 20:34:49.190040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.370 [2024-07-22 20:34:49.190063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.370 qpair failed and we were unable to recover it. 00:29:17.370 [2024-07-22 20:34:49.199904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.370 [2024-07-22 20:34:49.200019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.370 [2024-07-22 20:34:49.200039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.370 [2024-07-22 20:34:49.200054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.370 [2024-07-22 20:34:49.200060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.370 [2024-07-22 20:34:49.200077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.370 qpair failed and we were unable to recover it. 00:29:17.370 [2024-07-22 20:34:49.210083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.370 [2024-07-22 20:34:49.210207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.370 [2024-07-22 20:34:49.210226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.370 [2024-07-22 20:34:49.210232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.370 [2024-07-22 20:34:49.210238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.370 [2024-07-22 20:34:49.210255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.370 qpair failed and we were unable to recover it. 00:29:17.370 [2024-07-22 20:34:49.219987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.370 [2024-07-22 20:34:49.220100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.370 [2024-07-22 20:34:49.220119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.370 [2024-07-22 20:34:49.220126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.370 [2024-07-22 20:34:49.220132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.370 [2024-07-22 20:34:49.220149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.370 qpair failed and we were unable to recover it. 00:29:17.370 [2024-07-22 20:34:49.230022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.370 [2024-07-22 20:34:49.230132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.370 [2024-07-22 20:34:49.230151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.370 [2024-07-22 20:34:49.230157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.370 [2024-07-22 20:34:49.230164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.370 [2024-07-22 20:34:49.230180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.370 qpair failed and we were unable to recover it. 00:29:17.370 [2024-07-22 20:34:49.240003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.370 [2024-07-22 20:34:49.240119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.370 [2024-07-22 20:34:49.240137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.370 [2024-07-22 20:34:49.240144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.370 [2024-07-22 20:34:49.240149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.370 [2024-07-22 20:34:49.240165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.370 qpair failed and we were unable to recover it. 00:29:17.370 [2024-07-22 20:34:49.250068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.370 [2024-07-22 20:34:49.250180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.370 [2024-07-22 20:34:49.250198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.370 [2024-07-22 20:34:49.250205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.370 [2024-07-22 20:34:49.250210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.370 [2024-07-22 20:34:49.250226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.370 qpair failed and we were unable to recover it. 00:29:17.370 [2024-07-22 20:34:49.260106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.370 [2024-07-22 20:34:49.260223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.370 [2024-07-22 20:34:49.260242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.370 [2024-07-22 20:34:49.260248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.370 [2024-07-22 20:34:49.260254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.370 [2024-07-22 20:34:49.260270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.370 qpair failed and we were unable to recover it. 00:29:17.370 [2024-07-22 20:34:49.270166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.370 [2024-07-22 20:34:49.270308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.370 [2024-07-22 20:34:49.270327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.371 [2024-07-22 20:34:49.270334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.371 [2024-07-22 20:34:49.270340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.371 [2024-07-22 20:34:49.270356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.371 qpair failed and we were unable to recover it. 00:29:17.371 [2024-07-22 20:34:49.280194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.371 [2024-07-22 20:34:49.280310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.371 [2024-07-22 20:34:49.280328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.371 [2024-07-22 20:34:49.280338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.371 [2024-07-22 20:34:49.280344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.371 [2024-07-22 20:34:49.280360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.371 qpair failed and we were unable to recover it. 00:29:17.371 [2024-07-22 20:34:49.290114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.371 [2024-07-22 20:34:49.290226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.371 [2024-07-22 20:34:49.290245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.371 [2024-07-22 20:34:49.290252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.371 [2024-07-22 20:34:49.290258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.371 [2024-07-22 20:34:49.290274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.371 qpair failed and we were unable to recover it. 00:29:17.371 [2024-07-22 20:34:49.300215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.371 [2024-07-22 20:34:49.300329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.371 [2024-07-22 20:34:49.300347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.371 [2024-07-22 20:34:49.300354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.371 [2024-07-22 20:34:49.300360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.371 [2024-07-22 20:34:49.300376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.371 qpair failed and we were unable to recover it. 00:29:17.630 [2024-07-22 20:34:49.310288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.630 [2024-07-22 20:34:49.310403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.630 [2024-07-22 20:34:49.310422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.630 [2024-07-22 20:34:49.310429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.630 [2024-07-22 20:34:49.310435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.630 [2024-07-22 20:34:49.310450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.630 qpair failed and we were unable to recover it. 00:29:17.630 [2024-07-22 20:34:49.320282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.630 [2024-07-22 20:34:49.320395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.630 [2024-07-22 20:34:49.320413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.630 [2024-07-22 20:34:49.320420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.630 [2024-07-22 20:34:49.320426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.630 [2024-07-22 20:34:49.320442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.630 qpair failed and we were unable to recover it. 00:29:17.630 [2024-07-22 20:34:49.330312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.630 [2024-07-22 20:34:49.330426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.630 [2024-07-22 20:34:49.330445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.630 [2024-07-22 20:34:49.330451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.630 [2024-07-22 20:34:49.330458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.630 [2024-07-22 20:34:49.330474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.340336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.340450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.340469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.340476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.340482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.340498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.350373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.350502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.350521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.350528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.350534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.350550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.360382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.360492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.360511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.360518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.360524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.360540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.370345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.370455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.370478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.370486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.370492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.370508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.380456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.380585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.380604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.380611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.380617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.380633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.390466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.390576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.390594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.390601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.390607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.390623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.400520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.400644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.400663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.400670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.400676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.400692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.410518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.410629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.410648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.410655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.410661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.410678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.420577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.420690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.420708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.420715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.420721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.420737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.430603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.430717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.430735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.430742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.430748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.430764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.440631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.440787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.440805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.440812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.440818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.440834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.450632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.450740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.450758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.450765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.450771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.450787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.460676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.460779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.631 [2024-07-22 20:34:49.460800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.631 [2024-07-22 20:34:49.460807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.631 [2024-07-22 20:34:49.460813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.631 [2024-07-22 20:34:49.460830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.631 qpair failed and we were unable to recover it. 00:29:17.631 [2024-07-22 20:34:49.470720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.631 [2024-07-22 20:34:49.470833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.470852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.470859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.470864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.470881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.480785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.480943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.480961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.480968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.480974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.480990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.490777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.490888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.490906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.490914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.490920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.490936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.500763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.500876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.500895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.500902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.500908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.500925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.510746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.510856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.510873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.510881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.510887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.510902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.520987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.521108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.521126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.521133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.521139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.521156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.530807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.530920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.530940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.530946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.530952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.530969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.540908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.541019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.541038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.541051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.541057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.541074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.550922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.551034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.551062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.551069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.551075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.551091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.632 [2024-07-22 20:34:49.560974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.632 [2024-07-22 20:34:49.561096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.632 [2024-07-22 20:34:49.561114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.632 [2024-07-22 20:34:49.561121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.632 [2024-07-22 20:34:49.561127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.632 [2024-07-22 20:34:49.561143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.632 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.570941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.571063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.891 [2024-07-22 20:34:49.571082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.891 [2024-07-22 20:34:49.571089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.891 [2024-07-22 20:34:49.571094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.891 [2024-07-22 20:34:49.571111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.891 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.580950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.581068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.891 [2024-07-22 20:34:49.581085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.891 [2024-07-22 20:34:49.581093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.891 [2024-07-22 20:34:49.581099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.891 [2024-07-22 20:34:49.581115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.891 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.591079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.591195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.891 [2024-07-22 20:34:49.591214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.891 [2024-07-22 20:34:49.591221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.891 [2024-07-22 20:34:49.591227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.891 [2024-07-22 20:34:49.591249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.891 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.601010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.601129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.891 [2024-07-22 20:34:49.601148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.891 [2024-07-22 20:34:49.601155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.891 [2024-07-22 20:34:49.601161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.891 [2024-07-22 20:34:49.601177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.891 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.611091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.611202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.891 [2024-07-22 20:34:49.611220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.891 [2024-07-22 20:34:49.611227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.891 [2024-07-22 20:34:49.611233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.891 [2024-07-22 20:34:49.611249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.891 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.621065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.621173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.891 [2024-07-22 20:34:49.621192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.891 [2024-07-22 20:34:49.621199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.891 [2024-07-22 20:34:49.621205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.891 [2024-07-22 20:34:49.621222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.891 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.631176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.631303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.891 [2024-07-22 20:34:49.631321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.891 [2024-07-22 20:34:49.631328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.891 [2024-07-22 20:34:49.631335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.891 [2024-07-22 20:34:49.631351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.891 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.641206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.641321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.891 [2024-07-22 20:34:49.641343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.891 [2024-07-22 20:34:49.641350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.891 [2024-07-22 20:34:49.641356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.891 [2024-07-22 20:34:49.641372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.891 qpair failed and we were unable to recover it. 00:29:17.891 [2024-07-22 20:34:49.651154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.891 [2024-07-22 20:34:49.651391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.651409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.651416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.651422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.651437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.661253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.661365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.661383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.661390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.661395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.661412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.671294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.671402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.671421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.671428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.671434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.671450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.681278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.681393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.681412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.681419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.681425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.681444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.691370] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.691482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.691501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.691507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.691514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.691530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.701287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.701410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.701428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.701435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.701441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.701457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.711383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.711489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.711512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.711519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.711526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.711542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.721360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.721474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.721493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.721500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.721506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.721522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.731459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.731564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.731587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.731594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.731599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.731615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.741416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.741525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.741543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.741550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.741556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.741572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.751447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.751559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.751578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.751585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.751591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2347710 00:29:17.892 [2024-07-22 20:34:49.751606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.761539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.761657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.761681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.761689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.761695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:17.892 [2024-07-22 20:34:49.761714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.771508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.771629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.771649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.771656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.892 [2024-07-22 20:34:49.771663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf8000b90 00:29:17.892 [2024-07-22 20:34:49.771683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:17.892 qpair failed and we were unable to recover it. 00:29:17.892 [2024-07-22 20:34:49.781570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.892 [2024-07-22 20:34:49.781708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.892 [2024-07-22 20:34:49.781736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.892 [2024-07-22 20:34:49.781748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.893 [2024-07-22 20:34:49.781757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf0000b90 00:29:17.893 [2024-07-22 20:34:49.781780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:29:17.893 qpair failed and we were unable to recover it. 00:29:17.893 [2024-07-22 20:34:49.791588] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.893 [2024-07-22 20:34:49.791698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.893 [2024-07-22 20:34:49.791717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.893 [2024-07-22 20:34:49.791725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.893 [2024-07-22 20:34:49.791732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7febf0000b90 00:29:17.893 [2024-07-22 20:34:49.791749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:29:17.893 qpair failed and we were unable to recover it. 00:29:17.893 [2024-07-22 20:34:49.801676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.893 [2024-07-22 20:34:49.801811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.893 [2024-07-22 20:34:49.801839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.893 [2024-07-22 20:34:49.801850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.893 [2024-07-22 20:34:49.801859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fec00000b90 00:29:17.893 [2024-07-22 20:34:49.801882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:29:17.893 qpair failed and we were unable to recover it. 00:29:17.893 [2024-07-22 20:34:49.811695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:29:17.893 [2024-07-22 20:34:49.811808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:29:17.893 [2024-07-22 20:34:49.811827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:29:17.893 [2024-07-22 20:34:49.811835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:29:17.893 [2024-07-22 20:34:49.811841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fec00000b90 00:29:17.893 [2024-07-22 20:34:49.811858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:29:17.893 qpair failed and we were unable to recover it. 00:29:17.893 [2024-07-22 20:34:49.811923] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:29:17.893 A controller has encountered a failure and is being reset. 00:29:17.893 [2024-07-22 20:34:49.811963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2355200 (9): Bad file descriptor 00:29:17.893 Controller properly reset. 00:29:18.152 Initializing NVMe Controllers 00:29:18.152 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:29:18.152 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:29:18.152 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:29:18.152 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:29:18.152 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:29:18.152 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:29:18.152 Initialization complete. Launching workers. 00:29:18.152 Starting thread on core 1 00:29:18.152 Starting thread on core 2 00:29:18.152 Starting thread on core 3 00:29:18.152 Starting thread on core 0 00:29:18.152 20:34:49 -- host/target_disconnect.sh@59 -- # sync 00:29:18.152 00:29:18.152 real 0m11.339s 00:29:18.152 user 0m20.368s 00:29:18.152 sys 0m4.388s 00:29:18.152 20:34:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:18.152 20:34:49 -- common/autotest_common.sh@10 -- # set +x 00:29:18.152 ************************************ 00:29:18.152 END TEST nvmf_target_disconnect_tc2 00:29:18.152 ************************************ 00:29:18.152 20:34:49 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:29:18.152 20:34:49 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:29:18.152 20:34:49 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:29:18.152 20:34:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:18.152 20:34:49 -- nvmf/common.sh@116 -- # sync 00:29:18.152 20:34:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:18.152 20:34:49 -- nvmf/common.sh@119 -- # set +e 00:29:18.152 20:34:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:18.152 20:34:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:18.152 rmmod nvme_tcp 00:29:18.152 rmmod nvme_fabrics 00:29:18.152 rmmod nvme_keyring 00:29:18.152 20:34:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:18.152 20:34:49 -- nvmf/common.sh@123 -- # set -e 00:29:18.152 20:34:49 -- nvmf/common.sh@124 -- # return 0 00:29:18.152 20:34:49 -- nvmf/common.sh@477 -- # '[' -n 3584518 ']' 00:29:18.152 20:34:49 -- nvmf/common.sh@478 -- # killprocess 3584518 00:29:18.152 20:34:49 -- common/autotest_common.sh@926 -- # '[' -z 3584518 ']' 00:29:18.152 20:34:49 -- common/autotest_common.sh@930 -- # kill -0 3584518 00:29:18.152 20:34:49 -- common/autotest_common.sh@931 -- # uname 00:29:18.152 20:34:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:18.152 20:34:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3584518 00:29:18.152 20:34:49 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:29:18.152 20:34:49 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:29:18.152 20:34:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3584518' 00:29:18.152 killing process with pid 3584518 00:29:18.152 20:34:49 -- common/autotest_common.sh@945 -- # kill 3584518 00:29:18.152 20:34:49 -- common/autotest_common.sh@950 -- # wait 3584518 00:29:18.411 20:34:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:18.411 20:34:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:18.411 20:34:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:18.411 20:34:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:18.411 20:34:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:18.411 20:34:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:18.411 20:34:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:18.411 20:34:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:20.947 20:34:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:20.947 00:29:20.947 real 0m19.503s 00:29:20.947 user 0m47.756s 00:29:20.947 sys 0m8.897s 00:29:20.947 20:34:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:20.947 20:34:52 -- common/autotest_common.sh@10 -- # set +x 00:29:20.947 ************************************ 00:29:20.947 END TEST nvmf_target_disconnect 00:29:20.947 ************************************ 00:29:20.947 20:34:52 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:29:20.947 20:34:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:20.947 20:34:52 -- common/autotest_common.sh@10 -- # set +x 00:29:20.947 20:34:52 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:29:20.947 00:29:20.947 real 23m7.233s 00:29:20.947 user 62m34.027s 00:29:20.947 sys 5m52.443s 00:29:20.947 20:34:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:20.947 20:34:52 -- common/autotest_common.sh@10 -- # set +x 00:29:20.947 ************************************ 00:29:20.947 END TEST nvmf_tcp 00:29:20.947 ************************************ 00:29:20.947 20:34:52 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:29:20.947 20:34:52 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:29:20.947 20:34:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:20.947 20:34:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:20.947 20:34:52 -- common/autotest_common.sh@10 -- # set +x 00:29:20.947 ************************************ 00:29:20.947 START TEST spdkcli_nvmf_tcp 00:29:20.947 ************************************ 00:29:20.947 20:34:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:29:20.947 * Looking for test storage... 00:29:20.947 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:29:20.947 20:34:52 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:29:20.947 20:34:52 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:29:20.947 20:34:52 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:29:20.947 20:34:52 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:20.947 20:34:52 -- nvmf/common.sh@7 -- # uname -s 00:29:20.947 20:34:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:20.947 20:34:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:20.947 20:34:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:20.947 20:34:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:20.947 20:34:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:20.947 20:34:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:20.947 20:34:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:20.947 20:34:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:20.947 20:34:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:20.947 20:34:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:20.947 20:34:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:29:20.947 20:34:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:29:20.947 20:34:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:20.947 20:34:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:20.947 20:34:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:20.947 20:34:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:20.947 20:34:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:20.947 20:34:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:20.947 20:34:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:20.947 20:34:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:20.947 20:34:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:20.947 20:34:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:20.947 20:34:52 -- paths/export.sh@5 -- # export PATH 00:29:20.947 20:34:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:20.947 20:34:52 -- nvmf/common.sh@46 -- # : 0 00:29:20.947 20:34:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:20.947 20:34:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:20.947 20:34:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:20.947 20:34:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:20.947 20:34:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:20.947 20:34:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:20.947 20:34:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:20.947 20:34:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:20.947 20:34:52 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:29:20.947 20:34:52 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:29:20.947 20:34:52 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:29:20.947 20:34:52 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:29:20.947 20:34:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:20.947 20:34:52 -- common/autotest_common.sh@10 -- # set +x 00:29:20.947 20:34:52 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:29:20.947 20:34:52 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3586104 00:29:20.947 20:34:52 -- spdkcli/common.sh@34 -- # waitforlisten 3586104 00:29:20.947 20:34:52 -- common/autotest_common.sh@819 -- # '[' -z 3586104 ']' 00:29:20.947 20:34:52 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:29:20.947 20:34:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:20.947 20:34:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:20.947 20:34:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:20.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:20.947 20:34:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:20.947 20:34:52 -- common/autotest_common.sh@10 -- # set +x 00:29:20.947 [2024-07-22 20:34:52.537434] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:29:20.947 [2024-07-22 20:34:52.537484] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3586104 ] 00:29:20.947 EAL: No free 2048 kB hugepages reported on node 1 00:29:20.947 [2024-07-22 20:34:52.590768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:29:20.947 [2024-07-22 20:34:52.669990] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:20.947 [2024-07-22 20:34:52.670149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:20.947 [2024-07-22 20:34:52.670151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:21.516 20:34:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:21.516 20:34:53 -- common/autotest_common.sh@852 -- # return 0 00:29:21.516 20:34:53 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:29:21.516 20:34:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:21.516 20:34:53 -- common/autotest_common.sh@10 -- # set +x 00:29:21.516 20:34:53 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:29:21.516 20:34:53 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:29:21.516 20:34:53 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:29:21.516 20:34:53 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:21.516 20:34:53 -- common/autotest_common.sh@10 -- # set +x 00:29:21.516 20:34:53 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:29:21.516 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:29:21.516 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:29:21.516 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:29:21.516 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:29:21.516 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:29:21.516 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:29:21.516 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:29:21.516 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:29:21.516 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:29:21.516 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:29:21.516 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:29:21.516 ' 00:29:22.084 [2024-07-22 20:34:53.716493] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:29:23.990 [2024-07-22 20:34:55.757030] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:25.368 [2024-07-22 20:34:56.933101] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:29:27.273 [2024-07-22 20:34:59.096014] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:29:29.180 [2024-07-22 20:35:00.954039] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:29:30.559 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:29:30.559 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:29:30.559 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:29:30.559 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:29:30.559 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:29:30.559 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:29:30.559 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:29:30.559 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:29:30.559 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:29:30.559 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:29:30.559 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:29:30.559 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:29:30.559 20:35:02 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:29:30.559 20:35:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:30.559 20:35:02 -- common/autotest_common.sh@10 -- # set +x 00:29:30.818 20:35:02 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:29:30.818 20:35:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:30.818 20:35:02 -- common/autotest_common.sh@10 -- # set +x 00:29:30.818 20:35:02 -- spdkcli/nvmf.sh@69 -- # check_match 00:29:30.818 20:35:02 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:29:31.077 20:35:02 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:29:31.077 20:35:02 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:29:31.077 20:35:02 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:29:31.078 20:35:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:31.078 20:35:02 -- common/autotest_common.sh@10 -- # set +x 00:29:31.078 20:35:02 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:29:31.078 20:35:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:31.078 20:35:02 -- common/autotest_common.sh@10 -- # set +x 00:29:31.078 20:35:02 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:29:31.078 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:29:31.078 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:29:31.078 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:29:31.078 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:29:31.078 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:29:31.078 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:29:31.078 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:29:31.078 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:29:31.078 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:29:31.078 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:29:31.078 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:29:31.078 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:29:31.078 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:29:31.078 ' 00:29:36.352 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:29:36.352 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:29:36.352 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:29:36.352 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:29:36.352 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:29:36.352 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:29:36.352 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:29:36.352 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:29:36.352 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:29:36.352 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:29:36.352 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:29:36.352 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:29:36.352 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:29:36.352 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:29:36.352 20:35:07 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:29:36.352 20:35:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:36.352 20:35:07 -- common/autotest_common.sh@10 -- # set +x 00:29:36.352 20:35:07 -- spdkcli/nvmf.sh@90 -- # killprocess 3586104 00:29:36.352 20:35:07 -- common/autotest_common.sh@926 -- # '[' -z 3586104 ']' 00:29:36.352 20:35:07 -- common/autotest_common.sh@930 -- # kill -0 3586104 00:29:36.352 20:35:07 -- common/autotest_common.sh@931 -- # uname 00:29:36.352 20:35:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:36.352 20:35:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3586104 00:29:36.352 20:35:07 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:36.352 20:35:07 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:36.352 20:35:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3586104' 00:29:36.352 killing process with pid 3586104 00:29:36.352 20:35:07 -- common/autotest_common.sh@945 -- # kill 3586104 00:29:36.352 [2024-07-22 20:35:07.990418] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:29:36.352 20:35:07 -- common/autotest_common.sh@950 -- # wait 3586104 00:29:36.352 20:35:08 -- spdkcli/nvmf.sh@1 -- # cleanup 00:29:36.352 20:35:08 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:29:36.352 20:35:08 -- spdkcli/common.sh@13 -- # '[' -n 3586104 ']' 00:29:36.352 20:35:08 -- spdkcli/common.sh@14 -- # killprocess 3586104 00:29:36.352 20:35:08 -- common/autotest_common.sh@926 -- # '[' -z 3586104 ']' 00:29:36.352 20:35:08 -- common/autotest_common.sh@930 -- # kill -0 3586104 00:29:36.352 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3586104) - No such process 00:29:36.352 20:35:08 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3586104 is not found' 00:29:36.352 Process with pid 3586104 is not found 00:29:36.352 20:35:08 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:29:36.352 20:35:08 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:29:36.352 20:35:08 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:29:36.352 00:29:36.353 real 0m15.824s 00:29:36.353 user 0m32.739s 00:29:36.353 sys 0m0.681s 00:29:36.353 20:35:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:36.353 20:35:08 -- common/autotest_common.sh@10 -- # set +x 00:29:36.353 ************************************ 00:29:36.353 END TEST spdkcli_nvmf_tcp 00:29:36.353 ************************************ 00:29:36.353 20:35:08 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:29:36.353 20:35:08 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:36.353 20:35:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:36.353 20:35:08 -- common/autotest_common.sh@10 -- # set +x 00:29:36.353 ************************************ 00:29:36.353 START TEST nvmf_identify_passthru 00:29:36.353 ************************************ 00:29:36.353 20:35:08 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:29:36.612 * Looking for test storage... 00:29:36.612 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:36.612 20:35:08 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:36.612 20:35:08 -- nvmf/common.sh@7 -- # uname -s 00:29:36.612 20:35:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:36.612 20:35:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:36.612 20:35:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:36.612 20:35:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:36.612 20:35:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:36.612 20:35:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:36.612 20:35:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:36.612 20:35:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:36.612 20:35:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:36.612 20:35:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:36.612 20:35:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:29:36.612 20:35:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:29:36.612 20:35:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:36.612 20:35:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:36.612 20:35:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:36.612 20:35:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:36.612 20:35:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:36.612 20:35:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:36.612 20:35:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:36.612 20:35:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.612 20:35:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.612 20:35:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.612 20:35:08 -- paths/export.sh@5 -- # export PATH 00:29:36.612 20:35:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.612 20:35:08 -- nvmf/common.sh@46 -- # : 0 00:29:36.612 20:35:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:36.612 20:35:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:36.612 20:35:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:36.612 20:35:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:36.612 20:35:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:36.612 20:35:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:36.612 20:35:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:36.612 20:35:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:36.612 20:35:08 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:36.612 20:35:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:36.612 20:35:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:36.612 20:35:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:36.612 20:35:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.612 20:35:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.612 20:35:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.612 20:35:08 -- paths/export.sh@5 -- # export PATH 00:29:36.612 20:35:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.612 20:35:08 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:29:36.612 20:35:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:36.612 20:35:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:36.612 20:35:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:36.612 20:35:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:36.612 20:35:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:36.612 20:35:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:36.613 20:35:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:36.613 20:35:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:36.613 20:35:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:36.613 20:35:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:36.613 20:35:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:36.613 20:35:08 -- common/autotest_common.sh@10 -- # set +x 00:29:41.891 20:35:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:41.891 20:35:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:41.891 20:35:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:41.891 20:35:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:41.891 20:35:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:41.891 20:35:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:41.891 20:35:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:41.891 20:35:13 -- nvmf/common.sh@294 -- # net_devs=() 00:29:41.891 20:35:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:41.891 20:35:13 -- nvmf/common.sh@295 -- # e810=() 00:29:41.891 20:35:13 -- nvmf/common.sh@295 -- # local -ga e810 00:29:41.891 20:35:13 -- nvmf/common.sh@296 -- # x722=() 00:29:41.891 20:35:13 -- nvmf/common.sh@296 -- # local -ga x722 00:29:41.891 20:35:13 -- nvmf/common.sh@297 -- # mlx=() 00:29:41.891 20:35:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:41.891 20:35:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:41.891 20:35:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:41.891 20:35:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:41.891 20:35:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:41.891 20:35:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.891 20:35:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:29:41.891 Found 0000:86:00.0 (0x8086 - 0x159b) 00:29:41.891 20:35:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.891 20:35:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:29:41.891 Found 0000:86:00.1 (0x8086 - 0x159b) 00:29:41.891 20:35:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:41.891 20:35:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:41.891 20:35:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.891 20:35:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.891 20:35:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.891 20:35:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.891 20:35:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:29:41.891 Found net devices under 0000:86:00.0: cvl_0_0 00:29:41.891 20:35:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.891 20:35:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.892 20:35:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.892 20:35:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.892 20:35:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.892 20:35:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:29:41.892 Found net devices under 0000:86:00.1: cvl_0_1 00:29:41.892 20:35:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.892 20:35:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:41.892 20:35:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:41.892 20:35:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:41.892 20:35:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:41.892 20:35:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:41.892 20:35:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:41.892 20:35:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:41.892 20:35:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:41.892 20:35:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:41.892 20:35:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:41.892 20:35:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:41.892 20:35:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:41.892 20:35:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:41.892 20:35:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:41.892 20:35:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:41.892 20:35:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:41.892 20:35:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:41.892 20:35:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:41.892 20:35:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:41.892 20:35:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:41.892 20:35:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:41.892 20:35:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:41.892 20:35:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:41.892 20:35:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:41.892 20:35:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:41.892 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:41.892 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.165 ms 00:29:41.892 00:29:41.892 --- 10.0.0.2 ping statistics --- 00:29:41.892 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.892 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:29:41.892 20:35:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:41.892 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:41.892 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.304 ms 00:29:41.892 00:29:41.892 --- 10.0.0.1 ping statistics --- 00:29:41.892 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.892 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:29:41.892 20:35:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:41.892 20:35:13 -- nvmf/common.sh@410 -- # return 0 00:29:41.892 20:35:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:41.892 20:35:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:41.892 20:35:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:41.892 20:35:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:41.892 20:35:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:41.892 20:35:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:41.892 20:35:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:41.892 20:35:13 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:29:41.892 20:35:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:41.892 20:35:13 -- common/autotest_common.sh@10 -- # set +x 00:29:41.892 20:35:13 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:29:41.892 20:35:13 -- common/autotest_common.sh@1509 -- # bdfs=() 00:29:41.892 20:35:13 -- common/autotest_common.sh@1509 -- # local bdfs 00:29:41.892 20:35:13 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:29:41.892 20:35:13 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:29:41.892 20:35:13 -- common/autotest_common.sh@1498 -- # bdfs=() 00:29:41.892 20:35:13 -- common/autotest_common.sh@1498 -- # local bdfs 00:29:41.892 20:35:13 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:29:41.892 20:35:13 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:29:41.892 20:35:13 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:29:41.892 20:35:13 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:29:41.892 20:35:13 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:5e:00.0 00:29:41.892 20:35:13 -- common/autotest_common.sh@1512 -- # echo 0000:5e:00.0 00:29:41.892 20:35:13 -- target/identify_passthru.sh@16 -- # bdf=0000:5e:00.0 00:29:41.892 20:35:13 -- target/identify_passthru.sh@17 -- # '[' -z 0000:5e:00.0 ']' 00:29:41.892 20:35:13 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:5e:00.0' -i 0 00:29:41.892 20:35:13 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:29:41.892 20:35:13 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:29:41.892 EAL: No free 2048 kB hugepages reported on node 1 00:29:46.085 20:35:17 -- target/identify_passthru.sh@23 -- # nvme_serial_number=BTLJ72430F0E1P0FGN 00:29:46.085 20:35:17 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:5e:00.0' -i 0 00:29:46.085 20:35:17 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:29:46.085 20:35:17 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:29:46.085 EAL: No free 2048 kB hugepages reported on node 1 00:29:50.345 20:35:21 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:29:50.345 20:35:21 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:29:50.345 20:35:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:50.345 20:35:21 -- common/autotest_common.sh@10 -- # set +x 00:29:50.345 20:35:22 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:29:50.345 20:35:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:50.345 20:35:22 -- common/autotest_common.sh@10 -- # set +x 00:29:50.345 20:35:22 -- target/identify_passthru.sh@31 -- # nvmfpid=3593173 00:29:50.345 20:35:22 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:29:50.345 20:35:22 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:50.345 20:35:22 -- target/identify_passthru.sh@35 -- # waitforlisten 3593173 00:29:50.345 20:35:22 -- common/autotest_common.sh@819 -- # '[' -z 3593173 ']' 00:29:50.345 20:35:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:50.345 20:35:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:50.345 20:35:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:50.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:50.345 20:35:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:50.345 20:35:22 -- common/autotest_common.sh@10 -- # set +x 00:29:50.345 [2024-07-22 20:35:22.073880] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:29:50.345 [2024-07-22 20:35:22.073926] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:50.345 EAL: No free 2048 kB hugepages reported on node 1 00:29:50.345 [2024-07-22 20:35:22.133480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:50.345 [2024-07-22 20:35:22.210735] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:50.345 [2024-07-22 20:35:22.210839] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:50.345 [2024-07-22 20:35:22.210846] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:50.345 [2024-07-22 20:35:22.210853] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:50.345 [2024-07-22 20:35:22.210901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:50.345 [2024-07-22 20:35:22.210997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:50.345 [2024-07-22 20:35:22.211085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:50.345 [2024-07-22 20:35:22.211086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:51.282 20:35:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:51.282 20:35:22 -- common/autotest_common.sh@852 -- # return 0 00:29:51.283 20:35:22 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:29:51.283 20:35:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.283 20:35:22 -- common/autotest_common.sh@10 -- # set +x 00:29:51.283 INFO: Log level set to 20 00:29:51.283 INFO: Requests: 00:29:51.283 { 00:29:51.283 "jsonrpc": "2.0", 00:29:51.283 "method": "nvmf_set_config", 00:29:51.283 "id": 1, 00:29:51.283 "params": { 00:29:51.283 "admin_cmd_passthru": { 00:29:51.283 "identify_ctrlr": true 00:29:51.283 } 00:29:51.283 } 00:29:51.283 } 00:29:51.283 00:29:51.283 INFO: response: 00:29:51.283 { 00:29:51.283 "jsonrpc": "2.0", 00:29:51.283 "id": 1, 00:29:51.283 "result": true 00:29:51.283 } 00:29:51.283 00:29:51.283 20:35:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:51.283 20:35:22 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:29:51.283 20:35:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.283 20:35:22 -- common/autotest_common.sh@10 -- # set +x 00:29:51.283 INFO: Setting log level to 20 00:29:51.283 INFO: Setting log level to 20 00:29:51.283 INFO: Log level set to 20 00:29:51.283 INFO: Log level set to 20 00:29:51.283 INFO: Requests: 00:29:51.283 { 00:29:51.283 "jsonrpc": "2.0", 00:29:51.283 "method": "framework_start_init", 00:29:51.283 "id": 1 00:29:51.283 } 00:29:51.283 00:29:51.283 INFO: Requests: 00:29:51.283 { 00:29:51.283 "jsonrpc": "2.0", 00:29:51.283 "method": "framework_start_init", 00:29:51.283 "id": 1 00:29:51.283 } 00:29:51.283 00:29:51.283 [2024-07-22 20:35:22.970903] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:29:51.283 INFO: response: 00:29:51.283 { 00:29:51.283 "jsonrpc": "2.0", 00:29:51.283 "id": 1, 00:29:51.283 "result": true 00:29:51.283 } 00:29:51.283 00:29:51.283 INFO: response: 00:29:51.283 { 00:29:51.283 "jsonrpc": "2.0", 00:29:51.283 "id": 1, 00:29:51.283 "result": true 00:29:51.283 } 00:29:51.283 00:29:51.283 20:35:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:51.283 20:35:22 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:51.283 20:35:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.283 20:35:22 -- common/autotest_common.sh@10 -- # set +x 00:29:51.283 INFO: Setting log level to 40 00:29:51.283 INFO: Setting log level to 40 00:29:51.283 INFO: Setting log level to 40 00:29:51.283 [2024-07-22 20:35:22.984209] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:51.283 20:35:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:51.283 20:35:22 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:29:51.283 20:35:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:51.283 20:35:22 -- common/autotest_common.sh@10 -- # set +x 00:29:51.283 20:35:23 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:5e:00.0 00:29:51.283 20:35:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.283 20:35:23 -- common/autotest_common.sh@10 -- # set +x 00:29:54.568 Nvme0n1 00:29:54.568 20:35:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:54.568 20:35:25 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:29:54.568 20:35:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:54.568 20:35:25 -- common/autotest_common.sh@10 -- # set +x 00:29:54.568 20:35:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:54.568 20:35:25 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:29:54.568 20:35:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:54.568 20:35:25 -- common/autotest_common.sh@10 -- # set +x 00:29:54.568 20:35:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:54.568 20:35:25 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:54.568 20:35:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:54.568 20:35:25 -- common/autotest_common.sh@10 -- # set +x 00:29:54.568 [2024-07-22 20:35:25.888305] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:54.568 20:35:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:54.568 20:35:25 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:29:54.568 20:35:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:54.568 20:35:25 -- common/autotest_common.sh@10 -- # set +x 00:29:54.568 [2024-07-22 20:35:25.900126] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:29:54.568 [ 00:29:54.568 { 00:29:54.568 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:29:54.568 "subtype": "Discovery", 00:29:54.568 "listen_addresses": [], 00:29:54.568 "allow_any_host": true, 00:29:54.568 "hosts": [] 00:29:54.568 }, 00:29:54.568 { 00:29:54.568 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:29:54.568 "subtype": "NVMe", 00:29:54.568 "listen_addresses": [ 00:29:54.568 { 00:29:54.568 "transport": "TCP", 00:29:54.568 "trtype": "TCP", 00:29:54.568 "adrfam": "IPv4", 00:29:54.568 "traddr": "10.0.0.2", 00:29:54.568 "trsvcid": "4420" 00:29:54.568 } 00:29:54.568 ], 00:29:54.568 "allow_any_host": true, 00:29:54.568 "hosts": [], 00:29:54.568 "serial_number": "SPDK00000000000001", 00:29:54.568 "model_number": "SPDK bdev Controller", 00:29:54.568 "max_namespaces": 1, 00:29:54.568 "min_cntlid": 1, 00:29:54.568 "max_cntlid": 65519, 00:29:54.568 "namespaces": [ 00:29:54.568 { 00:29:54.568 "nsid": 1, 00:29:54.568 "bdev_name": "Nvme0n1", 00:29:54.568 "name": "Nvme0n1", 00:29:54.568 "nguid": "8F7DC707623C4E1CBE372E10F739E479", 00:29:54.568 "uuid": "8f7dc707-623c-4e1c-be37-2e10f739e479" 00:29:54.568 } 00:29:54.568 ] 00:29:54.568 } 00:29:54.568 ] 00:29:54.568 20:35:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:54.568 20:35:25 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:29:54.568 20:35:25 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:29:54.568 20:35:25 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:29:54.568 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.568 20:35:26 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=BTLJ72430F0E1P0FGN 00:29:54.568 20:35:26 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:29:54.568 20:35:26 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:29:54.568 20:35:26 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:29:54.568 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.568 20:35:26 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:29:54.568 20:35:26 -- target/identify_passthru.sh@63 -- # '[' BTLJ72430F0E1P0FGN '!=' BTLJ72430F0E1P0FGN ']' 00:29:54.568 20:35:26 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:29:54.568 20:35:26 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:54.568 20:35:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:54.568 20:35:26 -- common/autotest_common.sh@10 -- # set +x 00:29:54.568 20:35:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:54.568 20:35:26 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:29:54.568 20:35:26 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:29:54.568 20:35:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:54.568 20:35:26 -- nvmf/common.sh@116 -- # sync 00:29:54.568 20:35:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:54.568 20:35:26 -- nvmf/common.sh@119 -- # set +e 00:29:54.568 20:35:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:54.568 20:35:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:54.568 rmmod nvme_tcp 00:29:54.568 rmmod nvme_fabrics 00:29:54.568 rmmod nvme_keyring 00:29:54.568 20:35:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:54.568 20:35:26 -- nvmf/common.sh@123 -- # set -e 00:29:54.568 20:35:26 -- nvmf/common.sh@124 -- # return 0 00:29:54.568 20:35:26 -- nvmf/common.sh@477 -- # '[' -n 3593173 ']' 00:29:54.568 20:35:26 -- nvmf/common.sh@478 -- # killprocess 3593173 00:29:54.568 20:35:26 -- common/autotest_common.sh@926 -- # '[' -z 3593173 ']' 00:29:54.568 20:35:26 -- common/autotest_common.sh@930 -- # kill -0 3593173 00:29:54.568 20:35:26 -- common/autotest_common.sh@931 -- # uname 00:29:54.568 20:35:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:54.568 20:35:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3593173 00:29:54.568 20:35:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:54.568 20:35:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:54.568 20:35:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3593173' 00:29:54.568 killing process with pid 3593173 00:29:54.568 20:35:26 -- common/autotest_common.sh@945 -- # kill 3593173 00:29:54.568 [2024-07-22 20:35:26.419677] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:29:54.568 20:35:26 -- common/autotest_common.sh@950 -- # wait 3593173 00:29:56.473 20:35:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:56.473 20:35:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:56.473 20:35:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:56.473 20:35:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:56.473 20:35:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:56.473 20:35:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:56.473 20:35:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:56.473 20:35:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:58.376 20:35:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:58.376 00:29:58.376 real 0m21.740s 00:29:58.376 user 0m30.076s 00:29:58.376 sys 0m4.738s 00:29:58.376 20:35:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:58.376 20:35:29 -- common/autotest_common.sh@10 -- # set +x 00:29:58.376 ************************************ 00:29:58.376 END TEST nvmf_identify_passthru 00:29:58.376 ************************************ 00:29:58.376 20:35:30 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:29:58.376 20:35:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:58.376 20:35:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:58.376 20:35:30 -- common/autotest_common.sh@10 -- # set +x 00:29:58.376 ************************************ 00:29:58.376 START TEST nvmf_dif 00:29:58.376 ************************************ 00:29:58.376 20:35:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:29:58.376 * Looking for test storage... 00:29:58.376 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:58.376 20:35:30 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:58.376 20:35:30 -- nvmf/common.sh@7 -- # uname -s 00:29:58.376 20:35:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:58.376 20:35:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:58.376 20:35:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:58.376 20:35:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:58.376 20:35:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:58.376 20:35:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:58.376 20:35:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:58.376 20:35:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:58.376 20:35:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:58.376 20:35:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:58.376 20:35:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:29:58.376 20:35:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:29:58.376 20:35:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:58.376 20:35:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:58.376 20:35:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:58.376 20:35:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:58.376 20:35:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:58.376 20:35:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:58.376 20:35:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:58.376 20:35:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:58.376 20:35:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:58.376 20:35:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:58.376 20:35:30 -- paths/export.sh@5 -- # export PATH 00:29:58.376 20:35:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:58.376 20:35:30 -- nvmf/common.sh@46 -- # : 0 00:29:58.376 20:35:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:58.376 20:35:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:58.376 20:35:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:58.376 20:35:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:58.376 20:35:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:58.376 20:35:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:58.376 20:35:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:58.376 20:35:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:58.376 20:35:30 -- target/dif.sh@15 -- # NULL_META=16 00:29:58.376 20:35:30 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:29:58.376 20:35:30 -- target/dif.sh@15 -- # NULL_SIZE=64 00:29:58.376 20:35:30 -- target/dif.sh@15 -- # NULL_DIF=1 00:29:58.376 20:35:30 -- target/dif.sh@135 -- # nvmftestinit 00:29:58.376 20:35:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:58.376 20:35:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:58.376 20:35:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:58.376 20:35:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:58.376 20:35:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:58.376 20:35:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:58.376 20:35:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:58.376 20:35:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:58.376 20:35:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:58.376 20:35:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:58.376 20:35:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:58.376 20:35:30 -- common/autotest_common.sh@10 -- # set +x 00:30:03.644 20:35:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:03.644 20:35:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:03.644 20:35:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:03.644 20:35:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:03.644 20:35:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:03.644 20:35:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:03.644 20:35:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:03.644 20:35:34 -- nvmf/common.sh@294 -- # net_devs=() 00:30:03.644 20:35:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:03.644 20:35:34 -- nvmf/common.sh@295 -- # e810=() 00:30:03.644 20:35:34 -- nvmf/common.sh@295 -- # local -ga e810 00:30:03.644 20:35:34 -- nvmf/common.sh@296 -- # x722=() 00:30:03.644 20:35:34 -- nvmf/common.sh@296 -- # local -ga x722 00:30:03.644 20:35:34 -- nvmf/common.sh@297 -- # mlx=() 00:30:03.644 20:35:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:03.644 20:35:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:03.644 20:35:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:03.644 20:35:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:03.644 20:35:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:03.644 20:35:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:03.644 20:35:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:30:03.644 Found 0000:86:00.0 (0x8086 - 0x159b) 00:30:03.644 20:35:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:03.644 20:35:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:30:03.644 Found 0000:86:00.1 (0x8086 - 0x159b) 00:30:03.644 20:35:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:03.644 20:35:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:03.644 20:35:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:03.644 20:35:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:03.644 20:35:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:03.644 20:35:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:30:03.644 Found net devices under 0000:86:00.0: cvl_0_0 00:30:03.644 20:35:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:03.644 20:35:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:03.644 20:35:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:03.644 20:35:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:03.644 20:35:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:03.644 20:35:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:30:03.644 Found net devices under 0000:86:00.1: cvl_0_1 00:30:03.644 20:35:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:03.644 20:35:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:03.644 20:35:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:03.644 20:35:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:03.644 20:35:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:03.644 20:35:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:03.644 20:35:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:03.644 20:35:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:03.644 20:35:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:03.644 20:35:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:03.644 20:35:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:03.644 20:35:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:03.644 20:35:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:03.644 20:35:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:03.644 20:35:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:03.644 20:35:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:03.644 20:35:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:03.644 20:35:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:03.644 20:35:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:03.644 20:35:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:03.644 20:35:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:03.644 20:35:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:03.644 20:35:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:03.644 20:35:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:03.644 20:35:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:03.644 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:03.644 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:30:03.644 00:30:03.644 --- 10.0.0.2 ping statistics --- 00:30:03.644 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:03.644 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:30:03.644 20:35:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:03.644 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:03.644 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.252 ms 00:30:03.644 00:30:03.644 --- 10.0.0.1 ping statistics --- 00:30:03.644 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:03.644 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:30:03.644 20:35:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:03.644 20:35:35 -- nvmf/common.sh@410 -- # return 0 00:30:03.644 20:35:35 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:30:03.644 20:35:35 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:30:06.182 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:30:06.182 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:30:06.182 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:30:06.182 20:35:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:06.182 20:35:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:06.183 20:35:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:06.183 20:35:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:06.183 20:35:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:06.183 20:35:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:06.183 20:35:37 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:30:06.183 20:35:37 -- target/dif.sh@137 -- # nvmfappstart 00:30:06.183 20:35:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:06.183 20:35:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:06.183 20:35:37 -- common/autotest_common.sh@10 -- # set +x 00:30:06.183 20:35:37 -- nvmf/common.sh@469 -- # nvmfpid=3598686 00:30:06.183 20:35:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:30:06.183 20:35:37 -- nvmf/common.sh@470 -- # waitforlisten 3598686 00:30:06.183 20:35:37 -- common/autotest_common.sh@819 -- # '[' -z 3598686 ']' 00:30:06.183 20:35:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:06.183 20:35:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:06.183 20:35:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:06.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:06.183 20:35:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:06.183 20:35:37 -- common/autotest_common.sh@10 -- # set +x 00:30:06.183 [2024-07-22 20:35:37.708189] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:30:06.183 [2024-07-22 20:35:37.708227] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:06.183 EAL: No free 2048 kB hugepages reported on node 1 00:30:06.183 [2024-07-22 20:35:37.764326] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:06.183 [2024-07-22 20:35:37.840955] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:06.183 [2024-07-22 20:35:37.841066] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:06.183 [2024-07-22 20:35:37.841074] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:06.183 [2024-07-22 20:35:37.841080] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:06.183 [2024-07-22 20:35:37.841094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:06.752 20:35:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:06.752 20:35:38 -- common/autotest_common.sh@852 -- # return 0 00:30:06.752 20:35:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:06.752 20:35:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:06.752 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:30:06.752 20:35:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:06.752 20:35:38 -- target/dif.sh@139 -- # create_transport 00:30:06.752 20:35:38 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:30:06.752 20:35:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.752 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:30:06.752 [2024-07-22 20:35:38.551168] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:06.752 20:35:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.752 20:35:38 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:30:06.752 20:35:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:06.752 20:35:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:06.752 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:30:06.752 ************************************ 00:30:06.752 START TEST fio_dif_1_default 00:30:06.752 ************************************ 00:30:06.752 20:35:38 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:30:06.752 20:35:38 -- target/dif.sh@86 -- # create_subsystems 0 00:30:06.752 20:35:38 -- target/dif.sh@28 -- # local sub 00:30:06.752 20:35:38 -- target/dif.sh@30 -- # for sub in "$@" 00:30:06.752 20:35:38 -- target/dif.sh@31 -- # create_subsystem 0 00:30:06.752 20:35:38 -- target/dif.sh@18 -- # local sub_id=0 00:30:06.752 20:35:38 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:30:06.752 20:35:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.752 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:30:06.752 bdev_null0 00:30:06.752 20:35:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.752 20:35:38 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:06.752 20:35:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.752 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:30:06.752 20:35:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.752 20:35:38 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:06.752 20:35:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.752 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:30:06.752 20:35:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.752 20:35:38 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:06.752 20:35:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.752 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:30:06.752 [2024-07-22 20:35:38.595396] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:06.752 20:35:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.752 20:35:38 -- target/dif.sh@87 -- # fio /dev/fd/62 00:30:06.752 20:35:38 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:30:06.752 20:35:38 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:30:06.752 20:35:38 -- nvmf/common.sh@520 -- # config=() 00:30:06.752 20:35:38 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:06.752 20:35:38 -- nvmf/common.sh@520 -- # local subsystem config 00:30:06.752 20:35:38 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:06.752 20:35:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:06.752 20:35:38 -- target/dif.sh@82 -- # gen_fio_conf 00:30:06.752 20:35:38 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:30:06.752 20:35:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:06.752 { 00:30:06.752 "params": { 00:30:06.752 "name": "Nvme$subsystem", 00:30:06.752 "trtype": "$TEST_TRANSPORT", 00:30:06.752 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:06.752 "adrfam": "ipv4", 00:30:06.752 "trsvcid": "$NVMF_PORT", 00:30:06.752 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:06.752 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:06.752 "hdgst": ${hdgst:-false}, 00:30:06.752 "ddgst": ${ddgst:-false} 00:30:06.752 }, 00:30:06.752 "method": "bdev_nvme_attach_controller" 00:30:06.752 } 00:30:06.752 EOF 00:30:06.752 )") 00:30:06.752 20:35:38 -- target/dif.sh@54 -- # local file 00:30:06.752 20:35:38 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:06.752 20:35:38 -- target/dif.sh@56 -- # cat 00:30:06.752 20:35:38 -- common/autotest_common.sh@1318 -- # local sanitizers 00:30:06.752 20:35:38 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:06.752 20:35:38 -- common/autotest_common.sh@1320 -- # shift 00:30:06.752 20:35:38 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:30:06.752 20:35:38 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:06.752 20:35:38 -- nvmf/common.sh@542 -- # cat 00:30:06.752 20:35:38 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:06.752 20:35:38 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:06.752 20:35:38 -- common/autotest_common.sh@1324 -- # grep libasan 00:30:06.752 20:35:38 -- target/dif.sh@72 -- # (( file <= files )) 00:30:06.752 20:35:38 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:06.752 20:35:38 -- nvmf/common.sh@544 -- # jq . 00:30:06.752 20:35:38 -- nvmf/common.sh@545 -- # IFS=, 00:30:06.752 20:35:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:06.752 "params": { 00:30:06.752 "name": "Nvme0", 00:30:06.752 "trtype": "tcp", 00:30:06.752 "traddr": "10.0.0.2", 00:30:06.752 "adrfam": "ipv4", 00:30:06.752 "trsvcid": "4420", 00:30:06.752 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:06.752 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:06.752 "hdgst": false, 00:30:06.752 "ddgst": false 00:30:06.752 }, 00:30:06.752 "method": "bdev_nvme_attach_controller" 00:30:06.752 }' 00:30:06.752 20:35:38 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:06.752 20:35:38 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:06.752 20:35:38 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:06.752 20:35:38 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:06.752 20:35:38 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:30:06.752 20:35:38 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:06.752 20:35:38 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:06.752 20:35:38 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:06.752 20:35:38 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:06.752 20:35:38 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:07.010 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:30:07.010 fio-3.35 00:30:07.010 Starting 1 thread 00:30:07.268 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.526 [2024-07-22 20:35:39.359870] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:07.526 [2024-07-22 20:35:39.359914] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:30:19.788 00:30:19.788 filename0: (groupid=0, jobs=1): err= 0: pid=3599073: Mon Jul 22 20:35:49 2024 00:30:19.788 read: IOPS=185, BW=741KiB/s (759kB/s)(7440KiB/10037msec) 00:30:19.788 slat (nsec): min=4052, max=44293, avg=6143.46, stdev=1132.43 00:30:19.788 clat (usec): min=655, max=46460, avg=21566.88, stdev=20209.81 00:30:19.788 lat (usec): min=661, max=46479, avg=21573.03, stdev=20209.73 00:30:19.788 clat percentiles (usec): 00:30:19.788 | 1.00th=[ 1254], 5.00th=[ 1270], 10.00th=[ 1270], 20.00th=[ 1287], 00:30:19.788 | 30.00th=[ 1287], 40.00th=[ 1385], 50.00th=[41157], 60.00th=[41681], 00:30:19.788 | 70.00th=[41681], 80.00th=[41681], 90.00th=[41681], 95.00th=[41681], 00:30:19.788 | 99.00th=[42730], 99.50th=[42730], 99.90th=[46400], 99.95th=[46400], 00:30:19.788 | 99.99th=[46400] 00:30:19.788 bw ( KiB/s): min= 704, max= 768, per=100.00%, avg=742.40, stdev=30.45, samples=20 00:30:19.788 iops : min= 176, max= 192, avg=185.60, stdev= 7.61, samples=20 00:30:19.788 lat (usec) : 750=0.22% 00:30:19.788 lat (msec) : 2=49.46%, 4=0.22%, 50=50.11% 00:30:19.788 cpu : usr=95.25%, sys=4.50%, ctx=12, majf=0, minf=273 00:30:19.788 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:19.788 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:19.788 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:19.788 issued rwts: total=1860,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:19.788 latency : target=0, window=0, percentile=100.00%, depth=4 00:30:19.788 00:30:19.788 Run status group 0 (all jobs): 00:30:19.788 READ: bw=741KiB/s (759kB/s), 741KiB/s-741KiB/s (759kB/s-759kB/s), io=7440KiB (7619kB), run=10037-10037msec 00:30:19.788 20:35:49 -- target/dif.sh@88 -- # destroy_subsystems 0 00:30:19.788 20:35:49 -- target/dif.sh@43 -- # local sub 00:30:19.788 20:35:49 -- target/dif.sh@45 -- # for sub in "$@" 00:30:19.788 20:35:49 -- target/dif.sh@46 -- # destroy_subsystem 0 00:30:19.788 20:35:49 -- target/dif.sh@36 -- # local sub_id=0 00:30:19.788 20:35:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 00:30:19.788 real 0m11.147s 00:30:19.788 user 0m16.303s 00:30:19.788 sys 0m0.782s 00:30:19.788 20:35:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 ************************************ 00:30:19.788 END TEST fio_dif_1_default 00:30:19.788 ************************************ 00:30:19.788 20:35:49 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:30:19.788 20:35:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:19.788 20:35:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 ************************************ 00:30:19.788 START TEST fio_dif_1_multi_subsystems 00:30:19.788 ************************************ 00:30:19.788 20:35:49 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:30:19.788 20:35:49 -- target/dif.sh@92 -- # local files=1 00:30:19.788 20:35:49 -- target/dif.sh@94 -- # create_subsystems 0 1 00:30:19.788 20:35:49 -- target/dif.sh@28 -- # local sub 00:30:19.788 20:35:49 -- target/dif.sh@30 -- # for sub in "$@" 00:30:19.788 20:35:49 -- target/dif.sh@31 -- # create_subsystem 0 00:30:19.788 20:35:49 -- target/dif.sh@18 -- # local sub_id=0 00:30:19.788 20:35:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 bdev_null0 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 [2024-07-22 20:35:49.773409] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@30 -- # for sub in "$@" 00:30:19.788 20:35:49 -- target/dif.sh@31 -- # create_subsystem 1 00:30:19.788 20:35:49 -- target/dif.sh@18 -- # local sub_id=1 00:30:19.788 20:35:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 bdev_null1 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:19.788 20:35:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.788 20:35:49 -- common/autotest_common.sh@10 -- # set +x 00:30:19.788 20:35:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.788 20:35:49 -- target/dif.sh@95 -- # fio /dev/fd/62 00:30:19.788 20:35:49 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:30:19.788 20:35:49 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:19.788 20:35:49 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:30:19.788 20:35:49 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:19.788 20:35:49 -- nvmf/common.sh@520 -- # config=() 00:30:19.788 20:35:49 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:30:19.788 20:35:49 -- nvmf/common.sh@520 -- # local subsystem config 00:30:19.788 20:35:49 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:19.788 20:35:49 -- common/autotest_common.sh@1318 -- # local sanitizers 00:30:19.788 20:35:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:19.788 20:35:49 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:19.788 20:35:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:19.788 { 00:30:19.788 "params": { 00:30:19.788 "name": "Nvme$subsystem", 00:30:19.788 "trtype": "$TEST_TRANSPORT", 00:30:19.788 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:19.788 "adrfam": "ipv4", 00:30:19.788 "trsvcid": "$NVMF_PORT", 00:30:19.788 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:19.788 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:19.788 "hdgst": ${hdgst:-false}, 00:30:19.788 "ddgst": ${ddgst:-false} 00:30:19.788 }, 00:30:19.788 "method": "bdev_nvme_attach_controller" 00:30:19.788 } 00:30:19.788 EOF 00:30:19.788 )") 00:30:19.788 20:35:49 -- common/autotest_common.sh@1320 -- # shift 00:30:19.788 20:35:49 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:30:19.788 20:35:49 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:19.788 20:35:49 -- target/dif.sh@82 -- # gen_fio_conf 00:30:19.788 20:35:49 -- target/dif.sh@54 -- # local file 00:30:19.788 20:35:49 -- target/dif.sh@56 -- # cat 00:30:19.788 20:35:49 -- nvmf/common.sh@542 -- # cat 00:30:19.788 20:35:49 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:19.788 20:35:49 -- common/autotest_common.sh@1324 -- # grep libasan 00:30:19.788 20:35:49 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:19.788 20:35:49 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:19.788 20:35:49 -- target/dif.sh@72 -- # (( file <= files )) 00:30:19.788 20:35:49 -- target/dif.sh@73 -- # cat 00:30:19.788 20:35:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:19.788 20:35:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:19.788 { 00:30:19.788 "params": { 00:30:19.788 "name": "Nvme$subsystem", 00:30:19.788 "trtype": "$TEST_TRANSPORT", 00:30:19.788 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:19.788 "adrfam": "ipv4", 00:30:19.788 "trsvcid": "$NVMF_PORT", 00:30:19.788 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:19.788 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:19.788 "hdgst": ${hdgst:-false}, 00:30:19.788 "ddgst": ${ddgst:-false} 00:30:19.788 }, 00:30:19.788 "method": "bdev_nvme_attach_controller" 00:30:19.788 } 00:30:19.788 EOF 00:30:19.788 )") 00:30:19.788 20:35:49 -- nvmf/common.sh@542 -- # cat 00:30:19.788 20:35:49 -- target/dif.sh@72 -- # (( file++ )) 00:30:19.788 20:35:49 -- target/dif.sh@72 -- # (( file <= files )) 00:30:19.788 20:35:49 -- nvmf/common.sh@544 -- # jq . 00:30:19.788 20:35:49 -- nvmf/common.sh@545 -- # IFS=, 00:30:19.788 20:35:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:19.788 "params": { 00:30:19.788 "name": "Nvme0", 00:30:19.788 "trtype": "tcp", 00:30:19.788 "traddr": "10.0.0.2", 00:30:19.788 "adrfam": "ipv4", 00:30:19.788 "trsvcid": "4420", 00:30:19.788 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:19.788 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:19.788 "hdgst": false, 00:30:19.788 "ddgst": false 00:30:19.788 }, 00:30:19.788 "method": "bdev_nvme_attach_controller" 00:30:19.788 },{ 00:30:19.788 "params": { 00:30:19.788 "name": "Nvme1", 00:30:19.788 "trtype": "tcp", 00:30:19.788 "traddr": "10.0.0.2", 00:30:19.788 "adrfam": "ipv4", 00:30:19.788 "trsvcid": "4420", 00:30:19.788 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:19.788 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:19.788 "hdgst": false, 00:30:19.788 "ddgst": false 00:30:19.788 }, 00:30:19.788 "method": "bdev_nvme_attach_controller" 00:30:19.788 }' 00:30:19.788 20:35:49 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:19.788 20:35:49 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:19.788 20:35:49 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:19.788 20:35:49 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:19.788 20:35:49 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:30:19.788 20:35:49 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:19.788 20:35:49 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:19.788 20:35:49 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:19.788 20:35:49 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:19.788 20:35:49 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:19.788 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:30:19.788 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:30:19.788 fio-3.35 00:30:19.788 Starting 2 threads 00:30:19.788 EAL: No free 2048 kB hugepages reported on node 1 00:30:19.789 [2024-07-22 20:35:50.797864] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:19.789 [2024-07-22 20:35:50.797915] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:30:29.761 00:30:29.761 filename0: (groupid=0, jobs=1): err= 0: pid=3601071: Mon Jul 22 20:36:00 2024 00:30:29.761 read: IOPS=95, BW=380KiB/s (390kB/s)(3808KiB/10010msec) 00:30:29.761 slat (nsec): min=5930, max=24754, avg=7550.08, stdev=2262.16 00:30:29.761 clat (usec): min=41023, max=44804, avg=42036.15, stdev=296.13 00:30:29.761 lat (usec): min=41029, max=44829, avg=42043.70, stdev=296.40 00:30:29.761 clat percentiles (usec): 00:30:29.761 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[41681], 00:30:29.761 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:30:29.761 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42730], 00:30:29.761 | 99.00th=[43254], 99.50th=[43254], 99.90th=[44827], 99.95th=[44827], 00:30:29.761 | 99.99th=[44827] 00:30:29.761 bw ( KiB/s): min= 352, max= 384, per=33.83%, avg=379.20, stdev=11.72, samples=20 00:30:29.761 iops : min= 88, max= 96, avg=94.80, stdev= 2.93, samples=20 00:30:29.761 lat (msec) : 50=100.00% 00:30:29.761 cpu : usr=97.86%, sys=1.88%, ctx=4, majf=0, minf=156 00:30:29.761 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:29.761 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:29.761 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:29.761 issued rwts: total=952,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:29.761 latency : target=0, window=0, percentile=100.00%, depth=4 00:30:29.761 filename1: (groupid=0, jobs=1): err= 0: pid=3601072: Mon Jul 22 20:36:00 2024 00:30:29.761 read: IOPS=185, BW=741KiB/s (759kB/s)(7440KiB/10041msec) 00:30:29.761 slat (nsec): min=5937, max=25709, avg=7045.90, stdev=1822.53 00:30:29.761 clat (usec): min=1259, max=44369, avg=21572.30, stdev=20151.36 00:30:29.761 lat (usec): min=1266, max=44394, avg=21579.35, stdev=20150.82 00:30:29.761 clat percentiles (usec): 00:30:29.761 | 1.00th=[ 1287], 5.00th=[ 1303], 10.00th=[ 1319], 20.00th=[ 1369], 00:30:29.761 | 30.00th=[ 1385], 40.00th=[ 1418], 50.00th=[41681], 60.00th=[41681], 00:30:29.761 | 70.00th=[41681], 80.00th=[41681], 90.00th=[41681], 95.00th=[41681], 00:30:29.761 | 99.00th=[42730], 99.50th=[42730], 99.90th=[44303], 99.95th=[44303], 00:30:29.761 | 99.99th=[44303] 00:30:29.761 bw ( KiB/s): min= 704, max= 768, per=66.24%, avg=742.40, stdev=30.45, samples=20 00:30:29.761 iops : min= 176, max= 192, avg=185.60, stdev= 7.61, samples=20 00:30:29.761 lat (msec) : 2=49.89%, 50=50.11% 00:30:29.761 cpu : usr=98.21%, sys=1.52%, ctx=5, majf=0, minf=126 00:30:29.761 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:29.761 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:29.761 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:29.761 issued rwts: total=1860,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:29.761 latency : target=0, window=0, percentile=100.00%, depth=4 00:30:29.761 00:30:29.761 Run status group 0 (all jobs): 00:30:29.761 READ: bw=1120KiB/s (1147kB/s), 380KiB/s-741KiB/s (390kB/s-759kB/s), io=11.0MiB (11.5MB), run=10010-10041msec 00:30:29.761 20:36:01 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:30:29.761 20:36:01 -- target/dif.sh@43 -- # local sub 00:30:29.761 20:36:01 -- target/dif.sh@45 -- # for sub in "$@" 00:30:29.761 20:36:01 -- target/dif.sh@46 -- # destroy_subsystem 0 00:30:29.761 20:36:01 -- target/dif.sh@36 -- # local sub_id=0 00:30:29.761 20:36:01 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:30:29.761 20:36:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.761 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.761 20:36:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:29.762 20:36:01 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:30:29.762 20:36:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 20:36:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:29.762 20:36:01 -- target/dif.sh@45 -- # for sub in "$@" 00:30:29.762 20:36:01 -- target/dif.sh@46 -- # destroy_subsystem 1 00:30:29.762 20:36:01 -- target/dif.sh@36 -- # local sub_id=1 00:30:29.762 20:36:01 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:29.762 20:36:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 20:36:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:29.762 20:36:01 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:30:29.762 20:36:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 20:36:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:29.762 00:30:29.762 real 0m11.430s 00:30:29.762 user 0m26.193s 00:30:29.762 sys 0m0.644s 00:30:29.762 20:36:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 ************************************ 00:30:29.762 END TEST fio_dif_1_multi_subsystems 00:30:29.762 ************************************ 00:30:29.762 20:36:01 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:30:29.762 20:36:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:29.762 20:36:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 ************************************ 00:30:29.762 START TEST fio_dif_rand_params 00:30:29.762 ************************************ 00:30:29.762 20:36:01 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:30:29.762 20:36:01 -- target/dif.sh@100 -- # local NULL_DIF 00:30:29.762 20:36:01 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:30:29.762 20:36:01 -- target/dif.sh@103 -- # NULL_DIF=3 00:30:29.762 20:36:01 -- target/dif.sh@103 -- # bs=128k 00:30:29.762 20:36:01 -- target/dif.sh@103 -- # numjobs=3 00:30:29.762 20:36:01 -- target/dif.sh@103 -- # iodepth=3 00:30:29.762 20:36:01 -- target/dif.sh@103 -- # runtime=5 00:30:29.762 20:36:01 -- target/dif.sh@105 -- # create_subsystems 0 00:30:29.762 20:36:01 -- target/dif.sh@28 -- # local sub 00:30:29.762 20:36:01 -- target/dif.sh@30 -- # for sub in "$@" 00:30:29.762 20:36:01 -- target/dif.sh@31 -- # create_subsystem 0 00:30:29.762 20:36:01 -- target/dif.sh@18 -- # local sub_id=0 00:30:29.762 20:36:01 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:30:29.762 20:36:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 bdev_null0 00:30:29.762 20:36:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:29.762 20:36:01 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:29.762 20:36:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 20:36:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:29.762 20:36:01 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:29.762 20:36:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 20:36:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:29.762 20:36:01 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:29.762 20:36:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:29.762 20:36:01 -- common/autotest_common.sh@10 -- # set +x 00:30:29.762 [2024-07-22 20:36:01.245586] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:29.762 20:36:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:29.762 20:36:01 -- target/dif.sh@106 -- # fio /dev/fd/62 00:30:29.762 20:36:01 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:30:29.762 20:36:01 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:30:29.762 20:36:01 -- nvmf/common.sh@520 -- # config=() 00:30:29.762 20:36:01 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:29.762 20:36:01 -- nvmf/common.sh@520 -- # local subsystem config 00:30:29.762 20:36:01 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:29.762 20:36:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:29.762 20:36:01 -- target/dif.sh@82 -- # gen_fio_conf 00:30:29.762 20:36:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:29.762 { 00:30:29.762 "params": { 00:30:29.762 "name": "Nvme$subsystem", 00:30:29.762 "trtype": "$TEST_TRANSPORT", 00:30:29.762 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:29.762 "adrfam": "ipv4", 00:30:29.762 "trsvcid": "$NVMF_PORT", 00:30:29.762 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:29.762 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:29.762 "hdgst": ${hdgst:-false}, 00:30:29.762 "ddgst": ${ddgst:-false} 00:30:29.762 }, 00:30:29.762 "method": "bdev_nvme_attach_controller" 00:30:29.762 } 00:30:29.762 EOF 00:30:29.762 )") 00:30:29.762 20:36:01 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:30:29.762 20:36:01 -- target/dif.sh@54 -- # local file 00:30:29.762 20:36:01 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:29.762 20:36:01 -- target/dif.sh@56 -- # cat 00:30:29.762 20:36:01 -- common/autotest_common.sh@1318 -- # local sanitizers 00:30:29.762 20:36:01 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:29.762 20:36:01 -- common/autotest_common.sh@1320 -- # shift 00:30:29.762 20:36:01 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:30:29.762 20:36:01 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:29.762 20:36:01 -- nvmf/common.sh@542 -- # cat 00:30:29.762 20:36:01 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:29.762 20:36:01 -- target/dif.sh@72 -- # (( file <= files )) 00:30:29.762 20:36:01 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:29.762 20:36:01 -- common/autotest_common.sh@1324 -- # grep libasan 00:30:29.762 20:36:01 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:29.762 20:36:01 -- nvmf/common.sh@544 -- # jq . 00:30:29.762 20:36:01 -- nvmf/common.sh@545 -- # IFS=, 00:30:29.762 20:36:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:29.762 "params": { 00:30:29.762 "name": "Nvme0", 00:30:29.762 "trtype": "tcp", 00:30:29.762 "traddr": "10.0.0.2", 00:30:29.762 "adrfam": "ipv4", 00:30:29.762 "trsvcid": "4420", 00:30:29.762 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:29.762 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:29.762 "hdgst": false, 00:30:29.762 "ddgst": false 00:30:29.762 }, 00:30:29.762 "method": "bdev_nvme_attach_controller" 00:30:29.762 }' 00:30:29.762 20:36:01 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:29.762 20:36:01 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:29.762 20:36:01 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:29.762 20:36:01 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:29.762 20:36:01 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:30:29.762 20:36:01 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:29.762 20:36:01 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:29.762 20:36:01 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:29.762 20:36:01 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:29.762 20:36:01 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:29.762 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:30:29.762 ... 00:30:29.762 fio-3.35 00:30:29.762 Starting 3 threads 00:30:29.762 EAL: No free 2048 kB hugepages reported on node 1 00:30:30.329 [2024-07-22 20:36:02.116002] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:30.329 [2024-07-22 20:36:02.116048] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:30:35.597 00:30:35.597 filename0: (groupid=0, jobs=1): err= 0: pid=3603201: Mon Jul 22 20:36:07 2024 00:30:35.597 read: IOPS=249, BW=31.2MiB/s (32.8MB/s)(156MiB/5006msec) 00:30:35.597 slat (nsec): min=4525, max=16806, avg=9406.42, stdev=2446.71 00:30:35.597 clat (usec): min=4228, max=94601, avg=11987.27, stdev=12490.88 00:30:35.597 lat (usec): min=4235, max=94613, avg=11996.68, stdev=12491.09 00:30:35.597 clat percentiles (usec): 00:30:35.597 | 1.00th=[ 4686], 5.00th=[ 5145], 10.00th=[ 5669], 20.00th=[ 6325], 00:30:35.597 | 30.00th=[ 6980], 40.00th=[ 7635], 50.00th=[ 8291], 60.00th=[ 9110], 00:30:35.597 | 70.00th=[ 9765], 80.00th=[10552], 90.00th=[13042], 95.00th=[51119], 00:30:35.597 | 99.00th=[53740], 99.50th=[54264], 99.90th=[56361], 99.95th=[94897], 00:30:35.597 | 99.99th=[94897] 00:30:35.597 bw ( KiB/s): min=21504, max=51456, per=33.00%, avg=31974.40, stdev=9044.09, samples=10 00:30:35.597 iops : min= 168, max= 402, avg=249.80, stdev=70.66, samples=10 00:30:35.597 lat (msec) : 10=72.66%, 20=18.47%, 50=3.04%, 100=5.84% 00:30:35.597 cpu : usr=95.40%, sys=4.12%, ctx=15, majf=0, minf=17 00:30:35.597 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:35.597 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:35.597 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:35.597 issued rwts: total=1251,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:35.597 latency : target=0, window=0, percentile=100.00%, depth=3 00:30:35.598 filename0: (groupid=0, jobs=1): err= 0: pid=3603202: Mon Jul 22 20:36:07 2024 00:30:35.598 read: IOPS=257, BW=32.1MiB/s (33.7MB/s)(161MiB/5004msec) 00:30:35.598 slat (nsec): min=2972, max=44409, avg=9245.30, stdev=2771.71 00:30:35.598 clat (usec): min=4419, max=95147, avg=11648.75, stdev=12374.85 00:30:35.598 lat (usec): min=4425, max=95158, avg=11657.99, stdev=12375.08 00:30:35.598 clat percentiles (usec): 00:30:35.598 | 1.00th=[ 5014], 5.00th=[ 5473], 10.00th=[ 5735], 20.00th=[ 6456], 00:30:35.598 | 30.00th=[ 6980], 40.00th=[ 7373], 50.00th=[ 7898], 60.00th=[ 8455], 00:30:35.598 | 70.00th=[ 9634], 80.00th=[10683], 90.00th=[12911], 95.00th=[49546], 00:30:35.598 | 99.00th=[54264], 99.50th=[54789], 99.90th=[93848], 99.95th=[94897], 00:30:35.598 | 99.99th=[94897] 00:30:35.598 bw ( KiB/s): min=23296, max=47616, per=34.20%, avg=33137.78, stdev=8933.55, samples=9 00:30:35.598 iops : min= 182, max= 372, avg=258.89, stdev=69.79, samples=9 00:30:35.598 lat (msec) : 10=74.36%, 20=17.79%, 50=3.42%, 100=4.43% 00:30:35.598 cpu : usr=94.62%, sys=4.84%, ctx=9, majf=0, minf=108 00:30:35.598 IO depths : 1=2.1%, 2=97.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:35.598 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:35.598 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:35.598 issued rwts: total=1287,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:35.598 latency : target=0, window=0, percentile=100.00%, depth=3 00:30:35.598 filename0: (groupid=0, jobs=1): err= 0: pid=3603203: Mon Jul 22 20:36:07 2024 00:30:35.598 read: IOPS=250, BW=31.3MiB/s (32.8MB/s)(157MiB/5009msec) 00:30:35.598 slat (nsec): min=4155, max=15041, avg=9112.85, stdev=2369.87 00:30:35.598 clat (usec): min=4132, max=96884, avg=11968.98, stdev=13383.53 00:30:35.598 lat (usec): min=4139, max=96896, avg=11978.09, stdev=13383.63 00:30:35.598 clat percentiles (usec): 00:30:35.598 | 1.00th=[ 4490], 5.00th=[ 5014], 10.00th=[ 5407], 20.00th=[ 6259], 00:30:35.598 | 30.00th=[ 6915], 40.00th=[ 7439], 50.00th=[ 8160], 60.00th=[ 8848], 00:30:35.598 | 70.00th=[ 9634], 80.00th=[10683], 90.00th=[13698], 95.00th=[50594], 00:30:35.598 | 99.00th=[56361], 99.50th=[92799], 99.90th=[95945], 99.95th=[96994], 00:30:35.598 | 99.99th=[96994] 00:30:35.598 bw ( KiB/s): min=12032, max=51456, per=33.05%, avg=32025.60, stdev=12328.50, samples=10 00:30:35.598 iops : min= 94, max= 402, avg=250.20, stdev=96.32, samples=10 00:30:35.598 lat (msec) : 10=74.72%, 20=16.99%, 50=2.23%, 100=6.06% 00:30:35.598 cpu : usr=94.91%, sys=4.67%, ctx=10, majf=0, minf=71 00:30:35.598 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:35.598 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:35.598 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:35.598 issued rwts: total=1254,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:35.598 latency : target=0, window=0, percentile=100.00%, depth=3 00:30:35.598 00:30:35.598 Run status group 0 (all jobs): 00:30:35.598 READ: bw=94.6MiB/s (99.2MB/s), 31.2MiB/s-32.1MiB/s (32.8MB/s-33.7MB/s), io=474MiB (497MB), run=5004-5009msec 00:30:35.598 20:36:07 -- target/dif.sh@107 -- # destroy_subsystems 0 00:30:35.598 20:36:07 -- target/dif.sh@43 -- # local sub 00:30:35.598 20:36:07 -- target/dif.sh@45 -- # for sub in "$@" 00:30:35.598 20:36:07 -- target/dif.sh@46 -- # destroy_subsystem 0 00:30:35.598 20:36:07 -- target/dif.sh@36 -- # local sub_id=0 00:30:35.598 20:36:07 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:30:35.598 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.598 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.598 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.598 20:36:07 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:30:35.598 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.598 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.598 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.598 20:36:07 -- target/dif.sh@109 -- # NULL_DIF=2 00:30:35.598 20:36:07 -- target/dif.sh@109 -- # bs=4k 00:30:35.598 20:36:07 -- target/dif.sh@109 -- # numjobs=8 00:30:35.598 20:36:07 -- target/dif.sh@109 -- # iodepth=16 00:30:35.598 20:36:07 -- target/dif.sh@109 -- # runtime= 00:30:35.598 20:36:07 -- target/dif.sh@109 -- # files=2 00:30:35.598 20:36:07 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:30:35.598 20:36:07 -- target/dif.sh@28 -- # local sub 00:30:35.598 20:36:07 -- target/dif.sh@30 -- # for sub in "$@" 00:30:35.598 20:36:07 -- target/dif.sh@31 -- # create_subsystem 0 00:30:35.598 20:36:07 -- target/dif.sh@18 -- # local sub_id=0 00:30:35.598 20:36:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:30:35.598 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.598 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.598 bdev_null0 00:30:35.598 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.598 20:36:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:35.598 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 [2024-07-22 20:36:07.553344] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@30 -- # for sub in "$@" 00:30:35.858 20:36:07 -- target/dif.sh@31 -- # create_subsystem 1 00:30:35.858 20:36:07 -- target/dif.sh@18 -- # local sub_id=1 00:30:35.858 20:36:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 bdev_null1 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@30 -- # for sub in "$@" 00:30:35.858 20:36:07 -- target/dif.sh@31 -- # create_subsystem 2 00:30:35.858 20:36:07 -- target/dif.sh@18 -- # local sub_id=2 00:30:35.858 20:36:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 bdev_null2 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:30:35.858 20:36:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.858 20:36:07 -- common/autotest_common.sh@10 -- # set +x 00:30:35.858 20:36:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.858 20:36:07 -- target/dif.sh@112 -- # fio /dev/fd/62 00:30:35.859 20:36:07 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:30:35.859 20:36:07 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:30:35.859 20:36:07 -- nvmf/common.sh@520 -- # config=() 00:30:35.859 20:36:07 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:35.859 20:36:07 -- nvmf/common.sh@520 -- # local subsystem config 00:30:35.859 20:36:07 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:35.859 20:36:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:35.859 20:36:07 -- target/dif.sh@82 -- # gen_fio_conf 00:30:35.859 20:36:07 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:30:35.859 20:36:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:35.859 { 00:30:35.859 "params": { 00:30:35.859 "name": "Nvme$subsystem", 00:30:35.859 "trtype": "$TEST_TRANSPORT", 00:30:35.859 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:35.859 "adrfam": "ipv4", 00:30:35.859 "trsvcid": "$NVMF_PORT", 00:30:35.859 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:35.859 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:35.859 "hdgst": ${hdgst:-false}, 00:30:35.859 "ddgst": ${ddgst:-false} 00:30:35.859 }, 00:30:35.859 "method": "bdev_nvme_attach_controller" 00:30:35.859 } 00:30:35.859 EOF 00:30:35.859 )") 00:30:35.859 20:36:07 -- target/dif.sh@54 -- # local file 00:30:35.859 20:36:07 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:35.859 20:36:07 -- target/dif.sh@56 -- # cat 00:30:35.859 20:36:07 -- common/autotest_common.sh@1318 -- # local sanitizers 00:30:35.859 20:36:07 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:35.859 20:36:07 -- common/autotest_common.sh@1320 -- # shift 00:30:35.859 20:36:07 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:30:35.859 20:36:07 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:35.859 20:36:07 -- nvmf/common.sh@542 -- # cat 00:30:35.859 20:36:07 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:35.859 20:36:07 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:35.859 20:36:07 -- target/dif.sh@72 -- # (( file <= files )) 00:30:35.859 20:36:07 -- common/autotest_common.sh@1324 -- # grep libasan 00:30:35.859 20:36:07 -- target/dif.sh@73 -- # cat 00:30:35.859 20:36:07 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:35.859 20:36:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:35.859 20:36:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:35.859 { 00:30:35.859 "params": { 00:30:35.859 "name": "Nvme$subsystem", 00:30:35.859 "trtype": "$TEST_TRANSPORT", 00:30:35.859 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:35.859 "adrfam": "ipv4", 00:30:35.859 "trsvcid": "$NVMF_PORT", 00:30:35.859 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:35.859 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:35.859 "hdgst": ${hdgst:-false}, 00:30:35.859 "ddgst": ${ddgst:-false} 00:30:35.859 }, 00:30:35.859 "method": "bdev_nvme_attach_controller" 00:30:35.859 } 00:30:35.859 EOF 00:30:35.859 )") 00:30:35.859 20:36:07 -- target/dif.sh@72 -- # (( file++ )) 00:30:35.859 20:36:07 -- target/dif.sh@72 -- # (( file <= files )) 00:30:35.859 20:36:07 -- nvmf/common.sh@542 -- # cat 00:30:35.859 20:36:07 -- target/dif.sh@73 -- # cat 00:30:35.859 20:36:07 -- target/dif.sh@72 -- # (( file++ )) 00:30:35.859 20:36:07 -- target/dif.sh@72 -- # (( file <= files )) 00:30:35.859 20:36:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:35.859 20:36:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:35.859 { 00:30:35.859 "params": { 00:30:35.859 "name": "Nvme$subsystem", 00:30:35.859 "trtype": "$TEST_TRANSPORT", 00:30:35.859 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:35.859 "adrfam": "ipv4", 00:30:35.859 "trsvcid": "$NVMF_PORT", 00:30:35.859 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:35.859 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:35.859 "hdgst": ${hdgst:-false}, 00:30:35.859 "ddgst": ${ddgst:-false} 00:30:35.859 }, 00:30:35.859 "method": "bdev_nvme_attach_controller" 00:30:35.859 } 00:30:35.859 EOF 00:30:35.859 )") 00:30:35.859 20:36:07 -- nvmf/common.sh@542 -- # cat 00:30:35.859 20:36:07 -- nvmf/common.sh@544 -- # jq . 00:30:35.859 20:36:07 -- nvmf/common.sh@545 -- # IFS=, 00:30:35.859 20:36:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:35.859 "params": { 00:30:35.859 "name": "Nvme0", 00:30:35.859 "trtype": "tcp", 00:30:35.859 "traddr": "10.0.0.2", 00:30:35.859 "adrfam": "ipv4", 00:30:35.859 "trsvcid": "4420", 00:30:35.859 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:35.859 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:35.859 "hdgst": false, 00:30:35.859 "ddgst": false 00:30:35.859 }, 00:30:35.859 "method": "bdev_nvme_attach_controller" 00:30:35.859 },{ 00:30:35.859 "params": { 00:30:35.859 "name": "Nvme1", 00:30:35.859 "trtype": "tcp", 00:30:35.859 "traddr": "10.0.0.2", 00:30:35.859 "adrfam": "ipv4", 00:30:35.859 "trsvcid": "4420", 00:30:35.859 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:35.859 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:35.859 "hdgst": false, 00:30:35.859 "ddgst": false 00:30:35.859 }, 00:30:35.859 "method": "bdev_nvme_attach_controller" 00:30:35.859 },{ 00:30:35.859 "params": { 00:30:35.859 "name": "Nvme2", 00:30:35.859 "trtype": "tcp", 00:30:35.859 "traddr": "10.0.0.2", 00:30:35.859 "adrfam": "ipv4", 00:30:35.859 "trsvcid": "4420", 00:30:35.859 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:30:35.859 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:30:35.859 "hdgst": false, 00:30:35.859 "ddgst": false 00:30:35.859 }, 00:30:35.859 "method": "bdev_nvme_attach_controller" 00:30:35.859 }' 00:30:35.859 20:36:07 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:35.859 20:36:07 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:35.859 20:36:07 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:35.859 20:36:07 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:35.859 20:36:07 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:30:35.859 20:36:07 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:35.859 20:36:07 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:35.859 20:36:07 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:35.859 20:36:07 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:35.859 20:36:07 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:36.118 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:30:36.118 ... 00:30:36.118 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:30:36.118 ... 00:30:36.118 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:30:36.118 ... 00:30:36.118 fio-3.35 00:30:36.118 Starting 24 threads 00:30:36.118 EAL: No free 2048 kB hugepages reported on node 1 00:30:37.056 [2024-07-22 20:36:08.663034] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:37.056 [2024-07-22 20:36:08.663089] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:30:49.268 00:30:49.268 filename0: (groupid=0, jobs=1): err= 0: pid=3604500: Mon Jul 22 20:36:19 2024 00:30:49.268 read: IOPS=670, BW=2683KiB/s (2747kB/s)(26.2MiB/10001msec) 00:30:49.268 slat (usec): min=6, max=106, avg=28.52, stdev=19.15 00:30:49.268 clat (usec): min=4424, max=42471, avg=23632.24, stdev=3029.17 00:30:49.268 lat (usec): min=4458, max=42481, avg=23660.76, stdev=3030.66 00:30:49.268 clat percentiles (usec): 00:30:49.268 | 1.00th=[ 7701], 5.00th=[19530], 10.00th=[22152], 20.00th=[22938], 00:30:49.268 | 30.00th=[23462], 40.00th=[23725], 50.00th=[23987], 60.00th=[24249], 00:30:49.268 | 70.00th=[24511], 80.00th=[25035], 90.00th=[26084], 95.00th=[26608], 00:30:49.268 | 99.00th=[28181], 99.50th=[28967], 99.90th=[30278], 99.95th=[36963], 00:30:49.268 | 99.99th=[42730] 00:30:49.268 bw ( KiB/s): min= 2432, max= 3256, per=4.45%, avg=2675.16, stdev=185.07, samples=19 00:30:49.268 iops : min= 608, max= 814, avg=668.74, stdev=46.29, samples=19 00:30:49.268 lat (msec) : 10=1.52%, 20=4.03%, 50=94.45% 00:30:49.268 cpu : usr=98.63%, sys=0.81%, ctx=86, majf=0, minf=34 00:30:49.268 IO depths : 1=5.5%, 2=11.2%, 4=23.2%, 8=53.0%, 16=7.2%, 32=0.0%, >=64=0.0% 00:30:49.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.268 complete : 0=0.0%, 4=93.7%, 8=0.5%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.268 issued rwts: total=6707,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.268 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.268 filename0: (groupid=0, jobs=1): err= 0: pid=3604501: Mon Jul 22 20:36:19 2024 00:30:49.268 read: IOPS=643, BW=2574KiB/s (2636kB/s)(25.7MiB/10218msec) 00:30:49.268 slat (usec): min=6, max=143, avg=48.45, stdev=18.89 00:30:49.268 clat (msec): min=6, max=228, avg=24.46, stdev=10.18 00:30:49.268 lat (msec): min=6, max=228, avg=24.51, stdev=10.19 00:30:49.268 clat percentiles (msec): 00:30:49.268 | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 23], 00:30:49.268 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.268 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 26], 95.00th=[ 27], 00:30:49.268 | 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 228], 99.95th=[ 228], 00:30:49.268 | 99.99th=[ 228] 00:30:49.268 bw ( KiB/s): min= 2432, max= 2816, per=4.36%, avg=2624.25, stdev=95.81, samples=20 00:30:49.268 iops : min= 608, max= 704, avg=656.05, stdev=23.95, samples=20 00:30:49.268 lat (msec) : 10=0.24%, 20=0.81%, 50=98.71%, 250=0.24% 00:30:49.268 cpu : usr=98.39%, sys=0.87%, ctx=33, majf=0, minf=52 00:30:49.268 IO depths : 1=5.9%, 2=11.8%, 4=24.3%, 8=51.3%, 16=6.8%, 32=0.0%, >=64=0.0% 00:30:49.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.268 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.268 issued rwts: total=6576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.268 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.268 filename0: (groupid=0, jobs=1): err= 0: pid=3604503: Mon Jul 22 20:36:19 2024 00:30:49.268 read: IOPS=640, BW=2561KiB/s (2622kB/s)(25.4MiB/10171msec) 00:30:49.268 slat (usec): min=6, max=119, avg=51.66, stdev=17.29 00:30:49.268 clat (msec): min=15, max=228, avg=24.52, stdev=10.25 00:30:49.268 lat (msec): min=15, max=228, avg=24.58, stdev=10.25 00:30:49.268 clat percentiles (msec): 00:30:49.268 | 1.00th=[ 22], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.268 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 24], 00:30:49.268 | 70.00th=[ 25], 80.00th=[ 25], 90.00th=[ 26], 95.00th=[ 27], 00:30:49.268 | 99.00th=[ 28], 99.50th=[ 36], 99.90th=[ 230], 99.95th=[ 230], 00:30:49.268 | 99.99th=[ 230] 00:30:49.268 bw ( KiB/s): min= 2304, max= 2704, per=4.32%, avg=2597.25, stdev=119.83, samples=20 00:30:49.268 iops : min= 576, max= 676, avg=649.20, stdev=29.96, samples=20 00:30:49.268 lat (msec) : 20=0.15%, 50=99.60%, 250=0.25% 00:30:49.268 cpu : usr=98.08%, sys=0.88%, ctx=28, majf=0, minf=30 00:30:49.268 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:30:49.268 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.268 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.268 issued rwts: total=6512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.268 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.268 filename0: (groupid=0, jobs=1): err= 0: pid=3604504: Mon Jul 22 20:36:19 2024 00:30:49.268 read: IOPS=622, BW=2491KiB/s (2551kB/s)(24.8MiB/10185msec) 00:30:49.268 slat (nsec): min=6323, max=97296, avg=31315.80, stdev=19573.77 00:30:49.268 clat (msec): min=6, max=229, avg=25.51, stdev=11.01 00:30:49.268 lat (msec): min=6, max=229, avg=25.54, stdev=11.01 00:30:49.268 clat percentiles (msec): 00:30:49.268 | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.268 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:30:49.268 | 70.00th=[ 26], 80.00th=[ 27], 90.00th=[ 29], 95.00th=[ 34], 00:30:49.268 | 99.00th=[ 41], 99.50th=[ 59], 99.90th=[ 230], 99.95th=[ 230], 00:30:49.268 | 99.99th=[ 230] 00:30:49.269 bw ( KiB/s): min= 2304, max= 2736, per=4.21%, avg=2530.25, stdev=128.76, samples=20 00:30:49.269 iops : min= 576, max= 684, avg=632.50, stdev=32.23, samples=20 00:30:49.269 lat (msec) : 10=0.25%, 20=4.30%, 50=94.94%, 100=0.25%, 250=0.25% 00:30:49.269 cpu : usr=98.79%, sys=0.84%, ctx=11, majf=0, minf=34 00:30:49.269 IO depths : 1=1.5%, 2=3.3%, 4=10.7%, 8=71.3%, 16=13.1%, 32=0.0%, >=64=0.0% 00:30:49.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 complete : 0=0.0%, 4=90.9%, 8=5.4%, 16=3.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 issued rwts: total=6343,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.269 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.269 filename0: (groupid=0, jobs=1): err= 0: pid=3604505: Mon Jul 22 20:36:19 2024 00:30:49.269 read: IOPS=626, BW=2504KiB/s (2564kB/s)(24.9MiB/10198msec) 00:30:49.269 slat (usec): min=6, max=122, avg=32.57, stdev=22.63 00:30:49.269 clat (msec): min=5, max=229, avg=25.38, stdev=10.82 00:30:49.269 lat (msec): min=5, max=229, avg=25.41, stdev=10.82 00:30:49.269 clat percentiles (msec): 00:30:49.269 | 1.00th=[ 14], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.269 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:30:49.269 | 70.00th=[ 26], 80.00th=[ 27], 90.00th=[ 28], 95.00th=[ 32], 00:30:49.269 | 99.00th=[ 41], 99.50th=[ 45], 99.90th=[ 230], 99.95th=[ 230], 00:30:49.269 | 99.99th=[ 230] 00:30:49.269 bw ( KiB/s): min= 2336, max= 2912, per=4.23%, avg=2546.30, stdev=130.13, samples=20 00:30:49.269 iops : min= 584, max= 728, avg=636.50, stdev=32.49, samples=20 00:30:49.269 lat (msec) : 10=0.09%, 20=3.62%, 50=96.04%, 250=0.25% 00:30:49.269 cpu : usr=98.81%, sys=0.78%, ctx=27, majf=0, minf=58 00:30:49.269 IO depths : 1=0.8%, 2=1.9%, 4=8.0%, 8=74.9%, 16=14.4%, 32=0.0%, >=64=0.0% 00:30:49.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 complete : 0=0.0%, 4=90.6%, 8=6.2%, 16=3.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 issued rwts: total=6384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.269 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.269 filename0: (groupid=0, jobs=1): err= 0: pid=3604506: Mon Jul 22 20:36:19 2024 00:30:49.269 read: IOPS=644, BW=2577KiB/s (2639kB/s)(25.7MiB/10221msec) 00:30:49.269 slat (usec): min=6, max=120, avg=30.36, stdev=21.55 00:30:49.269 clat (msec): min=3, max=227, avg=24.64, stdev=10.68 00:30:49.269 lat (msec): min=3, max=227, avg=24.67, stdev=10.68 00:30:49.269 clat percentiles (msec): 00:30:49.269 | 1.00th=[ 7], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 23], 00:30:49.269 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:30:49.269 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 29], 00:30:49.269 | 99.00th=[ 40], 99.50th=[ 43], 99.90th=[ 228], 99.95th=[ 228], 00:30:49.269 | 99.99th=[ 228] 00:30:49.269 bw ( KiB/s): min= 2427, max= 3088, per=4.37%, avg=2627.75, stdev=162.59, samples=20 00:30:49.269 iops : min= 606, max= 772, avg=656.90, stdev=40.70, samples=20 00:30:49.269 lat (msec) : 4=0.03%, 10=1.58%, 20=3.78%, 50=94.37%, 250=0.24% 00:30:49.269 cpu : usr=97.69%, sys=1.14%, ctx=34, majf=0, minf=30 00:30:49.269 IO depths : 1=1.5%, 2=3.3%, 4=12.6%, 8=69.8%, 16=12.7%, 32=0.0%, >=64=0.0% 00:30:49.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 complete : 0=0.0%, 4=91.7%, 8=4.1%, 16=4.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 issued rwts: total=6586,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.269 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.269 filename0: (groupid=0, jobs=1): err= 0: pid=3604507: Mon Jul 22 20:36:19 2024 00:30:49.269 read: IOPS=638, BW=2554KiB/s (2616kB/s)(25.4MiB/10198msec) 00:30:49.269 slat (usec): min=6, max=119, avg=37.91, stdev=19.59 00:30:49.269 clat (msec): min=5, max=229, avg=24.78, stdev=10.67 00:30:49.269 lat (msec): min=5, max=229, avg=24.82, stdev=10.67 00:30:49.269 clat percentiles (msec): 00:30:49.269 | 1.00th=[ 13], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 23], 00:30:49.269 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.269 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 30], 00:30:49.269 | 99.00th=[ 41], 99.50th=[ 46], 99.90th=[ 230], 99.95th=[ 230], 00:30:49.269 | 99.99th=[ 230] 00:30:49.269 bw ( KiB/s): min= 2320, max= 2792, per=4.32%, avg=2597.50, stdev=113.39, samples=20 00:30:49.269 iops : min= 580, max= 698, avg=649.30, stdev=28.32, samples=20 00:30:49.269 lat (msec) : 10=0.55%, 20=4.44%, 50=94.76%, 250=0.25% 00:30:49.269 cpu : usr=98.58%, sys=0.95%, ctx=100, majf=0, minf=27 00:30:49.269 IO depths : 1=2.0%, 2=6.6%, 4=19.8%, 8=60.5%, 16=11.0%, 32=0.0%, >=64=0.0% 00:30:49.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 complete : 0=0.0%, 4=93.2%, 8=1.4%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 issued rwts: total=6512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.269 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.269 filename0: (groupid=0, jobs=1): err= 0: pid=3604508: Mon Jul 22 20:36:19 2024 00:30:49.269 read: IOPS=595, BW=2380KiB/s (2437kB/s)(23.7MiB/10199msec) 00:30:49.269 slat (usec): min=6, max=207, avg=29.66, stdev=20.25 00:30:49.269 clat (msec): min=8, max=227, avg=26.71, stdev=11.11 00:30:49.269 lat (msec): min=8, max=227, avg=26.74, stdev=11.11 00:30:49.269 clat percentiles (msec): 00:30:49.269 | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.269 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 25], 60.00th=[ 26], 00:30:49.269 | 70.00th=[ 27], 80.00th=[ 29], 90.00th=[ 34], 95.00th=[ 38], 00:30:49.269 | 99.00th=[ 45], 99.50th=[ 47], 99.90th=[ 228], 99.95th=[ 228], 00:30:49.269 | 99.99th=[ 228] 00:30:49.269 bw ( KiB/s): min= 2219, max= 2634, per=4.02%, avg=2420.40, stdev=109.44, samples=20 00:30:49.269 iops : min= 554, max= 658, avg=605.00, stdev=27.36, samples=20 00:30:49.269 lat (msec) : 10=0.15%, 20=3.16%, 50=96.39%, 100=0.03%, 250=0.26% 00:30:49.269 cpu : usr=97.52%, sys=1.26%, ctx=54, majf=0, minf=29 00:30:49.269 IO depths : 1=0.3%, 2=0.8%, 4=8.0%, 8=76.6%, 16=14.3%, 32=0.0%, >=64=0.0% 00:30:49.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 complete : 0=0.0%, 4=90.5%, 8=5.8%, 16=3.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 issued rwts: total=6069,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.269 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.269 filename1: (groupid=0, jobs=1): err= 0: pid=3604509: Mon Jul 22 20:36:19 2024 00:30:49.269 read: IOPS=636, BW=2547KiB/s (2608kB/s)(25.4MiB/10220msec) 00:30:49.269 slat (usec): min=6, max=107, avg=30.04, stdev=18.84 00:30:49.269 clat (msec): min=4, max=228, avg=24.93, stdev=10.54 00:30:49.269 lat (msec): min=4, max=228, avg=24.96, stdev=10.54 00:30:49.269 clat percentiles (msec): 00:30:49.269 | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.269 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.269 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 29], 00:30:49.269 | 99.00th=[ 39], 99.50th=[ 42], 99.90th=[ 228], 99.95th=[ 228], 00:30:49.269 | 99.99th=[ 228] 00:30:49.269 bw ( KiB/s): min= 2379, max= 2730, per=4.31%, avg=2595.95, stdev=100.39, samples=20 00:30:49.269 iops : min= 594, max= 682, avg=648.90, stdev=25.13, samples=20 00:30:49.269 lat (msec) : 10=0.49%, 20=2.43%, 50=96.83%, 250=0.25% 00:30:49.269 cpu : usr=97.89%, sys=1.44%, ctx=160, majf=0, minf=32 00:30:49.269 IO depths : 1=1.9%, 2=4.0%, 4=12.2%, 8=70.1%, 16=11.8%, 32=0.0%, >=64=0.0% 00:30:49.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 complete : 0=0.0%, 4=91.1%, 8=4.4%, 16=4.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 issued rwts: total=6508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.269 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.269 filename1: (groupid=0, jobs=1): err= 0: pid=3604511: Mon Jul 22 20:36:19 2024 00:30:49.269 read: IOPS=571, BW=2286KiB/s (2341kB/s)(22.8MiB/10198msec) 00:30:49.269 slat (usec): min=6, max=131, avg=34.07, stdev=22.85 00:30:49.269 clat (msec): min=11, max=229, avg=27.68, stdev=10.84 00:30:49.269 lat (msec): min=11, max=229, avg=27.72, stdev=10.84 00:30:49.269 clat percentiles (msec): 00:30:49.269 | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.269 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 26], 60.00th=[ 27], 00:30:49.269 | 70.00th=[ 28], 80.00th=[ 31], 90.00th=[ 36], 95.00th=[ 41], 00:30:49.269 | 99.00th=[ 47], 99.50th=[ 49], 99.90th=[ 230], 99.95th=[ 230], 00:30:49.269 | 99.99th=[ 230] 00:30:49.269 bw ( KiB/s): min= 1912, max= 2602, per=3.86%, avg=2324.35, stdev=157.23, samples=20 00:30:49.269 iops : min= 478, max= 650, avg=581.00, stdev=39.24, samples=20 00:30:49.269 lat (msec) : 20=2.45%, 50=97.17%, 100=0.17%, 250=0.21% 00:30:49.269 cpu : usr=98.30%, sys=0.90%, ctx=30, majf=0, minf=30 00:30:49.269 IO depths : 1=0.7%, 2=2.1%, 4=10.5%, 8=73.6%, 16=13.2%, 32=0.0%, >=64=0.0% 00:30:49.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 complete : 0=0.0%, 4=90.7%, 8=4.9%, 16=4.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 issued rwts: total=5829,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.269 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.269 filename1: (groupid=0, jobs=1): err= 0: pid=3604512: Mon Jul 22 20:36:19 2024 00:30:49.269 read: IOPS=617, BW=2469KiB/s (2529kB/s)(24.6MiB/10199msec) 00:30:49.269 slat (usec): min=6, max=122, avg=34.39, stdev=22.39 00:30:49.269 clat (msec): min=6, max=229, avg=25.67, stdev=10.48 00:30:49.269 lat (msec): min=6, max=229, avg=25.71, stdev=10.48 00:30:49.269 clat percentiles (msec): 00:30:49.269 | 1.00th=[ 15], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.269 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:30:49.269 | 70.00th=[ 26], 80.00th=[ 27], 90.00th=[ 30], 95.00th=[ 35], 00:30:49.269 | 99.00th=[ 43], 99.50th=[ 46], 99.90th=[ 228], 99.95th=[ 230], 00:30:49.269 | 99.99th=[ 230] 00:30:49.269 bw ( KiB/s): min= 2288, max= 2656, per=4.17%, avg=2511.15, stdev=93.26, samples=20 00:30:49.269 iops : min= 572, max= 664, avg=627.70, stdev=23.31, samples=20 00:30:49.269 lat (msec) : 10=0.33%, 20=3.37%, 50=96.05%, 100=0.03%, 250=0.22% 00:30:49.269 cpu : usr=98.77%, sys=0.71%, ctx=23, majf=0, minf=27 00:30:49.269 IO depths : 1=0.7%, 2=1.9%, 4=9.5%, 8=74.4%, 16=13.5%, 32=0.0%, >=64=0.0% 00:30:49.269 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 complete : 0=0.0%, 4=90.8%, 8=5.1%, 16=4.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.269 issued rwts: total=6296,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.270 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.270 filename1: (groupid=0, jobs=1): err= 0: pid=3604513: Mon Jul 22 20:36:19 2024 00:30:49.270 read: IOPS=610, BW=2440KiB/s (2499kB/s)(24.2MiB/10172msec) 00:30:49.270 slat (usec): min=6, max=900, avg=32.63, stdev=24.17 00:30:49.270 clat (msec): min=8, max=232, avg=26.02, stdev=10.64 00:30:49.270 lat (msec): min=8, max=232, avg=26.05, stdev=10.64 00:30:49.270 clat percentiles (msec): 00:30:49.270 | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.270 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:30:49.270 | 70.00th=[ 26], 80.00th=[ 27], 90.00th=[ 31], 95.00th=[ 36], 00:30:49.270 | 99.00th=[ 43], 99.50th=[ 46], 99.90th=[ 228], 99.95th=[ 232], 00:30:49.270 | 99.99th=[ 234] 00:30:49.270 bw ( KiB/s): min= 2144, max= 2688, per=4.11%, avg=2475.00, stdev=134.72, samples=20 00:30:49.270 iops : min= 536, max= 672, avg=618.60, stdev=33.72, samples=20 00:30:49.270 lat (msec) : 10=0.02%, 20=1.80%, 50=97.92%, 250=0.26% 00:30:49.270 cpu : usr=93.75%, sys=2.83%, ctx=301, majf=0, minf=27 00:30:49.270 IO depths : 1=0.5%, 2=1.4%, 4=7.3%, 8=76.1%, 16=14.7%, 32=0.0%, >=64=0.0% 00:30:49.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 complete : 0=0.0%, 4=90.5%, 8=6.4%, 16=3.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 issued rwts: total=6206,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.270 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.270 filename1: (groupid=0, jobs=1): err= 0: pid=3604514: Mon Jul 22 20:36:19 2024 00:30:49.270 read: IOPS=601, BW=2407KiB/s (2465kB/s)(23.9MiB/10171msec) 00:30:49.270 slat (usec): min=6, max=118, avg=36.01, stdev=23.34 00:30:49.270 clat (msec): min=8, max=229, avg=26.33, stdev=10.52 00:30:49.270 lat (msec): min=8, max=229, avg=26.36, stdev=10.52 00:30:49.270 clat percentiles (msec): 00:30:49.270 | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.270 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 25], 60.00th=[ 26], 00:30:49.270 | 70.00th=[ 27], 80.00th=[ 29], 90.00th=[ 33], 95.00th=[ 37], 00:30:49.270 | 99.00th=[ 43], 99.50th=[ 45], 99.90th=[ 226], 99.95th=[ 230], 00:30:49.270 | 99.99th=[ 230] 00:30:49.270 bw ( KiB/s): min= 2152, max= 2624, per=4.06%, avg=2440.30, stdev=110.20, samples=20 00:30:49.270 iops : min= 538, max= 656, avg=609.90, stdev=27.66, samples=20 00:30:49.270 lat (msec) : 10=0.07%, 20=4.10%, 50=95.57%, 250=0.26% 00:30:49.270 cpu : usr=98.97%, sys=0.61%, ctx=34, majf=0, minf=32 00:30:49.270 IO depths : 1=0.9%, 2=2.0%, 4=9.9%, 8=74.0%, 16=13.2%, 32=0.0%, >=64=0.0% 00:30:49.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 complete : 0=0.0%, 4=90.6%, 8=5.1%, 16=4.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 issued rwts: total=6120,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.270 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.270 filename1: (groupid=0, jobs=1): err= 0: pid=3604515: Mon Jul 22 20:36:19 2024 00:30:49.270 read: IOPS=633, BW=2536KiB/s (2597kB/s)(25.2MiB/10184msec) 00:30:49.270 slat (usec): min=6, max=681, avg=42.59, stdev=20.66 00:30:49.270 clat (msec): min=10, max=228, avg=24.79, stdev= 9.11 00:30:49.270 lat (msec): min=10, max=228, avg=24.83, stdev= 9.11 00:30:49.270 clat percentiles (msec): 00:30:49.270 | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.270 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.270 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 28], 00:30:49.270 | 99.00th=[ 39], 99.50th=[ 45], 99.90th=[ 176], 99.95th=[ 230], 00:30:49.270 | 99.99th=[ 230] 00:30:49.270 bw ( KiB/s): min= 2304, max= 2720, per=4.28%, avg=2575.40, stdev=124.59, samples=20 00:30:49.270 iops : min= 576, max= 680, avg=643.80, stdev=31.14, samples=20 00:30:49.270 lat (msec) : 20=1.70%, 50=97.80%, 100=0.25%, 250=0.25% 00:30:49.270 cpu : usr=93.17%, sys=3.17%, ctx=150, majf=0, minf=28 00:30:49.270 IO depths : 1=4.8%, 2=9.6%, 4=20.7%, 8=57.0%, 16=7.8%, 32=0.0%, >=64=0.0% 00:30:49.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 complete : 0=0.0%, 4=92.9%, 8=1.4%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 issued rwts: total=6456,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.270 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.270 filename1: (groupid=0, jobs=1): err= 0: pid=3604516: Mon Jul 22 20:36:19 2024 00:30:49.270 read: IOPS=644, BW=2579KiB/s (2641kB/s)(25.7MiB/10220msec) 00:30:49.270 slat (usec): min=6, max=102, avg=37.66, stdev=19.08 00:30:49.270 clat (msec): min=4, max=227, avg=24.51, stdev=10.21 00:30:49.270 lat (msec): min=4, max=227, avg=24.55, stdev=10.21 00:30:49.270 clat percentiles (msec): 00:30:49.270 | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.270 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.270 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 26], 95.00th=[ 27], 00:30:49.270 | 99.00th=[ 30], 99.50th=[ 37], 99.90th=[ 228], 99.95th=[ 228], 00:30:49.270 | 99.99th=[ 228] 00:30:49.270 bw ( KiB/s): min= 2432, max= 2816, per=4.37%, avg=2629.45, stdev=103.40, samples=20 00:30:49.270 iops : min= 608, max= 704, avg=657.35, stdev=25.86, samples=20 00:30:49.270 lat (msec) : 10=0.29%, 20=1.17%, 50=98.30%, 250=0.24% 00:30:49.270 cpu : usr=98.56%, sys=0.82%, ctx=66, majf=0, minf=35 00:30:49.270 IO depths : 1=5.6%, 2=11.5%, 4=24.1%, 8=51.8%, 16=7.0%, 32=0.0%, >=64=0.0% 00:30:49.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 issued rwts: total=6589,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.270 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.270 filename1: (groupid=0, jobs=1): err= 0: pid=3604517: Mon Jul 22 20:36:19 2024 00:30:49.270 read: IOPS=601, BW=2405KiB/s (2462kB/s)(23.9MiB/10177msec) 00:30:49.270 slat (usec): min=5, max=102, avg=28.41, stdev=20.78 00:30:49.270 clat (msec): min=13, max=228, avg=26.37, stdev=10.15 00:30:49.270 lat (msec): min=13, max=228, avg=26.40, stdev=10.15 00:30:49.270 clat percentiles (msec): 00:30:49.270 | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.270 | 30.00th=[ 24], 40.00th=[ 25], 50.00th=[ 25], 60.00th=[ 26], 00:30:49.270 | 70.00th=[ 27], 80.00th=[ 28], 90.00th=[ 33], 95.00th=[ 37], 00:30:49.270 | 99.00th=[ 44], 99.50th=[ 49], 99.90th=[ 226], 99.95th=[ 228], 00:30:49.270 | 99.99th=[ 228] 00:30:49.270 bw ( KiB/s): min= 2176, max= 2672, per=4.06%, avg=2440.20, stdev=140.94, samples=20 00:30:49.270 iops : min= 544, max= 668, avg=610.00, stdev=35.17, samples=20 00:30:49.270 lat (msec) : 20=2.44%, 50=97.30%, 100=0.07%, 250=0.20% 00:30:49.270 cpu : usr=93.24%, sys=3.15%, ctx=138, majf=0, minf=33 00:30:49.270 IO depths : 1=0.2%, 2=1.6%, 4=9.3%, 8=73.9%, 16=14.9%, 32=0.0%, >=64=0.0% 00:30:49.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 complete : 0=0.0%, 4=91.2%, 8=5.1%, 16=3.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 issued rwts: total=6118,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.270 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.270 filename2: (groupid=0, jobs=1): err= 0: pid=3604518: Mon Jul 22 20:36:19 2024 00:30:49.270 read: IOPS=641, BW=2567KiB/s (2628kB/s)(25.6MiB/10198msec) 00:30:49.270 slat (usec): min=6, max=105, avg=39.93, stdev=19.38 00:30:49.270 clat (msec): min=8, max=228, avg=24.61, stdev=10.26 00:30:49.270 lat (msec): min=8, max=228, avg=24.65, stdev=10.26 00:30:49.270 clat percentiles (msec): 00:30:49.270 | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.270 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.270 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 27], 00:30:49.270 | 99.00th=[ 29], 99.50th=[ 37], 99.90th=[ 228], 99.95th=[ 228], 00:30:49.270 | 99.99th=[ 228] 00:30:49.270 bw ( KiB/s): min= 2432, max= 2816, per=4.34%, avg=2610.30, stdev=104.77, samples=20 00:30:49.270 iops : min= 608, max= 704, avg=652.50, stdev=26.17, samples=20 00:30:49.270 lat (msec) : 10=0.09%, 20=1.05%, 50=98.61%, 250=0.24% 00:30:49.270 cpu : usr=99.19%, sys=0.44%, ctx=9, majf=0, minf=26 00:30:49.270 IO depths : 1=4.3%, 2=10.4%, 4=24.6%, 8=52.5%, 16=8.2%, 32=0.0%, >=64=0.0% 00:30:49.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 issued rwts: total=6544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.270 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.270 filename2: (groupid=0, jobs=1): err= 0: pid=3604520: Mon Jul 22 20:36:19 2024 00:30:49.270 read: IOPS=629, BW=2516KiB/s (2577kB/s)(25.0MiB/10171msec) 00:30:49.270 slat (usec): min=6, max=140, avg=44.15, stdev=20.38 00:30:49.270 clat (msec): min=8, max=239, avg=25.08, stdev=10.67 00:30:49.270 lat (msec): min=8, max=239, avg=25.12, stdev=10.67 00:30:49.270 clat percentiles (msec): 00:30:49.270 | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.270 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.270 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 31], 00:30:49.270 | 99.00th=[ 41], 99.50th=[ 45], 99.90th=[ 228], 99.95th=[ 228], 00:30:49.270 | 99.99th=[ 241] 00:30:49.270 bw ( KiB/s): min= 2208, max= 2688, per=4.24%, avg=2551.65, stdev=136.07, samples=20 00:30:49.270 iops : min= 552, max= 672, avg=637.80, stdev=34.05, samples=20 00:30:49.270 lat (msec) : 10=0.06%, 20=1.86%, 50=97.83%, 250=0.25% 00:30:49.270 cpu : usr=97.68%, sys=1.14%, ctx=45, majf=0, minf=28 00:30:49.270 IO depths : 1=3.9%, 2=8.1%, 4=18.9%, 8=59.6%, 16=9.5%, 32=0.0%, >=64=0.0% 00:30:49.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 complete : 0=0.0%, 4=92.8%, 8=2.3%, 16=4.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.270 issued rwts: total=6398,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.270 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.270 filename2: (groupid=0, jobs=1): err= 0: pid=3604521: Mon Jul 22 20:36:19 2024 00:30:49.270 read: IOPS=631, BW=2527KiB/s (2588kB/s)(25.2MiB/10199msec) 00:30:49.270 slat (usec): min=6, max=107, avg=28.67, stdev=19.01 00:30:49.270 clat (msec): min=8, max=234, avg=25.17, stdev=10.97 00:30:49.270 lat (msec): min=8, max=234, avg=25.20, stdev=10.97 00:30:49.270 clat percentiles (msec): 00:30:49.270 | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.270 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:30:49.270 | 70.00th=[ 26], 80.00th=[ 26], 90.00th=[ 28], 95.00th=[ 32], 00:30:49.270 | 99.00th=[ 44], 99.50th=[ 45], 99.90th=[ 234], 99.95th=[ 234], 00:30:49.271 | 99.99th=[ 234] 00:30:49.271 bw ( KiB/s): min= 2392, max= 2736, per=4.27%, avg=2570.30, stdev=95.22, samples=20 00:30:49.271 iops : min= 598, max= 684, avg=642.50, stdev=23.80, samples=20 00:30:49.271 lat (msec) : 10=0.05%, 20=4.14%, 50=95.56%, 250=0.25% 00:30:49.271 cpu : usr=98.74%, sys=0.85%, ctx=21, majf=0, minf=43 00:30:49.271 IO depths : 1=0.5%, 2=1.4%, 4=7.8%, 8=76.6%, 16=13.8%, 32=0.0%, >=64=0.0% 00:30:49.271 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 complete : 0=0.0%, 4=90.2%, 8=5.8%, 16=4.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 issued rwts: total=6444,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.271 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.271 filename2: (groupid=0, jobs=1): err= 0: pid=3604522: Mon Jul 22 20:36:19 2024 00:30:49.271 read: IOPS=640, BW=2560KiB/s (2622kB/s)(25.5MiB/10199msec) 00:30:49.271 slat (usec): min=6, max=118, avg=49.49, stdev=18.91 00:30:49.271 clat (msec): min=20, max=228, avg=24.56, stdev=10.22 00:30:49.271 lat (msec): min=20, max=228, avg=24.61, stdev=10.22 00:30:49.271 clat percentiles (msec): 00:30:49.271 | 1.00th=[ 22], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 23], 00:30:49.271 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.271 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 26], 95.00th=[ 27], 00:30:49.271 | 99.00th=[ 29], 99.50th=[ 32], 99.90th=[ 228], 99.95th=[ 230], 00:30:49.271 | 99.99th=[ 230] 00:30:49.271 bw ( KiB/s): min= 2432, max= 2816, per=4.33%, avg=2603.90, stdev=103.68, samples=20 00:30:49.271 iops : min= 608, max= 704, avg=650.90, stdev=25.89, samples=20 00:30:49.271 lat (msec) : 50=99.75%, 250=0.25% 00:30:49.271 cpu : usr=98.54%, sys=0.72%, ctx=39, majf=0, minf=30 00:30:49.271 IO depths : 1=6.0%, 2=12.2%, 4=24.9%, 8=50.4%, 16=6.5%, 32=0.0%, >=64=0.0% 00:30:49.271 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 issued rwts: total=6528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.271 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.271 filename2: (groupid=0, jobs=1): err= 0: pid=3604523: Mon Jul 22 20:36:19 2024 00:30:49.271 read: IOPS=639, BW=2558KiB/s (2619kB/s)(25.4MiB/10172msec) 00:30:49.271 slat (nsec): min=6217, max=95744, avg=38289.88, stdev=20000.76 00:30:49.271 clat (msec): min=14, max=229, avg=24.70, stdev=10.32 00:30:49.271 lat (msec): min=14, max=229, avg=24.74, stdev=10.32 00:30:49.271 clat percentiles (msec): 00:30:49.271 | 1.00th=[ 22], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.271 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.271 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 26], 95.00th=[ 27], 00:30:49.271 | 99.00th=[ 30], 99.50th=[ 43], 99.90th=[ 230], 99.95th=[ 230], 00:30:49.271 | 99.99th=[ 230] 00:30:49.271 bw ( KiB/s): min= 2304, max= 2816, per=4.31%, avg=2594.60, stdev=128.93, samples=20 00:30:49.271 iops : min= 576, max= 704, avg=648.60, stdev=32.21, samples=20 00:30:49.271 lat (msec) : 20=0.42%, 50=99.34%, 250=0.25% 00:30:49.271 cpu : usr=98.82%, sys=0.69%, ctx=85, majf=0, minf=36 00:30:49.271 IO depths : 1=4.3%, 2=8.7%, 4=17.9%, 8=59.1%, 16=9.9%, 32=0.0%, >=64=0.0% 00:30:49.271 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 complete : 0=0.0%, 4=92.7%, 8=3.2%, 16=4.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 issued rwts: total=6504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.271 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.271 filename2: (groupid=0, jobs=1): err= 0: pid=3604524: Mon Jul 22 20:36:19 2024 00:30:49.271 read: IOPS=622, BW=2491KiB/s (2551kB/s)(24.8MiB/10177msec) 00:30:49.271 slat (usec): min=5, max=104, avg=29.73, stdev=20.46 00:30:49.271 clat (msec): min=6, max=228, avg=25.50, stdev=10.55 00:30:49.271 lat (msec): min=6, max=228, avg=25.53, stdev=10.55 00:30:49.271 clat percentiles (msec): 00:30:49.271 | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 24], 00:30:49.271 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 25], 00:30:49.271 | 70.00th=[ 26], 80.00th=[ 27], 90.00th=[ 30], 95.00th=[ 34], 00:30:49.271 | 99.00th=[ 43], 99.50th=[ 50], 99.90th=[ 230], 99.95th=[ 230], 00:30:49.271 | 99.99th=[ 230] 00:30:49.271 bw ( KiB/s): min= 2328, max= 2688, per=4.20%, avg=2528.25, stdev=98.94, samples=20 00:30:49.271 iops : min= 582, max= 672, avg=632.00, stdev=24.80, samples=20 00:30:49.271 lat (msec) : 10=0.32%, 20=3.85%, 50=95.58%, 250=0.25% 00:30:49.271 cpu : usr=98.60%, sys=0.85%, ctx=75, majf=0, minf=35 00:30:49.271 IO depths : 1=0.1%, 2=1.1%, 4=7.9%, 8=75.3%, 16=15.5%, 32=0.0%, >=64=0.0% 00:30:49.271 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 complete : 0=0.0%, 4=90.8%, 8=6.4%, 16=2.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 issued rwts: total=6338,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.271 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.271 filename2: (groupid=0, jobs=1): err= 0: pid=3604525: Mon Jul 22 20:36:19 2024 00:30:49.271 read: IOPS=652, BW=2612KiB/s (2675kB/s)(26.1MiB/10221msec) 00:30:49.271 slat (nsec): min=6264, max=96214, avg=32879.91, stdev=19743.67 00:30:49.271 clat (msec): min=4, max=227, avg=24.27, stdev=10.25 00:30:49.271 lat (msec): min=4, max=227, avg=24.31, stdev=10.25 00:30:49.271 clat percentiles (msec): 00:30:49.271 | 1.00th=[ 11], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 23], 00:30:49.271 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.271 | 70.00th=[ 25], 80.00th=[ 26], 90.00th=[ 27], 95.00th=[ 28], 00:30:49.271 | 99.00th=[ 37], 99.50th=[ 41], 99.90th=[ 215], 99.95th=[ 228], 00:30:49.271 | 99.99th=[ 228] 00:30:49.271 bw ( KiB/s): min= 2432, max= 3472, per=4.43%, avg=2663.20, stdev=212.10, samples=20 00:30:49.271 iops : min= 608, max= 868, avg=665.80, stdev=53.03, samples=20 00:30:49.271 lat (msec) : 10=0.99%, 20=7.28%, 50=91.49%, 250=0.24% 00:30:49.271 cpu : usr=97.41%, sys=1.53%, ctx=398, majf=0, minf=38 00:30:49.271 IO depths : 1=1.5%, 2=3.1%, 4=11.5%, 8=72.2%, 16=11.7%, 32=0.0%, >=64=0.0% 00:30:49.271 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 complete : 0=0.0%, 4=90.7%, 8=4.4%, 16=4.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 issued rwts: total=6674,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.271 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.271 filename2: (groupid=0, jobs=1): err= 0: pid=3604526: Mon Jul 22 20:36:19 2024 00:30:49.271 read: IOPS=638, BW=2555KiB/s (2616kB/s)(25.4MiB/10170msec) 00:30:49.271 slat (usec): min=6, max=119, avg=52.53, stdev=16.80 00:30:49.271 clat (msec): min=20, max=228, avg=24.59, stdev=10.36 00:30:49.271 lat (msec): min=20, max=228, avg=24.64, stdev=10.36 00:30:49.271 clat percentiles (msec): 00:30:49.271 | 1.00th=[ 22], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 23], 00:30:49.271 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 24], 60.00th=[ 25], 00:30:49.271 | 70.00th=[ 25], 80.00th=[ 25], 90.00th=[ 26], 95.00th=[ 27], 00:30:49.271 | 99.00th=[ 28], 99.50th=[ 40], 99.90th=[ 228], 99.95th=[ 230], 00:30:49.271 | 99.99th=[ 230] 00:30:49.271 bw ( KiB/s): min= 2304, max= 2688, per=4.30%, avg=2590.85, stdev=130.15, samples=20 00:30:49.271 iops : min= 576, max= 672, avg=647.60, stdev=32.53, samples=20 00:30:49.271 lat (msec) : 50=99.51%, 100=0.25%, 250=0.25% 00:30:49.271 cpu : usr=99.15%, sys=0.44%, ctx=28, majf=0, minf=33 00:30:49.271 IO depths : 1=6.2%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.3%, 32=0.0%, >=64=0.0% 00:30:49.271 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:49.271 issued rwts: total=6496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:49.271 latency : target=0, window=0, percentile=100.00%, depth=16 00:30:49.271 00:30:49.271 Run status group 0 (all jobs): 00:30:49.271 READ: bw=58.8MiB/s (61.6MB/s), 2286KiB/s-2683KiB/s (2341kB/s-2747kB/s), io=601MiB (630MB), run=10001-10221msec 00:30:49.271 20:36:19 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:30:49.271 20:36:19 -- target/dif.sh@43 -- # local sub 00:30:49.271 20:36:19 -- target/dif.sh@45 -- # for sub in "$@" 00:30:49.271 20:36:19 -- target/dif.sh@46 -- # destroy_subsystem 0 00:30:49.271 20:36:19 -- target/dif.sh@36 -- # local sub_id=0 00:30:49.271 20:36:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:30:49.271 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.271 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.271 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.271 20:36:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:30:49.271 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.271 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.271 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.271 20:36:19 -- target/dif.sh@45 -- # for sub in "$@" 00:30:49.271 20:36:19 -- target/dif.sh@46 -- # destroy_subsystem 1 00:30:49.271 20:36:19 -- target/dif.sh@36 -- # local sub_id=1 00:30:49.271 20:36:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:49.271 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.271 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.271 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.271 20:36:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:30:49.271 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.271 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.271 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.271 20:36:19 -- target/dif.sh@45 -- # for sub in "$@" 00:30:49.271 20:36:19 -- target/dif.sh@46 -- # destroy_subsystem 2 00:30:49.271 20:36:19 -- target/dif.sh@36 -- # local sub_id=2 00:30:49.271 20:36:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:30:49.271 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.271 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.271 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.271 20:36:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:30:49.271 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.271 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.271 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.271 20:36:19 -- target/dif.sh@115 -- # NULL_DIF=1 00:30:49.271 20:36:19 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:30:49.271 20:36:19 -- target/dif.sh@115 -- # numjobs=2 00:30:49.271 20:36:19 -- target/dif.sh@115 -- # iodepth=8 00:30:49.272 20:36:19 -- target/dif.sh@115 -- # runtime=5 00:30:49.272 20:36:19 -- target/dif.sh@115 -- # files=1 00:30:49.272 20:36:19 -- target/dif.sh@117 -- # create_subsystems 0 1 00:30:49.272 20:36:19 -- target/dif.sh@28 -- # local sub 00:30:49.272 20:36:19 -- target/dif.sh@30 -- # for sub in "$@" 00:30:49.272 20:36:19 -- target/dif.sh@31 -- # create_subsystem 0 00:30:49.272 20:36:19 -- target/dif.sh@18 -- # local sub_id=0 00:30:49.272 20:36:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:30:49.272 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.272 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.272 bdev_null0 00:30:49.272 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.272 20:36:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:49.272 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.272 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.272 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.272 20:36:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:49.272 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.272 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.272 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.272 20:36:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:49.272 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.272 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.272 [2024-07-22 20:36:19.339304] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:49.272 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.272 20:36:19 -- target/dif.sh@30 -- # for sub in "$@" 00:30:49.272 20:36:19 -- target/dif.sh@31 -- # create_subsystem 1 00:30:49.272 20:36:19 -- target/dif.sh@18 -- # local sub_id=1 00:30:49.272 20:36:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:30:49.272 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.272 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.272 bdev_null1 00:30:49.272 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.272 20:36:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:30:49.272 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.272 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.272 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.272 20:36:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:30:49.272 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.272 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.272 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.272 20:36:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:49.272 20:36:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.272 20:36:19 -- common/autotest_common.sh@10 -- # set +x 00:30:49.272 20:36:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.272 20:36:19 -- target/dif.sh@118 -- # fio /dev/fd/62 00:30:49.272 20:36:19 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:30:49.272 20:36:19 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:30:49.272 20:36:19 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:49.272 20:36:19 -- nvmf/common.sh@520 -- # config=() 00:30:49.272 20:36:19 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:49.272 20:36:19 -- nvmf/common.sh@520 -- # local subsystem config 00:30:49.272 20:36:19 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:30:49.272 20:36:19 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:49.272 20:36:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:49.272 20:36:19 -- common/autotest_common.sh@1318 -- # local sanitizers 00:30:49.272 20:36:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:49.272 { 00:30:49.272 "params": { 00:30:49.272 "name": "Nvme$subsystem", 00:30:49.272 "trtype": "$TEST_TRANSPORT", 00:30:49.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:49.272 "adrfam": "ipv4", 00:30:49.272 "trsvcid": "$NVMF_PORT", 00:30:49.272 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:49.272 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:49.272 "hdgst": ${hdgst:-false}, 00:30:49.272 "ddgst": ${ddgst:-false} 00:30:49.272 }, 00:30:49.272 "method": "bdev_nvme_attach_controller" 00:30:49.272 } 00:30:49.272 EOF 00:30:49.272 )") 00:30:49.272 20:36:19 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:49.272 20:36:19 -- common/autotest_common.sh@1320 -- # shift 00:30:49.272 20:36:19 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:30:49.272 20:36:19 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:49.272 20:36:19 -- target/dif.sh@82 -- # gen_fio_conf 00:30:49.272 20:36:19 -- target/dif.sh@54 -- # local file 00:30:49.272 20:36:19 -- target/dif.sh@56 -- # cat 00:30:49.272 20:36:19 -- nvmf/common.sh@542 -- # cat 00:30:49.272 20:36:19 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:49.272 20:36:19 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:49.272 20:36:19 -- common/autotest_common.sh@1324 -- # grep libasan 00:30:49.272 20:36:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:49.272 20:36:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:49.272 { 00:30:49.272 "params": { 00:30:49.272 "name": "Nvme$subsystem", 00:30:49.272 "trtype": "$TEST_TRANSPORT", 00:30:49.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:49.272 "adrfam": "ipv4", 00:30:49.272 "trsvcid": "$NVMF_PORT", 00:30:49.272 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:49.272 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:49.272 "hdgst": ${hdgst:-false}, 00:30:49.272 "ddgst": ${ddgst:-false} 00:30:49.272 }, 00:30:49.272 "method": "bdev_nvme_attach_controller" 00:30:49.272 } 00:30:49.272 EOF 00:30:49.272 )") 00:30:49.272 20:36:19 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:49.272 20:36:19 -- target/dif.sh@72 -- # (( file <= files )) 00:30:49.272 20:36:19 -- target/dif.sh@73 -- # cat 00:30:49.272 20:36:19 -- nvmf/common.sh@542 -- # cat 00:30:49.272 20:36:19 -- target/dif.sh@72 -- # (( file++ )) 00:30:49.272 20:36:19 -- target/dif.sh@72 -- # (( file <= files )) 00:30:49.272 20:36:19 -- nvmf/common.sh@544 -- # jq . 00:30:49.272 20:36:19 -- nvmf/common.sh@545 -- # IFS=, 00:30:49.272 20:36:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:49.272 "params": { 00:30:49.272 "name": "Nvme0", 00:30:49.272 "trtype": "tcp", 00:30:49.272 "traddr": "10.0.0.2", 00:30:49.272 "adrfam": "ipv4", 00:30:49.272 "trsvcid": "4420", 00:30:49.272 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:49.272 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:49.272 "hdgst": false, 00:30:49.272 "ddgst": false 00:30:49.272 }, 00:30:49.272 "method": "bdev_nvme_attach_controller" 00:30:49.272 },{ 00:30:49.272 "params": { 00:30:49.272 "name": "Nvme1", 00:30:49.272 "trtype": "tcp", 00:30:49.272 "traddr": "10.0.0.2", 00:30:49.272 "adrfam": "ipv4", 00:30:49.272 "trsvcid": "4420", 00:30:49.272 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:49.272 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:49.272 "hdgst": false, 00:30:49.272 "ddgst": false 00:30:49.272 }, 00:30:49.272 "method": "bdev_nvme_attach_controller" 00:30:49.272 }' 00:30:49.272 20:36:19 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:49.272 20:36:19 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:49.272 20:36:19 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:49.272 20:36:19 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:49.272 20:36:19 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:30:49.272 20:36:19 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:49.272 20:36:19 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:49.272 20:36:19 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:49.272 20:36:19 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:49.272 20:36:19 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:49.272 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:30:49.272 ... 00:30:49.272 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:30:49.272 ... 00:30:49.272 fio-3.35 00:30:49.272 Starting 4 threads 00:30:49.272 EAL: No free 2048 kB hugepages reported on node 1 00:30:49.272 [2024-07-22 20:36:20.473591] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:49.272 [2024-07-22 20:36:20.473638] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:30:54.541 00:30:54.541 filename0: (groupid=0, jobs=1): err= 0: pid=3606871: Mon Jul 22 20:36:25 2024 00:30:54.541 read: IOPS=2887, BW=22.6MiB/s (23.7MB/s)(113MiB/5001msec) 00:30:54.541 slat (nsec): min=6155, max=81032, avg=8485.51, stdev=2622.12 00:30:54.541 clat (usec): min=1193, max=4971, avg=2749.30, stdev=455.44 00:30:54.541 lat (usec): min=1200, max=4982, avg=2757.79, stdev=455.43 00:30:54.541 clat percentiles (usec): 00:30:54.541 | 1.00th=[ 1663], 5.00th=[ 2024], 10.00th=[ 2212], 20.00th=[ 2376], 00:30:54.541 | 30.00th=[ 2507], 40.00th=[ 2638], 50.00th=[ 2737], 60.00th=[ 2868], 00:30:54.541 | 70.00th=[ 2933], 80.00th=[ 3097], 90.00th=[ 3294], 95.00th=[ 3490], 00:30:54.541 | 99.00th=[ 4015], 99.50th=[ 4228], 99.90th=[ 4621], 99.95th=[ 4817], 00:30:54.541 | 99.99th=[ 4948] 00:30:54.541 bw ( KiB/s): min=22704, max=23936, per=27.16%, avg=23153.78, stdev=403.70, samples=9 00:30:54.541 iops : min= 2838, max= 2992, avg=2894.22, stdev=50.46, samples=9 00:30:54.541 lat (msec) : 2=4.49%, 4=94.49%, 10=1.02% 00:30:54.541 cpu : usr=96.48%, sys=3.20%, ctx=7, majf=0, minf=32 00:30:54.541 IO depths : 1=0.1%, 2=1.2%, 4=65.7%, 8=33.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:54.541 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:54.541 complete : 0=0.0%, 4=96.3%, 8=3.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:54.541 issued rwts: total=14440,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:54.541 latency : target=0, window=0, percentile=100.00%, depth=8 00:30:54.541 filename0: (groupid=0, jobs=1): err= 0: pid=3606872: Mon Jul 22 20:36:25 2024 00:30:54.541 read: IOPS=2862, BW=22.4MiB/s (23.5MB/s)(112MiB/5002msec) 00:30:54.541 slat (nsec): min=6115, max=25927, avg=8703.65, stdev=2707.80 00:30:54.541 clat (usec): min=1212, max=45503, avg=2771.79, stdev=1103.23 00:30:54.541 lat (usec): min=1222, max=45529, avg=2780.50, stdev=1103.26 00:30:54.541 clat percentiles (usec): 00:30:54.541 | 1.00th=[ 1762], 5.00th=[ 2057], 10.00th=[ 2180], 20.00th=[ 2376], 00:30:54.542 | 30.00th=[ 2507], 40.00th=[ 2638], 50.00th=[ 2737], 60.00th=[ 2868], 00:30:54.542 | 70.00th=[ 2966], 80.00th=[ 3130], 90.00th=[ 3326], 95.00th=[ 3523], 00:30:54.542 | 99.00th=[ 3884], 99.50th=[ 4015], 99.90th=[ 4424], 99.95th=[45351], 00:30:54.542 | 99.99th=[45351] 00:30:54.542 bw ( KiB/s): min=20656, max=23616, per=26.73%, avg=22789.33, stdev=941.22, samples=9 00:30:54.542 iops : min= 2582, max= 2952, avg=2848.67, stdev=117.65, samples=9 00:30:54.542 lat (msec) : 2=3.67%, 4=95.80%, 10=0.48%, 50=0.06% 00:30:54.542 cpu : usr=96.76%, sys=2.90%, ctx=6, majf=0, minf=35 00:30:54.542 IO depths : 1=0.2%, 2=1.5%, 4=65.8%, 8=32.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:54.542 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:54.542 complete : 0=0.0%, 4=96.0%, 8=4.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:54.542 issued rwts: total=14319,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:54.542 latency : target=0, window=0, percentile=100.00%, depth=8 00:30:54.542 filename1: (groupid=0, jobs=1): err= 0: pid=3606873: Mon Jul 22 20:36:25 2024 00:30:54.542 read: IOPS=2745, BW=21.5MiB/s (22.5MB/s)(107MiB/5002msec) 00:30:54.542 slat (nsec): min=6175, max=26742, avg=8593.53, stdev=2568.78 00:30:54.542 clat (usec): min=1453, max=44547, avg=2891.57, stdev=1103.82 00:30:54.542 lat (usec): min=1460, max=44564, avg=2900.16, stdev=1103.78 00:30:54.542 clat percentiles (usec): 00:30:54.542 | 1.00th=[ 1942], 5.00th=[ 2147], 10.00th=[ 2278], 20.00th=[ 2474], 00:30:54.542 | 30.00th=[ 2638], 40.00th=[ 2737], 50.00th=[ 2868], 60.00th=[ 2933], 00:30:54.542 | 70.00th=[ 3097], 80.00th=[ 3228], 90.00th=[ 3458], 95.00th=[ 3654], 00:30:54.542 | 99.00th=[ 4113], 99.50th=[ 4359], 99.90th=[ 5014], 99.95th=[44303], 00:30:54.542 | 99.99th=[44303] 00:30:54.542 bw ( KiB/s): min=20400, max=22544, per=25.76%, avg=21964.80, stdev=591.44, samples=10 00:30:54.542 iops : min= 2550, max= 2818, avg=2745.60, stdev=73.93, samples=10 00:30:54.542 lat (msec) : 2=1.81%, 4=96.60%, 10=1.53%, 50=0.06% 00:30:54.542 cpu : usr=96.38%, sys=3.28%, ctx=6, majf=0, minf=51 00:30:54.542 IO depths : 1=0.1%, 2=1.3%, 4=65.8%, 8=32.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:54.542 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:54.542 complete : 0=0.0%, 4=96.1%, 8=3.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:54.542 issued rwts: total=13735,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:54.542 latency : target=0, window=0, percentile=100.00%, depth=8 00:30:54.542 filename1: (groupid=0, jobs=1): err= 0: pid=3606874: Mon Jul 22 20:36:25 2024 00:30:54.542 read: IOPS=2160, BW=16.9MiB/s (17.7MB/s)(84.4MiB/5002msec) 00:30:54.542 slat (nsec): min=6179, max=24328, avg=8555.35, stdev=2617.95 00:30:54.542 clat (usec): min=1946, max=10481, avg=3680.02, stdev=722.01 00:30:54.542 lat (usec): min=1952, max=10498, avg=3688.58, stdev=721.99 00:30:54.542 clat percentiles (usec): 00:30:54.542 | 1.00th=[ 2376], 5.00th=[ 2671], 10.00th=[ 2900], 20.00th=[ 3097], 00:30:54.542 | 30.00th=[ 3261], 40.00th=[ 3425], 50.00th=[ 3589], 60.00th=[ 3752], 00:30:54.542 | 70.00th=[ 3949], 80.00th=[ 4228], 90.00th=[ 4621], 95.00th=[ 4948], 00:30:54.542 | 99.00th=[ 5669], 99.50th=[ 6194], 99.90th=[ 7898], 99.95th=[ 9896], 00:30:54.542 | 99.99th=[10421] 00:30:54.542 bw ( KiB/s): min=17008, max=17504, per=20.25%, avg=17262.22, stdev=180.74, samples=9 00:30:54.542 iops : min= 2126, max= 2188, avg=2157.78, stdev=22.59, samples=9 00:30:54.542 lat (msec) : 2=0.04%, 4=72.19%, 10=27.75%, 20=0.02% 00:30:54.542 cpu : usr=96.56%, sys=3.12%, ctx=9, majf=0, minf=63 00:30:54.542 IO depths : 1=0.1%, 2=1.7%, 4=66.1%, 8=32.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:30:54.542 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:54.542 complete : 0=0.0%, 4=95.1%, 8=4.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:54.542 issued rwts: total=10807,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:54.542 latency : target=0, window=0, percentile=100.00%, depth=8 00:30:54.542 00:30:54.542 Run status group 0 (all jobs): 00:30:54.542 READ: bw=83.2MiB/s (87.3MB/s), 16.9MiB/s-22.6MiB/s (17.7MB/s-23.7MB/s), io=416MiB (437MB), run=5001-5002msec 00:30:54.542 20:36:25 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:30:54.542 20:36:25 -- target/dif.sh@43 -- # local sub 00:30:54.542 20:36:25 -- target/dif.sh@45 -- # for sub in "$@" 00:30:54.542 20:36:25 -- target/dif.sh@46 -- # destroy_subsystem 0 00:30:54.542 20:36:25 -- target/dif.sh@36 -- # local sub_id=0 00:30:54.542 20:36:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:30:54.542 20:36:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 20:36:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:54.542 20:36:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:30:54.542 20:36:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 20:36:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:54.542 20:36:25 -- target/dif.sh@45 -- # for sub in "$@" 00:30:54.542 20:36:25 -- target/dif.sh@46 -- # destroy_subsystem 1 00:30:54.542 20:36:25 -- target/dif.sh@36 -- # local sub_id=1 00:30:54.542 20:36:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:54.542 20:36:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 20:36:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:54.542 20:36:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:30:54.542 20:36:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 20:36:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:54.542 00:30:54.542 real 0m24.609s 00:30:54.542 user 4m53.830s 00:30:54.542 sys 0m5.176s 00:30:54.542 20:36:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 ************************************ 00:30:54.542 END TEST fio_dif_rand_params 00:30:54.542 ************************************ 00:30:54.542 20:36:25 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:30:54.542 20:36:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:54.542 20:36:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 ************************************ 00:30:54.542 START TEST fio_dif_digest 00:30:54.542 ************************************ 00:30:54.542 20:36:25 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:30:54.542 20:36:25 -- target/dif.sh@123 -- # local NULL_DIF 00:30:54.542 20:36:25 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:30:54.542 20:36:25 -- target/dif.sh@125 -- # local hdgst ddgst 00:30:54.542 20:36:25 -- target/dif.sh@127 -- # NULL_DIF=3 00:30:54.542 20:36:25 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:30:54.542 20:36:25 -- target/dif.sh@127 -- # numjobs=3 00:30:54.542 20:36:25 -- target/dif.sh@127 -- # iodepth=3 00:30:54.542 20:36:25 -- target/dif.sh@127 -- # runtime=10 00:30:54.542 20:36:25 -- target/dif.sh@128 -- # hdgst=true 00:30:54.542 20:36:25 -- target/dif.sh@128 -- # ddgst=true 00:30:54.542 20:36:25 -- target/dif.sh@130 -- # create_subsystems 0 00:30:54.542 20:36:25 -- target/dif.sh@28 -- # local sub 00:30:54.542 20:36:25 -- target/dif.sh@30 -- # for sub in "$@" 00:30:54.542 20:36:25 -- target/dif.sh@31 -- # create_subsystem 0 00:30:54.542 20:36:25 -- target/dif.sh@18 -- # local sub_id=0 00:30:54.542 20:36:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:30:54.542 20:36:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 bdev_null0 00:30:54.542 20:36:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:54.542 20:36:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:54.542 20:36:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 20:36:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:54.542 20:36:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:54.542 20:36:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 20:36:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:54.542 20:36:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:54.542 20:36:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:54.542 20:36:25 -- common/autotest_common.sh@10 -- # set +x 00:30:54.542 [2024-07-22 20:36:25.895556] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:54.542 20:36:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:54.542 20:36:25 -- target/dif.sh@131 -- # fio /dev/fd/62 00:30:54.542 20:36:25 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:30:54.542 20:36:25 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:30:54.542 20:36:25 -- nvmf/common.sh@520 -- # config=() 00:30:54.542 20:36:25 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:54.542 20:36:25 -- nvmf/common.sh@520 -- # local subsystem config 00:30:54.542 20:36:25 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:54.542 20:36:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:54.542 20:36:25 -- target/dif.sh@82 -- # gen_fio_conf 00:30:54.542 20:36:25 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:30:54.542 20:36:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:54.542 { 00:30:54.542 "params": { 00:30:54.542 "name": "Nvme$subsystem", 00:30:54.542 "trtype": "$TEST_TRANSPORT", 00:30:54.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:54.542 "adrfam": "ipv4", 00:30:54.542 "trsvcid": "$NVMF_PORT", 00:30:54.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:54.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:54.542 "hdgst": ${hdgst:-false}, 00:30:54.542 "ddgst": ${ddgst:-false} 00:30:54.542 }, 00:30:54.542 "method": "bdev_nvme_attach_controller" 00:30:54.542 } 00:30:54.542 EOF 00:30:54.542 )") 00:30:54.542 20:36:25 -- target/dif.sh@54 -- # local file 00:30:54.542 20:36:25 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:54.542 20:36:25 -- target/dif.sh@56 -- # cat 00:30:54.542 20:36:25 -- common/autotest_common.sh@1318 -- # local sanitizers 00:30:54.543 20:36:25 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:54.543 20:36:25 -- common/autotest_common.sh@1320 -- # shift 00:30:54.543 20:36:25 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:30:54.543 20:36:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:54.543 20:36:25 -- nvmf/common.sh@542 -- # cat 00:30:54.543 20:36:25 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:54.543 20:36:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:54.543 20:36:25 -- target/dif.sh@72 -- # (( file <= files )) 00:30:54.543 20:36:25 -- common/autotest_common.sh@1324 -- # grep libasan 00:30:54.543 20:36:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:54.543 20:36:25 -- nvmf/common.sh@544 -- # jq . 00:30:54.543 20:36:25 -- nvmf/common.sh@545 -- # IFS=, 00:30:54.543 20:36:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:54.543 "params": { 00:30:54.543 "name": "Nvme0", 00:30:54.543 "trtype": "tcp", 00:30:54.543 "traddr": "10.0.0.2", 00:30:54.543 "adrfam": "ipv4", 00:30:54.543 "trsvcid": "4420", 00:30:54.543 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:54.543 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:54.543 "hdgst": true, 00:30:54.543 "ddgst": true 00:30:54.543 }, 00:30:54.543 "method": "bdev_nvme_attach_controller" 00:30:54.543 }' 00:30:54.543 20:36:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:54.543 20:36:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:54.543 20:36:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:54.543 20:36:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:54.543 20:36:25 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:30:54.543 20:36:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:54.543 20:36:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:54.543 20:36:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:54.543 20:36:25 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:54.543 20:36:25 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:54.543 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:30:54.543 ... 00:30:54.543 fio-3.35 00:30:54.543 Starting 3 threads 00:30:54.543 EAL: No free 2048 kB hugepages reported on node 1 00:30:54.810 [2024-07-22 20:36:26.645117] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:54.810 [2024-07-22 20:36:26.645164] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:07.086 00:31:07.086 filename0: (groupid=0, jobs=1): err= 0: pid=3607952: Mon Jul 22 20:36:36 2024 00:31:07.086 read: IOPS=298, BW=37.3MiB/s (39.1MB/s)(375MiB/10046msec) 00:31:07.086 slat (nsec): min=7180, max=49687, avg=17459.31, stdev=5627.33 00:31:07.086 clat (usec): min=4579, max=55641, avg=10020.43, stdev=6529.15 00:31:07.086 lat (usec): min=4591, max=55662, avg=10037.89, stdev=6530.04 00:31:07.086 clat percentiles (usec): 00:31:07.086 | 1.00th=[ 5014], 5.00th=[ 5407], 10.00th=[ 6063], 20.00th=[ 7046], 00:31:07.086 | 30.00th=[ 7570], 40.00th=[ 8291], 50.00th=[ 9241], 60.00th=[10159], 00:31:07.086 | 70.00th=[10814], 80.00th=[11469], 90.00th=[12125], 95.00th=[13042], 00:31:07.086 | 99.00th=[53216], 99.50th=[53740], 99.90th=[55313], 99.95th=[55313], 00:31:07.086 | 99.99th=[55837] 00:31:07.086 bw ( KiB/s): min=28416, max=47616, per=40.36%, avg=38336.00, stdev=5753.71, samples=20 00:31:07.086 iops : min= 222, max= 372, avg=299.50, stdev=44.95, samples=20 00:31:07.086 lat (msec) : 10=57.26%, 20=40.67%, 50=0.13%, 100=1.94% 00:31:07.086 cpu : usr=96.46%, sys=3.17%, ctx=18, majf=0, minf=85 00:31:07.086 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:07.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:07.086 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:07.086 issued rwts: total=2997,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:07.086 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:07.086 filename0: (groupid=0, jobs=1): err= 0: pid=3607953: Mon Jul 22 20:36:36 2024 00:31:07.086 read: IOPS=259, BW=32.5MiB/s (34.0MB/s)(326MiB/10046msec) 00:31:07.086 slat (nsec): min=4635, max=68636, avg=18177.44, stdev=8412.48 00:31:07.086 clat (usec): min=4968, max=94089, avg=11513.81, stdev=9063.88 00:31:07.086 lat (usec): min=4976, max=94097, avg=11531.99, stdev=9064.18 00:31:07.086 clat percentiles (usec): 00:31:07.086 | 1.00th=[ 5538], 5.00th=[ 7046], 10.00th=[ 7767], 20.00th=[ 8225], 00:31:07.086 | 30.00th=[ 8717], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10290], 00:31:07.086 | 70.00th=[10683], 80.00th=[11338], 90.00th=[12387], 95.00th=[14091], 00:31:07.086 | 99.00th=[54789], 99.50th=[55313], 99.90th=[57934], 99.95th=[93848], 00:31:07.086 | 99.99th=[93848] 00:31:07.086 bw ( KiB/s): min=17920, max=45568, per=35.13%, avg=33369.60, stdev=7266.58, samples=20 00:31:07.086 iops : min= 140, max= 356, avg=260.70, stdev=56.77, samples=20 00:31:07.086 lat (msec) : 10=54.62%, 20=41.24%, 50=0.15%, 100=3.99% 00:31:07.086 cpu : usr=96.16%, sys=3.50%, ctx=21, majf=0, minf=180 00:31:07.086 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:07.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:07.086 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:07.086 issued rwts: total=2609,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:07.086 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:07.086 filename0: (groupid=0, jobs=1): err= 0: pid=3607954: Mon Jul 22 20:36:36 2024 00:31:07.086 read: IOPS=183, BW=23.0MiB/s (24.1MB/s)(231MiB/10044msec) 00:31:07.086 slat (nsec): min=6480, max=43523, avg=17372.61, stdev=7848.88 00:31:07.086 clat (usec): min=4872, max=97671, avg=16282.60, stdev=14960.24 00:31:07.086 lat (usec): min=4880, max=97695, avg=16299.98, stdev=14960.23 00:31:07.086 clat percentiles (usec): 00:31:07.086 | 1.00th=[ 6194], 5.00th=[ 7439], 10.00th=[ 8160], 20.00th=[ 9372], 00:31:07.086 | 30.00th=[10421], 40.00th=[11076], 50.00th=[11469], 60.00th=[11863], 00:31:07.086 | 70.00th=[12256], 80.00th=[13042], 90.00th=[51643], 95.00th=[53740], 00:31:07.086 | 99.00th=[56361], 99.50th=[92799], 99.90th=[95945], 99.95th=[98042], 00:31:07.086 | 99.99th=[98042] 00:31:07.086 bw ( KiB/s): min=15104, max=31744, per=24.87%, avg=23616.00, stdev=4298.07, samples=20 00:31:07.086 iops : min= 118, max= 248, avg=184.50, stdev=33.58, samples=20 00:31:07.086 lat (msec) : 10=25.00%, 20=62.55%, 50=0.60%, 100=11.85% 00:31:07.086 cpu : usr=97.20%, sys=2.46%, ctx=15, majf=0, minf=138 00:31:07.086 IO depths : 1=0.6%, 2=99.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:07.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:07.086 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:07.086 issued rwts: total=1848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:07.086 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:07.086 00:31:07.086 Run status group 0 (all jobs): 00:31:07.086 READ: bw=92.7MiB/s (97.3MB/s), 23.0MiB/s-37.3MiB/s (24.1MB/s-39.1MB/s), io=932MiB (977MB), run=10044-10046msec 00:31:07.086 20:36:36 -- target/dif.sh@132 -- # destroy_subsystems 0 00:31:07.086 20:36:36 -- target/dif.sh@43 -- # local sub 00:31:07.086 20:36:36 -- target/dif.sh@45 -- # for sub in "$@" 00:31:07.086 20:36:36 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:07.086 20:36:36 -- target/dif.sh@36 -- # local sub_id=0 00:31:07.086 20:36:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:07.086 20:36:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:07.086 20:36:36 -- common/autotest_common.sh@10 -- # set +x 00:31:07.086 20:36:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:07.086 20:36:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:07.086 20:36:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:07.086 20:36:36 -- common/autotest_common.sh@10 -- # set +x 00:31:07.086 20:36:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:07.086 00:31:07.086 real 0m11.143s 00:31:07.086 user 0m35.794s 00:31:07.086 sys 0m1.208s 00:31:07.086 20:36:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:07.086 20:36:37 -- common/autotest_common.sh@10 -- # set +x 00:31:07.086 ************************************ 00:31:07.086 END TEST fio_dif_digest 00:31:07.086 ************************************ 00:31:07.086 20:36:37 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:31:07.086 20:36:37 -- target/dif.sh@147 -- # nvmftestfini 00:31:07.086 20:36:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:07.086 20:36:37 -- nvmf/common.sh@116 -- # sync 00:31:07.086 20:36:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:07.086 20:36:37 -- nvmf/common.sh@119 -- # set +e 00:31:07.086 20:36:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:07.086 20:36:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:07.086 rmmod nvme_tcp 00:31:07.086 rmmod nvme_fabrics 00:31:07.086 rmmod nvme_keyring 00:31:07.086 20:36:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:07.086 20:36:37 -- nvmf/common.sh@123 -- # set -e 00:31:07.086 20:36:37 -- nvmf/common.sh@124 -- # return 0 00:31:07.086 20:36:37 -- nvmf/common.sh@477 -- # '[' -n 3598686 ']' 00:31:07.086 20:36:37 -- nvmf/common.sh@478 -- # killprocess 3598686 00:31:07.086 20:36:37 -- common/autotest_common.sh@926 -- # '[' -z 3598686 ']' 00:31:07.086 20:36:37 -- common/autotest_common.sh@930 -- # kill -0 3598686 00:31:07.086 20:36:37 -- common/autotest_common.sh@931 -- # uname 00:31:07.086 20:36:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:07.086 20:36:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3598686 00:31:07.086 20:36:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:31:07.086 20:36:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:31:07.086 20:36:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3598686' 00:31:07.086 killing process with pid 3598686 00:31:07.086 20:36:37 -- common/autotest_common.sh@945 -- # kill 3598686 00:31:07.086 20:36:37 -- common/autotest_common.sh@950 -- # wait 3598686 00:31:07.086 20:36:37 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:31:07.086 20:36:37 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:31:08.022 Waiting for block devices as requested 00:31:08.022 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:31:08.282 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:08.282 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:08.282 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:08.542 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:08.542 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:08.542 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:08.542 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:08.802 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:08.802 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:08.802 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:08.802 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:09.062 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:09.062 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:09.062 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:09.321 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:09.321 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:09.321 20:36:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:09.321 20:36:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:09.321 20:36:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:09.321 20:36:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:09.321 20:36:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:09.321 20:36:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:09.321 20:36:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:11.860 20:36:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:11.860 00:31:11.860 real 1m13.183s 00:31:11.860 user 7m11.889s 00:31:11.860 sys 0m18.436s 00:31:11.860 20:36:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:11.860 20:36:43 -- common/autotest_common.sh@10 -- # set +x 00:31:11.860 ************************************ 00:31:11.860 END TEST nvmf_dif 00:31:11.860 ************************************ 00:31:11.860 20:36:43 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:31:11.860 20:36:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:11.860 20:36:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:11.860 20:36:43 -- common/autotest_common.sh@10 -- # set +x 00:31:11.860 ************************************ 00:31:11.860 START TEST nvmf_abort_qd_sizes 00:31:11.860 ************************************ 00:31:11.860 20:36:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:31:11.860 * Looking for test storage... 00:31:11.860 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:11.860 20:36:43 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:11.860 20:36:43 -- nvmf/common.sh@7 -- # uname -s 00:31:11.860 20:36:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:11.860 20:36:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:11.860 20:36:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:11.860 20:36:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:11.860 20:36:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:11.860 20:36:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:11.860 20:36:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:11.860 20:36:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:11.860 20:36:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:11.860 20:36:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:11.860 20:36:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 00:31:11.860 20:36:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=80aaeb9f-0274-ea11-906e-0017a4403562 00:31:11.860 20:36:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:11.860 20:36:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:11.860 20:36:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:11.860 20:36:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:11.860 20:36:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:11.860 20:36:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:11.860 20:36:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:11.860 20:36:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:11.860 20:36:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:11.860 20:36:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:11.860 20:36:43 -- paths/export.sh@5 -- # export PATH 00:31:11.860 20:36:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:11.860 20:36:43 -- nvmf/common.sh@46 -- # : 0 00:31:11.860 20:36:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:11.860 20:36:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:11.860 20:36:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:11.860 20:36:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:11.860 20:36:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:11.860 20:36:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:11.860 20:36:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:11.860 20:36:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:11.860 20:36:43 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:31:11.860 20:36:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:11.860 20:36:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:11.860 20:36:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:11.860 20:36:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:11.860 20:36:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:11.860 20:36:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:11.860 20:36:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:11.860 20:36:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:11.860 20:36:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:11.860 20:36:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:11.860 20:36:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:11.860 20:36:43 -- common/autotest_common.sh@10 -- # set +x 00:31:17.140 20:36:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:17.140 20:36:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:17.140 20:36:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:17.140 20:36:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:17.140 20:36:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:17.140 20:36:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:17.140 20:36:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:17.140 20:36:48 -- nvmf/common.sh@294 -- # net_devs=() 00:31:17.140 20:36:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:17.140 20:36:48 -- nvmf/common.sh@295 -- # e810=() 00:31:17.140 20:36:48 -- nvmf/common.sh@295 -- # local -ga e810 00:31:17.140 20:36:48 -- nvmf/common.sh@296 -- # x722=() 00:31:17.140 20:36:48 -- nvmf/common.sh@296 -- # local -ga x722 00:31:17.140 20:36:48 -- nvmf/common.sh@297 -- # mlx=() 00:31:17.140 20:36:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:17.140 20:36:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:17.140 20:36:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:17.140 20:36:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:17.140 20:36:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:17.140 20:36:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:17.140 20:36:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.0 (0x8086 - 0x159b)' 00:31:17.140 Found 0000:86:00.0 (0x8086 - 0x159b) 00:31:17.140 20:36:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:17.140 20:36:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:86:00.1 (0x8086 - 0x159b)' 00:31:17.140 Found 0000:86:00.1 (0x8086 - 0x159b) 00:31:17.140 20:36:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:17.140 20:36:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:17.140 20:36:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:17.140 20:36:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:17.140 20:36:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:17.140 20:36:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.0: cvl_0_0' 00:31:17.140 Found net devices under 0000:86:00.0: cvl_0_0 00:31:17.140 20:36:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:17.140 20:36:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:17.140 20:36:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:17.140 20:36:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:17.140 20:36:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:17.140 20:36:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:86:00.1: cvl_0_1' 00:31:17.140 Found net devices under 0000:86:00.1: cvl_0_1 00:31:17.140 20:36:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:17.140 20:36:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:17.140 20:36:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:17.140 20:36:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:17.140 20:36:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:17.140 20:36:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:17.140 20:36:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:17.140 20:36:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:17.140 20:36:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:17.140 20:36:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:17.140 20:36:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:17.140 20:36:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:17.140 20:36:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:17.140 20:36:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:17.140 20:36:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:17.140 20:36:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:17.140 20:36:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:17.140 20:36:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:17.140 20:36:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:17.140 20:36:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:17.140 20:36:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:17.140 20:36:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:17.140 20:36:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:17.141 20:36:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:17.141 20:36:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:17.141 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:17.141 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.158 ms 00:31:17.141 00:31:17.141 --- 10.0.0.2 ping statistics --- 00:31:17.141 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:17.141 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:31:17.141 20:36:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:17.141 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:17.141 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.255 ms 00:31:17.141 00:31:17.141 --- 10.0.0.1 ping statistics --- 00:31:17.141 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:17.141 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:31:17.141 20:36:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:17.141 20:36:48 -- nvmf/common.sh@410 -- # return 0 00:31:17.141 20:36:48 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:17.141 20:36:48 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:19.680 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:31:19.680 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:31:19.939 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:31:20.879 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:31:20.879 20:36:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:20.879 20:36:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:20.879 20:36:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:20.879 20:36:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:20.879 20:36:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:20.879 20:36:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:20.879 20:36:52 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:31:20.879 20:36:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:20.879 20:36:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:20.879 20:36:52 -- common/autotest_common.sh@10 -- # set +x 00:31:20.879 20:36:52 -- nvmf/common.sh@469 -- # nvmfpid=3615810 00:31:20.879 20:36:52 -- nvmf/common.sh@470 -- # waitforlisten 3615810 00:31:20.879 20:36:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:31:20.879 20:36:52 -- common/autotest_common.sh@819 -- # '[' -z 3615810 ']' 00:31:20.879 20:36:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:20.879 20:36:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:20.879 20:36:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:20.879 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:20.879 20:36:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:20.879 20:36:52 -- common/autotest_common.sh@10 -- # set +x 00:31:20.879 [2024-07-22 20:36:52.670450] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... 00:31:20.879 [2024-07-22 20:36:52.670501] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:20.879 EAL: No free 2048 kB hugepages reported on node 1 00:31:20.879 [2024-07-22 20:36:52.732105] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:20.879 [2024-07-22 20:36:52.813542] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:20.879 [2024-07-22 20:36:52.813655] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:20.879 [2024-07-22 20:36:52.813663] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:20.879 [2024-07-22 20:36:52.813670] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:20.879 [2024-07-22 20:36:52.813712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:20.879 [2024-07-22 20:36:52.813831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:20.879 [2024-07-22 20:36:52.813856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:20.879 [2024-07-22 20:36:52.813857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:21.817 20:36:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:21.817 20:36:53 -- common/autotest_common.sh@852 -- # return 0 00:31:21.817 20:36:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:21.817 20:36:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:21.817 20:36:53 -- common/autotest_common.sh@10 -- # set +x 00:31:21.817 20:36:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:21.817 20:36:53 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:31:21.817 20:36:53 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:31:21.817 20:36:53 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:31:21.817 20:36:53 -- scripts/common.sh@311 -- # local bdf bdfs 00:31:21.817 20:36:53 -- scripts/common.sh@312 -- # local nvmes 00:31:21.817 20:36:53 -- scripts/common.sh@314 -- # [[ -n 0000:5e:00.0 ]] 00:31:21.817 20:36:53 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:31:21.817 20:36:53 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:31:21.817 20:36:53 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:5e:00.0 ]] 00:31:21.817 20:36:53 -- scripts/common.sh@322 -- # uname -s 00:31:21.817 20:36:53 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:31:21.817 20:36:53 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:31:21.817 20:36:53 -- scripts/common.sh@327 -- # (( 1 )) 00:31:21.817 20:36:53 -- scripts/common.sh@328 -- # printf '%s\n' 0000:5e:00.0 00:31:21.817 20:36:53 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:31:21.817 20:36:53 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:5e:00.0 00:31:21.817 20:36:53 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:31:21.817 20:36:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:21.817 20:36:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:21.817 20:36:53 -- common/autotest_common.sh@10 -- # set +x 00:31:21.817 ************************************ 00:31:21.817 START TEST spdk_target_abort 00:31:21.817 ************************************ 00:31:21.817 20:36:53 -- common/autotest_common.sh@1104 -- # spdk_target 00:31:21.818 20:36:53 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:31:21.818 20:36:53 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:31:21.818 20:36:53 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:5e:00.0 -b spdk_target 00:31:21.818 20:36:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.818 20:36:53 -- common/autotest_common.sh@10 -- # set +x 00:31:25.116 spdk_targetn1 00:31:25.116 20:36:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:25.116 20:36:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:25.116 20:36:56 -- common/autotest_common.sh@10 -- # set +x 00:31:25.116 [2024-07-22 20:36:56.362156] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:25.116 20:36:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:31:25.116 20:36:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:25.116 20:36:56 -- common/autotest_common.sh@10 -- # set +x 00:31:25.116 20:36:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:31:25.116 20:36:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:25.116 20:36:56 -- common/autotest_common.sh@10 -- # set +x 00:31:25.116 20:36:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:31:25.116 20:36:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:25.116 20:36:56 -- common/autotest_common.sh@10 -- # set +x 00:31:25.116 [2024-07-22 20:36:56.391097] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:25.116 20:36:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:31:25.116 20:36:56 -- target/abort_qd_sizes.sh@24 -- # local target r 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:31:25.117 20:36:56 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:31:25.117 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.653 Initializing NVMe Controllers 00:31:27.653 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:31:27.653 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:31:27.653 Initialization complete. Launching workers. 00:31:27.653 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 6812, failed: 0 00:31:27.653 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1711, failed to submit 5101 00:31:27.653 success 909, unsuccess 802, failed 0 00:31:27.653 20:36:59 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:31:27.653 20:36:59 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:31:27.653 EAL: No free 2048 kB hugepages reported on node 1 00:31:30.941 Initializing NVMe Controllers 00:31:30.941 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:31:30.941 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:31:30.941 Initialization complete. Launching workers. 00:31:30.941 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8703, failed: 0 00:31:30.941 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1232, failed to submit 7471 00:31:30.942 success 357, unsuccess 875, failed 0 00:31:30.942 20:37:02 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:31:30.942 20:37:02 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:31:30.942 EAL: No free 2048 kB hugepages reported on node 1 00:31:34.305 Initializing NVMe Controllers 00:31:34.305 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:31:34.305 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:31:34.305 Initialization complete. Launching workers. 00:31:34.305 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 36019, failed: 0 00:31:34.305 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2733, failed to submit 33286 00:31:34.305 success 658, unsuccess 2075, failed 0 00:31:34.305 20:37:05 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:31:34.305 20:37:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:34.305 20:37:05 -- common/autotest_common.sh@10 -- # set +x 00:31:34.305 20:37:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:34.305 20:37:05 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:31:34.305 20:37:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:34.305 20:37:05 -- common/autotest_common.sh@10 -- # set +x 00:31:35.683 20:37:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.683 20:37:07 -- target/abort_qd_sizes.sh@62 -- # killprocess 3615810 00:31:35.683 20:37:07 -- common/autotest_common.sh@926 -- # '[' -z 3615810 ']' 00:31:35.683 20:37:07 -- common/autotest_common.sh@930 -- # kill -0 3615810 00:31:35.683 20:37:07 -- common/autotest_common.sh@931 -- # uname 00:31:35.683 20:37:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:35.683 20:37:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3615810 00:31:35.683 20:37:07 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:31:35.683 20:37:07 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:31:35.683 20:37:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3615810' 00:31:35.683 killing process with pid 3615810 00:31:35.683 20:37:07 -- common/autotest_common.sh@945 -- # kill 3615810 00:31:35.683 20:37:07 -- common/autotest_common.sh@950 -- # wait 3615810 00:31:35.683 00:31:35.683 real 0m13.961s 00:31:35.683 user 0m55.582s 00:31:35.683 sys 0m2.114s 00:31:35.683 20:37:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:35.683 20:37:07 -- common/autotest_common.sh@10 -- # set +x 00:31:35.683 ************************************ 00:31:35.683 END TEST spdk_target_abort 00:31:35.683 ************************************ 00:31:35.683 20:37:07 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:31:35.683 20:37:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:35.683 20:37:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:35.683 20:37:07 -- common/autotest_common.sh@10 -- # set +x 00:31:35.683 ************************************ 00:31:35.683 START TEST kernel_target_abort 00:31:35.683 ************************************ 00:31:35.683 20:37:07 -- common/autotest_common.sh@1104 -- # kernel_target 00:31:35.683 20:37:07 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:31:35.683 20:37:07 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:31:35.683 20:37:07 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:31:35.683 20:37:07 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:31:35.683 20:37:07 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:31:35.683 20:37:07 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:31:35.683 20:37:07 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:31:35.683 20:37:07 -- nvmf/common.sh@627 -- # local block nvme 00:31:35.683 20:37:07 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:31:35.683 20:37:07 -- nvmf/common.sh@630 -- # modprobe nvmet 00:31:35.683 20:37:07 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:31:35.683 20:37:07 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:31:38.219 Waiting for block devices as requested 00:31:38.219 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:31:38.478 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:38.478 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:38.478 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:38.478 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:38.738 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:38.738 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:38.738 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:38.738 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:38.997 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:38.997 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:38.997 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:39.255 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:39.255 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:39.255 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:39.255 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:39.515 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:39.515 20:37:11 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:31:39.515 20:37:11 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:31:39.515 20:37:11 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:31:39.515 20:37:11 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:31:39.515 20:37:11 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:31:39.515 No valid GPT data, bailing 00:31:39.515 20:37:11 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:31:39.515 20:37:11 -- scripts/common.sh@393 -- # pt= 00:31:39.515 20:37:11 -- scripts/common.sh@394 -- # return 1 00:31:39.515 20:37:11 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:31:39.515 20:37:11 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:31:39.515 20:37:11 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:31:39.515 20:37:11 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:31:39.515 20:37:11 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:31:39.515 20:37:11 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:31:39.515 20:37:11 -- nvmf/common.sh@654 -- # echo 1 00:31:39.515 20:37:11 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:31:39.515 20:37:11 -- nvmf/common.sh@656 -- # echo 1 00:31:39.515 20:37:11 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:31:39.515 20:37:11 -- nvmf/common.sh@663 -- # echo tcp 00:31:39.515 20:37:11 -- nvmf/common.sh@664 -- # echo 4420 00:31:39.515 20:37:11 -- nvmf/common.sh@665 -- # echo ipv4 00:31:39.515 20:37:11 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:31:39.515 20:37:11 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80aaeb9f-0274-ea11-906e-0017a4403562 --hostid=80aaeb9f-0274-ea11-906e-0017a4403562 -a 10.0.0.1 -t tcp -s 4420 00:31:39.515 00:31:39.515 Discovery Log Number of Records 2, Generation counter 2 00:31:39.515 =====Discovery Log Entry 0====== 00:31:39.515 trtype: tcp 00:31:39.515 adrfam: ipv4 00:31:39.515 subtype: current discovery subsystem 00:31:39.515 treq: not specified, sq flow control disable supported 00:31:39.515 portid: 1 00:31:39.515 trsvcid: 4420 00:31:39.515 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:31:39.515 traddr: 10.0.0.1 00:31:39.515 eflags: none 00:31:39.515 sectype: none 00:31:39.515 =====Discovery Log Entry 1====== 00:31:39.515 trtype: tcp 00:31:39.515 adrfam: ipv4 00:31:39.515 subtype: nvme subsystem 00:31:39.515 treq: not specified, sq flow control disable supported 00:31:39.515 portid: 1 00:31:39.515 trsvcid: 4420 00:31:39.515 subnqn: kernel_target 00:31:39.515 traddr: 10.0.0.1 00:31:39.515 eflags: none 00:31:39.515 sectype: none 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@24 -- # local target r 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:31:39.515 20:37:11 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:31:39.515 EAL: No free 2048 kB hugepages reported on node 1 00:31:42.804 Initializing NVMe Controllers 00:31:42.804 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:31:42.804 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:31:42.804 Initialization complete. Launching workers. 00:31:42.804 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 45402, failed: 0 00:31:42.804 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 45402, failed to submit 0 00:31:42.804 success 0, unsuccess 45402, failed 0 00:31:42.804 20:37:14 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:31:42.804 20:37:14 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:31:42.804 EAL: No free 2048 kB hugepages reported on node 1 00:31:46.093 Initializing NVMe Controllers 00:31:46.093 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:31:46.093 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:31:46.093 Initialization complete. Launching workers. 00:31:46.093 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 88352, failed: 0 00:31:46.093 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 22314, failed to submit 66038 00:31:46.093 success 0, unsuccess 22314, failed 0 00:31:46.093 20:37:17 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:31:46.093 20:37:17 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:31:46.093 EAL: No free 2048 kB hugepages reported on node 1 00:31:49.389 Initializing NVMe Controllers 00:31:49.389 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:31:49.389 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:31:49.389 Initialization complete. Launching workers. 00:31:49.389 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 85739, failed: 0 00:31:49.389 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21410, failed to submit 64329 00:31:49.389 success 0, unsuccess 21410, failed 0 00:31:49.389 20:37:20 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:31:49.389 20:37:20 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:31:49.389 20:37:20 -- nvmf/common.sh@677 -- # echo 0 00:31:49.389 20:37:20 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:31:49.389 20:37:20 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:31:49.389 20:37:20 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:31:49.389 20:37:20 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:31:49.389 20:37:20 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:31:49.389 20:37:20 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:31:49.389 00:31:49.389 real 0m13.106s 00:31:49.389 user 0m4.638s 00:31:49.389 sys 0m3.569s 00:31:49.389 20:37:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:49.389 20:37:20 -- common/autotest_common.sh@10 -- # set +x 00:31:49.389 ************************************ 00:31:49.389 END TEST kernel_target_abort 00:31:49.389 ************************************ 00:31:49.389 20:37:20 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:31:49.389 20:37:20 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:31:49.389 20:37:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:49.389 20:37:20 -- nvmf/common.sh@116 -- # sync 00:31:49.389 20:37:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:49.389 20:37:20 -- nvmf/common.sh@119 -- # set +e 00:31:49.389 20:37:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:49.389 20:37:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:49.389 rmmod nvme_tcp 00:31:49.389 rmmod nvme_fabrics 00:31:49.389 rmmod nvme_keyring 00:31:49.389 20:37:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:49.389 20:37:20 -- nvmf/common.sh@123 -- # set -e 00:31:49.389 20:37:20 -- nvmf/common.sh@124 -- # return 0 00:31:49.389 20:37:20 -- nvmf/common.sh@477 -- # '[' -n 3615810 ']' 00:31:49.389 20:37:20 -- nvmf/common.sh@478 -- # killprocess 3615810 00:31:49.389 20:37:20 -- common/autotest_common.sh@926 -- # '[' -z 3615810 ']' 00:31:49.389 20:37:20 -- common/autotest_common.sh@930 -- # kill -0 3615810 00:31:49.389 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3615810) - No such process 00:31:49.389 20:37:20 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3615810 is not found' 00:31:49.389 Process with pid 3615810 is not found 00:31:49.389 20:37:20 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:31:49.389 20:37:20 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:31:51.296 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:31:51.296 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:31:51.296 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:31:51.296 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:31:51.556 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:31:51.556 20:37:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:51.556 20:37:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:51.556 20:37:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:51.556 20:37:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:51.556 20:37:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:51.556 20:37:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:51.556 20:37:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:54.092 20:37:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:54.092 00:31:54.092 real 0m42.280s 00:31:54.092 user 1m4.102s 00:31:54.092 sys 0m13.797s 00:31:54.092 20:37:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:54.092 20:37:25 -- common/autotest_common.sh@10 -- # set +x 00:31:54.092 ************************************ 00:31:54.092 END TEST nvmf_abort_qd_sizes 00:31:54.092 ************************************ 00:31:54.092 20:37:25 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:31:54.092 20:37:25 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:31:54.092 20:37:25 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:31:54.092 20:37:25 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:31:54.092 20:37:25 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:31:54.092 20:37:25 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:31:54.092 20:37:25 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:31:54.092 20:37:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:54.092 20:37:25 -- common/autotest_common.sh@10 -- # set +x 00:31:54.092 20:37:25 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:31:54.092 20:37:25 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:31:54.092 20:37:25 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:31:54.092 20:37:25 -- common/autotest_common.sh@10 -- # set +x 00:31:58.289 INFO: APP EXITING 00:31:58.289 INFO: killing all VMs 00:31:58.289 INFO: killing vhost app 00:31:58.289 INFO: EXIT DONE 00:32:00.235 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:32:00.235 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:32:00.235 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:32:00.494 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:32:00.494 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:32:00.494 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:32:03.040 Cleaning 00:32:03.040 Removing: /var/run/dpdk/spdk0/config 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:32:03.040 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:32:03.040 Removing: /var/run/dpdk/spdk0/hugepage_info 00:32:03.040 Removing: /var/run/dpdk/spdk1/config 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:32:03.040 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:32:03.040 Removing: /var/run/dpdk/spdk1/hugepage_info 00:32:03.040 Removing: /var/run/dpdk/spdk1/mp_socket 00:32:03.040 Removing: /var/run/dpdk/spdk2/config 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:32:03.040 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:32:03.300 Removing: /var/run/dpdk/spdk2/hugepage_info 00:32:03.300 Removing: /var/run/dpdk/spdk3/config 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:32:03.300 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:32:03.300 Removing: /var/run/dpdk/spdk3/hugepage_info 00:32:03.300 Removing: /var/run/dpdk/spdk4/config 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:32:03.300 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:32:03.300 Removing: /var/run/dpdk/spdk4/hugepage_info 00:32:03.300 Removing: /dev/shm/bdev_svc_trace.1 00:32:03.300 Removing: /dev/shm/nvmf_trace.0 00:32:03.300 Removing: /dev/shm/spdk_tgt_trace.pid3224517 00:32:03.300 Removing: /var/run/dpdk/spdk0 00:32:03.300 Removing: /var/run/dpdk/spdk1 00:32:03.300 Removing: /var/run/dpdk/spdk2 00:32:03.300 Removing: /var/run/dpdk/spdk3 00:32:03.300 Removing: /var/run/dpdk/spdk4 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3222340 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3223443 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3224517 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3225184 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3226709 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3227772 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3228085 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3228480 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3228866 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3229149 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3229411 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3229605 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3229858 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3230705 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3233733 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3233995 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3234269 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3234495 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3234996 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3235008 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3235505 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3235713 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3235862 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3236013 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3236270 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3236377 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3236845 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3237101 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3237389 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3237656 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3237685 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3237956 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3238168 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3238413 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3238623 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3238870 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3239089 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3239332 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3239557 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3239812 00:32:03.300 Removing: /var/run/dpdk/spdk_pid3240017 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3240266 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3240488 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3240753 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3240966 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3241223 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3241444 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3241692 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3241917 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3242166 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3242388 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3242655 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3242876 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3243139 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3243365 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3243626 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3243857 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3244111 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3244336 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3244596 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3244823 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3245076 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3245313 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3245571 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3245808 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3246077 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3246318 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3246587 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3246810 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3247065 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3247301 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3247571 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3247817 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3248118 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3251778 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3333348 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3337743 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3348086 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3353511 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3357689 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3358267 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3366836 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3367091 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3371388 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3377195 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3379743 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3390636 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3399684 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3401374 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3402319 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3418992 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3422793 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3427211 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3428954 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3430826 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3431071 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3431291 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3431439 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3432077 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3434026 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3435083 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3435931 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3441666 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3447083 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3452184 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3488776 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3492643 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3498684 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3500016 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3501575 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3505681 00:32:03.560 Removing: /var/run/dpdk/spdk_pid3509784 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3517241 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3517343 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3522000 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3522233 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3522461 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3523028 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3523269 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3524680 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3526373 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3528007 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3529639 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3531354 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3533126 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3539043 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3539615 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3541361 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3542269 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3548003 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3550802 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3556323 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3562556 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3568326 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3569036 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3569738 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3570403 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3571215 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3571924 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3572632 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3573122 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3577402 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3577647 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3583764 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3583855 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3586104 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3593887 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3593897 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3598960 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3600808 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3602832 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3604159 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3606552 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3607665 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3616474 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3616941 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3617476 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3619753 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3620309 00:32:03.821 Removing: /var/run/dpdk/spdk_pid3620865 00:32:03.821 Clean 00:32:03.821 killing process with pid 3178200 00:32:11.948 killing process with pid 3178197 00:32:11.948 killing process with pid 3178199 00:32:11.948 killing process with pid 3178198 00:32:11.948 20:37:43 -- common/autotest_common.sh@1436 -- # return 0 00:32:11.948 20:37:43 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:32:11.948 20:37:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:11.948 20:37:43 -- common/autotest_common.sh@10 -- # set +x 00:32:11.948 20:37:43 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:32:11.948 20:37:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:11.948 20:37:43 -- common/autotest_common.sh@10 -- # set +x 00:32:11.948 20:37:43 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:32:11.948 20:37:43 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:32:11.948 20:37:43 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:32:11.948 20:37:43 -- spdk/autotest.sh@394 -- # hash lcov 00:32:11.948 20:37:43 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:32:11.948 20:37:43 -- spdk/autotest.sh@396 -- # hostname 00:32:11.948 20:37:43 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-wfp-08 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:32:11.948 geninfo: WARNING: invalid characters removed from testname! 00:32:30.046 20:38:01 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:32:31.953 20:38:03 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:32:33.861 20:38:05 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:32:35.242 20:38:07 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:32:37.150 20:38:08 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:32:38.530 20:38:10 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:32:40.498 20:38:12 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:32:40.498 20:38:12 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:40.498 20:38:12 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:32:40.498 20:38:12 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:40.498 20:38:12 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:40.498 20:38:12 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:40.498 20:38:12 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:40.498 20:38:12 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:40.498 20:38:12 -- paths/export.sh@5 -- $ export PATH 00:32:40.498 20:38:12 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:40.498 20:38:12 -- common/autobuild_common.sh@437 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:32:40.498 20:38:12 -- common/autobuild_common.sh@438 -- $ date +%s 00:32:40.498 20:38:12 -- common/autobuild_common.sh@438 -- $ mktemp -dt spdk_1721673492.XXXXXX 00:32:40.498 20:38:12 -- common/autobuild_common.sh@438 -- $ SPDK_WORKSPACE=/tmp/spdk_1721673492.0Tgml8 00:32:40.498 20:38:12 -- common/autobuild_common.sh@440 -- $ [[ -n '' ]] 00:32:40.498 20:38:12 -- common/autobuild_common.sh@444 -- $ '[' -n '' ']' 00:32:40.498 20:38:12 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:32:40.499 20:38:12 -- common/autobuild_common.sh@451 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:32:40.499 20:38:12 -- common/autobuild_common.sh@453 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:32:40.499 20:38:12 -- common/autobuild_common.sh@454 -- $ get_config_params 00:32:40.499 20:38:12 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:32:40.499 20:38:12 -- common/autotest_common.sh@10 -- $ set +x 00:32:40.499 20:38:12 -- common/autobuild_common.sh@454 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:32:40.499 20:38:12 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j96 00:32:40.499 20:38:12 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:32:40.499 20:38:12 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:32:40.499 20:38:12 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:32:40.499 20:38:12 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:32:40.499 20:38:12 -- spdk/autopackage.sh@19 -- $ timing_finish 00:32:40.499 20:38:12 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:32:40.499 20:38:12 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:32:40.499 20:38:12 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:32:40.499 20:38:12 -- spdk/autopackage.sh@20 -- $ exit 0 00:32:40.499 + [[ -n 3135898 ]] 00:32:40.499 + sudo kill 3135898 00:32:40.509 [Pipeline] } 00:32:40.527 [Pipeline] // stage 00:32:40.533 [Pipeline] } 00:32:40.552 [Pipeline] // timeout 00:32:40.557 [Pipeline] } 00:32:40.576 [Pipeline] // catchError 00:32:40.582 [Pipeline] } 00:32:40.599 [Pipeline] // wrap 00:32:40.605 [Pipeline] } 00:32:40.621 [Pipeline] // catchError 00:32:40.631 [Pipeline] stage 00:32:40.634 [Pipeline] { (Epilogue) 00:32:40.648 [Pipeline] catchError 00:32:40.650 [Pipeline] { 00:32:40.666 [Pipeline] echo 00:32:40.668 Cleanup processes 00:32:40.675 [Pipeline] sh 00:32:40.962 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:32:40.962 3633548 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:32:40.976 [Pipeline] sh 00:32:41.259 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:32:41.259 ++ grep -v 'sudo pgrep' 00:32:41.259 ++ awk '{print $1}' 00:32:41.259 + sudo kill -9 00:32:41.259 + true 00:32:41.271 [Pipeline] sh 00:32:41.559 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:32:53.777 [Pipeline] sh 00:32:54.060 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:32:54.060 Artifacts sizes are good 00:32:54.074 [Pipeline] archiveArtifacts 00:32:54.081 Archiving artifacts 00:32:54.274 [Pipeline] sh 00:32:54.554 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:32:54.569 [Pipeline] cleanWs 00:32:54.578 [WS-CLEANUP] Deleting project workspace... 00:32:54.578 [WS-CLEANUP] Deferred wipeout is used... 00:32:54.584 [WS-CLEANUP] done 00:32:54.586 [Pipeline] } 00:32:54.606 [Pipeline] // catchError 00:32:54.618 [Pipeline] sh 00:32:54.897 + logger -p user.info -t JENKINS-CI 00:32:54.906 [Pipeline] } 00:32:54.922 [Pipeline] // stage 00:32:54.927 [Pipeline] } 00:32:54.943 [Pipeline] // node 00:32:54.949 [Pipeline] End of Pipeline 00:32:54.984 Finished: SUCCESS